Patient-reported outcomes of laparoscopic magnetic sphincter augmentation for gastro-oesophageal reflux disease

INTRODUCTION

Gastro-oesophageal reflux disease (GORD) is a chronic progressive disease, associated with substantial clinical and economic burden. Proton pump inhibitors (PPIs) are considered first-line treatment; however, there are concerns around the long-term impact of their usage. Surgical treatment with Nissen fundoplication can be considered but, because of the potential side effects, few patients undergo surgery and there remains a substantial therapeutic gap within the current treatment pathway. Laparoscopic magnetic sphincter augmentation (MSA) using the LINX® device is an alternative surgical approach.

METHODS

The objective of this study was to investigate patient-reported outcomes following laparoscopic MSA surgery using the LINX® device in a UK setting. A retrospective questionnaire obtained data regarding postoperative symptoms, medication use and patient satisfaction.

RESULTS

Out of 131 patients surveyed, 97 responses were received, with a minimum follow-up time of 1 year. In those who reported heartburn and regurgitation preoperatively, improvement was reported in 93% (84/90) and 90% (86/96) of patients, respectively. Eighty-eight per cent (73/83) of patients were able to completely stop or reduce their medication by at least 75%. Seventy-seven per cent (73/95) of patients were "very satisfied" or "satisfied".

CONCLUSIONS

This study is the first to present patient-reported outcomes of MSA using the LINX® device for patients with GORD in the UK. It demonstrates that the device has favourable outcomes and could effectively bridge the current therapeutic gap that exists between PPI medication and Nissen fundoplication.

The Bethesda ERCP Skills Assessment Tool (BESAT) can reliably differentiate endoscopists of different experience levels

Background and study aims The Bethesda ERCP Skill Assessment Tool (BESAT) is a video-based assessment tool of technical endoscopic retrograde cholangiopancreatography (ERCP) skill with previously established validity evidence. We aimed to assess the discriminative validity of the BESAT in differentiating ERCP skill levels. Methods Twelve experienced ERCP practitioners from tertiary academic centers were asked to blindly rate 43 ERCP videos using the BESAT. ERCP videos consisted of native biliary cannulation and sphincterotomy and were recorded from 10 unique endoscopists of various ERCP experience (from advanced endoscopy fellow to > 10 years of ERCP experience). Inter-rater reliability, discriminative validity, and internal structure validity were subsequently assessed. Results The BESAT was found to reliably differentiate between endoscopists of varying levels of ERCP experience with experienced ERCPists scoring higher than novice ERCPists in 11 of 13 (85%) instrument items. Inter-rater reliability for BESAT items ranged from good to excellent (intraclass correlation range: 0.86 to 0.93). Internal structure validity was assessed with item-total correlations ranging from 0.53 to 0.83. Conclusions Study findings demonstrate that the BESAT, a video-based ERCP skill assessment tool, has high inter-rater reliability and has discriminative validity in differentiating novice from expert ERCP skill. Further investigations are needed to determine the role of video-based assessment in improving trainee learning curves and patient outcomes.

Medical students' perceived comfort and competence performing physical examinations on patients with obesity: A mixed-methods needs assessment

Physicians are unsatisfied with their training in the care of patients with obesity. Physical examination is a key component of care, and modifications to techniques are often necessary for patients with obesity. To determine learning needs, we examined medical students' perceived comfort and competency in conducting physical examinations on patients with obesity. This mixed-methods study of Canadian medical students used a questionnaire and semi-structured focus groups to assess medical students' perceived comfort and competence in examining patients with obesity. Participants included 175 Canadian medical students. A minority of medical students felt comfortable (42%) or competent (14%) examining patients with obesity. Physical exam challenges included modifying exam manoeuvres, interpreting findings and communicating sensitively around weight. Lack of early exposure to patients with obesity, minimal instruction by preceptors and a lack of curricular focus on obesity were felt to be barriers to improving these skills. Students perceived their lack of confidence as negatively impacting their ability to manage patients with obesity and more training in this area was desired to prevent disparities in care. Medical students feel that adequate training on how to perform an obesity-specific physical examination is lacking. Developing curricula and including formal teaching around these key competencies within medical education is essential.

Effectiveness and safety of thin vs. thick cold snare polypectomy of small colorectal polyps: Systematic review and meta-analysis

Background and study aims Cold-snare polypectomy (CSP) is considered the standard of care for resection of colorectal polyps ≤10 mm. Data on the efficacy of CSP performed with thin-wire snares compared0 with thick-wire snares are conflicting. We performed a meta-analysis comparing complete resection (CR) and adverse event rates of CSP using thin-wire and thick-wire snares. Patients and methods Comparative studies of adult patients with ≧1 colorectal polyp(s) ≦10 mm who underwent CSP with thin-wire or thick-wire snares were included. We collected data on study, patient, polyp, and snare characteristics. The primary outcome was CR rate. Secondary outcomes were polyp retrieval rate, intraprocedural bleeding, delayed post-polypectomy bleeding, deep mural injury or perforation, patient discomfort, total sedation, and procedure time. We used random-effects models to calculate risk ratios for outcomes. We performed risk of bias assessments, rated the certainty of evidence, and assessed publication bias for all studies. Results We included four randomized controlled trials (RCTs) and two observational studies including 1316 patients with 1679 polyps (826 thin-wire CSPs and 853 thick-wire CSPs). There was no significant difference between thin-wire CSP (92.1%) and thick-wire CSP (87.7%) for RCTs (risk ratio [RR] 1.05, 95% confidence interval [CI] 0.94-1.16) or observational studies (78.1% versus 79.6%, RR 1.03, 95% CI 0.99-1.08). There were no significant differences in polyp retrieval rate or intraprocedural bleeding. There were no cases of delayed bleeding or perforation. Conclusions We found no differences in CR rates for CSP between thin-wire and thick-wire snares. CSP, regardless of snare type, is safe and effective for resection of small colorectal polyps.

Pediatric endoscopy: how can we improve patient outcomes and ensure best practices?

INTRODUCTION

Strategies to promote high-quality endoscopy in children require consensus around pediatric-specific quality standards and indicators. Using a rigorous guideline development process, the international Pediatric Endoscopy Quality Improvement Network (PEnQuIN) was developed to support continuous quality improvement efforts within and across pediatric endoscopy services.

AREAS COVERED

This review presents a framework, informed by the PEnQuIN guidelines, for assessing endoscopist competence, granting procedural privileges, audit and feedback, and for skill remediation, when required. As is critical for promoting quality, PEnQuIN indicators can be benchmarked at the individual endoscopist, endoscopy facility, and endoscopy community levels. Furthermore, efforts to incorporate technologies, including electronic medical records and artificial intelligence, into endoscopic quality improvement processes can aid in creation of large-scale networks to facilitate comparison and standardization of quality indicator reporting across sites.

EXPERT OPINION

PEnQuIN quality standards and indicators provide a framework for continuous quality improvement in pediatric endoscopy, benefiting individual endoscopists, endoscopy facilities, and the broader endoscopy community. Routine and reliable measurement of data, facilitated by technology, is required to identify and drive improvements in care. Engaging all stakeholders in endoscopy quality improvement processes is crucial to enhancing patient outcomes and establishing best practices for safe, efficient, and effective pediatric endoscopic care.

How to make cost-effective polyp simulators for high-fidelity simulation-based training in postpolypectomy bleeding management and EMR

Video 1Demonstration of manufacturing instructions and features of the postpolypectomy bleeding and conventional and underwater EMR simulators.

Promoting Research that Supports High-Quality Gastrointestinal Endoscopy in Children

PURPOSE OF REVIEW

Defining and measuring the quality of endoscopic care is a key component of performing gastrointestinal endoscopy in children. The purpose of this review is to discuss quality metrics for pediatric gastrointestinal endoscopy and identify where additional research is needed.

RECENT FINDINGS

Pediatric-specific standards and indicators were recently defined by the international Pediatric Endoscopy Quality Improvement Network (PEnQuIN) working group through a rigorous guideline consensus process. Although the aim of these guidelines is to facilitate best practices for safe and high-quality gastrointestinal endoscopy in children, they highlight the pressing need to expand upon the body of evidence supporting these standards and indicators as predictors of clinically relevant outcomes. In this review, we propose and discuss ideas for several high-yield research topics to engage pediatric endoscopists and promote best practices in pediatric endoscopy.

Validity evidence for observational ERCP competency assessment tools: a systematic review

BACKGROUND : Assessment of competence in endoscopic retrograde cholangiopancreatography (ERCP) is critical for supporting learning and documenting attainment of skill. Validity evidence supporting ERCP observational assessment tools has not been systematically evaluated. METHODS : We conducted a systematic search using electronic databases and hand-searching from inception until August 2021 for studies evaluating observational assessment tools of ERCP performance. We used a unified validity framework to characterize validity evidence from five sources: content, response process, internal structure, relations to other variables, and consequences. Each domain was assigned a score of 0-3 (maximum score 15). We assessed educational utility and methodological quality using the Accreditation Council for Graduate Medical Education framework and the Medical Education Research Quality Instrument, respectively. RESULTS : From 2769 records, we included 17 studies evaluating 7 assessment tools. Five tools were studied for clinical ERCP, one for simulated ERCP, and one for simulated and clinical ERCP. Validity evidence scores ranged from 2 to 12. The Bethesda ERCP Skills Assessment Tool (BESAT), ERCP Direct Observation of Procedural Skills Tool (ERCP DOPS), and The Endoscopic Ultrasound (EUS) and ERCP Skills Assessment Tool (TEESAT) had the strongest validity evidence, with scores of 10, 12, and 11, respectively. Regarding educational utility, most tools were easy to use and interpret, and required minimal additional resources. Overall methodological quality (maximum score 13.5) was strong, with scores ranging from 10 to 12.5. CONCLUSIONS : The BESAT, ERCP DOPS, and TEESAT had strong validity evidence compared with other assessments. Integrating tools into training may help drive learners' development and support competency decision making.

Transfusion medicine curricular content for general pediatricians and pediatric subspecialists: A national multi-specialty Delphi consensus study

BACKGROUND

Although pediatric residents frequently order blood products, transfusion medicine (TM) education is both limited and unstandardized during postgraduate training. Using Delphi methodology, this study aimed to identify and prioritize which pediatric TM curricular topics are most important to inform postgraduate training in TM for general pediatricians and pediatric subspecialists.

METHODS

A national panel of experts iteratively rated potential curricular topics, on a 5-point scale, to determine their priority for inclusion within a TM curriculum. After each round, responses were analyzed. Topics receiving a mean rating <3/5 were removed from subsequent rounds and remaining topics were resent to the panel for further ratings until consensus was achieved, defined as Cronbach α ≥ 0.95. At conclusion of the Delphi process, topics rated ≥4/5 were considered core curricular topics, while topics rated ≥3 to <4 were considered extended topics.

RESULTS

Forty-five TM experts from 17 Canadian institutions and 12 subspecialties completed the first Delphi round and 31 completed the second. Fifty-seven potential curricular topics were generated from a systematic literature review and Delphi panelists. Two survey rounds were completed before consensus was achieved. Seventy-three topics in six domains reached consensus: 31 core curricular topics and 42 extended topics. There were no significant differences in ratings between TM and non-TM specialists.

DISCUSSION

A multispecialty Delphi panel reached consensus in identification of curricular topics for pediatric resident physicians. These results set the stage to develop a pediatric TM curriculum that will be foundational for pediatric trainees to enhance learning and improve transfusion safety.

Video-based interventions to improve self-assessment accuracy among physicians: A systematic review

PURPOSE

Self-assessment of a physician's performance in both procedure and non-procedural activities can be used to identify their deficiencies to allow for appropriate corrective measures. Physicians are inaccurate in their self-assessments, which may compromise opportunities for self- development. To improve this accuracy, video-based interventions of physicians watching their own performance, an experts' performance or both, have been proposed to inform their self-assessment. We conducted a systematic review of the effectiveness of video-based interventions targeting improved self-assessment accuracy among physicians.

MATERIALS AND METHODS

The authors performed a systematic search of MEDLINE, Embase, EBM reviews, and Scopus databases from inception to August 23, 2022, using combinations of terms for "self-assessment", "video-recording", and "physician". Eligible studies were empirical investigations assessing the effect of video-based interventions on physicians' self-assessment accuracy with a comparison of self-assessment accuracy pre- and post- video intervention. We defined self-assessment accuracy as a "direct comparison between an external evaluator and self-assessment that was quantified using formal statistical analysis". Two reviewers independently screened records, extracted data, assessed risk of bias, and evaluated quality of evidence. A narrative synthesis was conducted, as variable outcomes precluded a meta-analysis.

RESULTS

A total of 2,376 papers were initially retrieved. Of these, 22 papers were selected for full-text review; a final 9 studies met inclusion criteria for data extraction. Across studies, 240 participants from 5 specialties were represented. Video-based interventions included self-video review (8/9), benchmark video review (3/9), and/or a combination of both types (1/9). Five out of nine studies reported that participants had inaccurate self-assessment at baseline. After the intervention, 5 of 9 studies found a statistically significant improvement in self-assessment accuracy.

CONCLUSIONS

Overall, current data suggests video-based interventions can improve self-assessment accuracy. Benchmark video review may enable physicians to improve self-assessment accuracy, especially for those with limited experience performing a particular clinical skill. In contrast, self-video review may be able to provide improvement in self-assessment accuracy for more experience physicians. Future research should use standardized methods of comparison for self-assessment accuracy, such as the Bland-Altman analysis, to facilitate meta-analytic summation.

Implementation of Video Laryngoscope-Assisted Coaching Reduces Adverse Tracheal Intubation-Associated Events in the PICU

OBJECTIVES

To evaluate implementation of a video laryngoscope (VL) as a coaching device to reduce adverse tracheal intubation associated events (TIAEs).

DESIGN

Prospective multicenter interventional quality improvement study.

SETTING

Ten PICUs in North America.

PATIENTS

Patients undergoing tracheal intubation in the PICU.

INTERVENTIONS

VLs were implemented as coaching devices with standardized coaching language between 2016 and 2020. Laryngoscopists were encouraged to perform direct laryngoscopy with video images only available in real-time for experienced supervising clinician-coaches.

MEASUREMENTS AND MAIN RESULTS

The primary outcome was TIAEs. Secondary outcomes included severe TIAEs, severe hypoxemia (oxygen saturation < 80%), and first attempt success. Of 5,060 tracheal intubations, a VL was used in 3,580 (71%). VL use increased from baseline (29.7%) to implementation phase (89.4%; p < 0.001). VL use was associated with lower TIAEs (VL 336/3,580 [9.4%] vs standard laryngoscope [SL] 215/1,480 [14.5%]; absolute difference, 5.1%; 95% CI, 3.1-7.2%; p < 0.001). VL use was associated with lower severe TIAE rate (VL 3.9% vs SL 5.3%; p = 0.024), but not associated with a reduction in severe hypoxemia (VL 15.7% vs SL 16.4%; p = 0.58). VL use was associated with higher first attempt success (VL 71.8% vs SL 66.6%; p < 0.001). In the primary analysis after adjusting for site clustering, VL use was associated with lower adverse TIAEs (odds ratio [OR], 0.61; 95% CI, 0.46-0.81; p = 0.001). In secondary analyses, VL use was not significantly associated with severe TIAEs (OR, 0.72; 95% CI, 0.44-1.19; p = 0.20), severe hypoxemia (OR, 0.95; 95% CI, 0.73-1.25; p = 0.734), or first attempt success (OR, 1.28; 95% CI, 0.98-1.67; p = 0.073). After further controlling for patient and provider characteristics, VL use was independently associated with a lower TIAE rate (adjusted OR, 0.65; 95% CI, 0.49-0.86; p = 0.003).

CONCLUSIONS

Implementation of VL-assisted coaching achieved a high level of adherence across the PICUs. VL use was associated with reduced adverse TIAEs.

The influence of resident and faculty gender on assessments in anesthesia competency-based medical education

PURPOSE

Competency-based medical education (CBME) relies on frequent workplace-based assessments of trainees, providing opportunities for conscious and implicit biases to reflect in these assessments. We aimed to examine the influence of resident and faculty gender on performance ratings of residents within a CBME system.

METHODS

This retrospective cohort study took place from August 2017 to January 2021 using resident assessment data from two workplace-based assessments: the Anesthesia Clinical Encounter Assessment (ACEA) and Entrustable Professional Activities (EPAs). Self-reported gender data were also extracted. The primary outcome-gender-based differences in entrustment ratings of residents on the ACEA and EPAs-was evaluated using mixed-effects logistic regression, with differences reported through odds ratios and confidence intervals (α = 0.01). Gender-based differences in the receipt of free-text comments on the ACEA and EPAs were also explored.

RESULTS

In total, 14,376 ACEA and 4,467 EPA assessments were analyzed. There were no significant differences in entrustment ratings on either assessment tool between men and women residents. Regardless of whether assessments were completed by men or women faculty, entrustment rates between men and women residents were not significantly different for any postgraduate year level. Additionally, men and women residents received strengths-related and actions-related comments on both assessments at comparable frequencies, irrespective of faculty gender.

CONCLUSION

We found no gender-based differences in entrustment ratings for both the ACEA and EPAs, which suggests an absence of resident gender bias within this CBME system. Given considerable heterogeneity in rater leniency, future work would be strengthened by using rater leniency-adjusted scores rather than raw scores.

Electronic Medical Records: Use as Tools for Improving Quality in Pediatric Endoscopy

Quality indicators and standards for pediatric endoscopy have recently been developed by the inaugural working group of the international Pediatric Endoscopy Quality Improvement Network (PEnQuIN). Currently available electronic medical record (EMR) functionalities can enable real-time capture of quality indicators to support continuous quality measurement and improvement within pediatric endoscopy facilities. Ultimately, EMR interoperability and cross-institutional data sharing can serve to validate PEnQuIN standards of care and permit benchmarking across endoscopy services, in the pursuit of elevating the quality of endoscopic care for children everywhere.

Enhancing Ergonomics in Pediatric Endoscopy Training and Practice

Pediatric endoscopists are at risk of work-related injuries from overuse and repetitive motions during endoscopy. Recently, there has been increasing appreciation for the importance of ergonomics education and training to help build long-term habits that prevent injury. This article reviews the epidemiology of endoscopy-related injuries in pediatric practice, describes methods for controlling exposures in the workplace, discusses key ergonomic principles that can be used to mitigate injury risk, and outlines tips for integrating education on endoscopy ergonomics during training.

Artificial Intelligence in Pediatric Endoscopy: Current Status and Future Applications

The application of artificial intelligence (AI) has great promise for improving pediatric endoscopy. The majority of preclinical studies have been undertaken in adults, with the greatest progress being made in the context of colorectal cancer screening and surveillance. This development has only been possible with advances in deep learning, like the convolutional neural network model, which has enabled real-time detection of pathology. Comparatively, the majority of deep learning systems developed in inflammatory bowel disease have focused on predicting disease severity and were developed using still images rather than videos. The application of AI to pediatric endoscopy is in its infancy, thus providing an opportunity to develop clinically meaningful and fair systems that do not perpetuate societal biases. In this review, we provide an overview of AI, summarize the advances of AI in endoscopy, and describe its potential application to pediatric endoscopic practice and education.

Impact of antegrade enema initiation on healthcare utilization in pediatric patients: A population-based cohort study

BACKGROUND

When constipation is refractory to first-line interventions, antegrade enema use may be considered. We aimed to assess the impact of this intervention on healthcare utilization.

METHODS

We conducted a population-based, quasi-experimental study with pre-post comparison of the intervention group and a non-equivalent control group using linked clinical and health administrative data from Ontario, Canada. Subjects included children (0-18 years) who underwent antegrade enema initiation from 2007 to 2020 and matched controls (4:1) from the general population. To assess the change in healthcare utilization following antegrade enema initiation, we used negative binomial generalized estimating equations with covariates selected a priori.

KEY RESULTS

One hundred thirty-eight subjects met eligibility criteria (appendicostomy = 55 (39.9%); cecostomy tube = 83 (60.1%)) and were matched to 550 controls. There was no significant difference in the change in the rate of hospitalizations (rate ratio (RR) 1.05, 95% confidence interval (CI) 0.35-1.75), outpatient visits (RR 1.05, 95% CI 0.91-1.18), or same-day surgical procedures (RR 1.51, 95% CI 0.60-2.43) across cases in 2 years following antegrade enema initiation compared with controls. Cases had an increased rate of emergency department (ED) visits, which was not observed in controls (RR 1.52, 95% CI 1.11-1.79), driven in part by device-related complications.

CONCLUSIONS AND INFERENCES

Understanding healthcare utilization patterns following antegrade enema initiation allows for effective health system planning and aids medical decision-making. The observed increase in ED visits for device-related complications speaks to the need to improve preventive management to help mitigate emergency care after initiation of antegrade enemas.

Accuracy of self-assessment in gastrointestinal endoscopy: a systematic review and meta-analysis

BACKGROUND

Assessment is necessary to ensure both attainment and maintenance of competency in gastrointestinal (GI) endoscopy, and this can be accomplished through self-assessment. We conducted a systematic review with meta-analysis to evaluate the accuracy of self-assessment among GI endoscopists.

METHODS

This was an individual participant data meta-analysis of studies that investigated self-assessment of endoscopic competency. We performed a systematic search of the following databases: Ovid MEDLINE, Ovid EMBASE, Wiley Cochrane CENTRAL, and ProQuest Education Resources Information Center. We included studies if they were primary investigations of self-assessment accuracy in GI endoscopy that used statistical analyses to determine accuracy. We conducted a meta-analysis of studies using a limits of agreement (LoA) approach to meta-analysis of Bland-Altman studies.

RESULTS

After removing duplicate entries, we screened 7138 records. After full-text review, we included 16 studies for qualitative analysis and three for meta-analysis. In the meta-analysis, we found that the LoA were wide (-41.0 % to 34.0 %) and beyond the clinically acceptable difference. Subgroup analyses found that both novice and intermediate endoscopists had wide LoA (-45.0 % to 35.1 % and -54.7 % to 46.5 %, respectively) and expert endoscopists had narrow LoA (-14.2 % to 21.4 %).

CONCLUSIONS

GI endoscopists are inaccurate in self-assessment of their endoscopic competency. Subgroup analyses demonstrated that novice and intermediate endoscopists were inaccurate, while expert endoscopists have accurate self-assessment. While we advise against the sole use of self-assessment among novice and intermediate endoscopists, expert endoscopists may wish to integrate it into their practice.

"Walking on both sides of the fence": A qualitative exploration of the challenges and opportunities facing emergent clinician-scientists in child health

RATIONALE, AIMS, AND OBJECTIVES

While paediatric clinician-scientists are ideally positioned to generate clinically relevant research and translate research evidence into practice, they face challenges in this dual role. The authors sought to explore the unique contributions, opportunities, and challenges of paediatric clinician-scientists, including issues related to training and ongoing support needs to ensure their success.

METHOD

The authors used a qualitative descriptive approach with thematic analysis to explore the experiences of clinician-scientist stakeholders in child health (n = 39). Semi-structured interviews (60 min) were conducted virtually and recorded. Thematic analysis was conducted according to the phases outlined by Braun and Clarke (2006).

RESULTS

The analysis resulted in the creation of three themes: (1) "Walking on both sides of the fence": unique positioning of clinician-scientists for advancing clinical practice and research; (2) the clinician-scientist: a specialized role with significant challenges; and (3) beyond the basics of clinical and research training programmes: essential skill sets and knowledge for future clinician-scientists.

CONCLUSIONS

While clinician-scientists can make unique contributions to the advancement of evidence-based practice, they face significant barriers straddling their dual roles including divergent institutional cultures in healthcare and academia and a lack of infrastructure to effectively support clinician-scientist positions. Training programmes can play an important role in mentoring and supporting early-career clinician-scientists.

Musculoskeletal injury and ergonomics in pediatric gastrointestinal endoscopic practice

BACKGROUND AND AIMS

Endoscopy-related musculoskeletal injuries (ERI) are increasingly prevalent in adult endoscopists; however, there are no studies that have evaluated ERI and ergonomic practices among pediatric gastroenterologists and trainees. We aimed to examine the prevalence, nature, and impact of musculoskeletal injuries in pediatric endoscopic practice and assess attitudes towards ergonomic training needs.

METHODS

Pediatric gastroenterologists and trainees were surveyed to collect information on endoscopist and practice characteristics, the prevalence, nature, and impacts of ERI, ergonomics strategies employed in practice, previous ergonomics training, and perceptions of ergonomics training (elicited using a 1 (strongly disagree) to 5 (strongly agree) Likert scale). Responses were analyzed using descriptive statistics, and bivariate analyses were conducted to explore correlates of ERI.

RESULTS

Among 146 survey respondents, 50 (34.2%) were trainees and 96 (65.8%) were practicing endoscopists with a mean duration of endoscopic practice of 9.7 ± 9.4 years. Overall, 55.6% (n = 80/144) reported experiencing a musculoskeletal injury, with 34.7% (n = 50/144) reporting an injury attributable to endoscopy. Among those with ERI, the most common sites were the neck/upper back (44.0%), thumb (42.0%), hand/finger (38.0%), and lower back (36.0%). Women were more likely to experience ERI compared to men (43.4% vs. 23.4%; p = 0.013). Only 20.9% of participants had formal training in ergonomics. Respondents reported being motivated to implement practice changes to prevent ERI (4.41 ± 0.95) and perceived ergonomics training as important (4.37 ± 0.96).

CONCLUSIONS

Pediatric endoscopists, and particularly women, experience significant ERI; however, formal endoscopy ergonomics training is rare. Improved ergonomics training is needed for both practicing pediatric gastroenterologists and trainees.

Effect of Wearing a Face Mask on Hand-to-Face Contact by Children in a Simulated School Environment: The Back-to-School COVID-19 Simulation Randomized Clinical Trial

IMPORTANCE

Wearing a face mask in school can reduce SARS-CoV-2 transmission but it may also lead to increased hand-to-face contact, which in turn could increase infection risk through self-inoculation.

OBJECTIVE

To evaluate the effect of wearing a face mask on hand-to-face contact by children while at school.

DESIGN, SETTING, AND PARTICIPANTS

This prospective randomized clinical trial randomized students from junior kindergarten to grade 12 at 2 schools in Toronto, Ontario, Canada, during August 2020 in a 1:1 ratio to either a mask or control class during a 2-day school simulation. Classes were video recorded from 4 angles to accurately capture outcomes.

INTERVENTIONS

Participants in the mask arm were instructed to bring their own mask and wear it at all times. Students assigned to control classes were not required to mask at any time (grade 4 and lower) or in the classroom where physical distancing could be maintained (grade 5 and up).

MAIN OUTCOMES AND MEASURES

The primary outcome was the number of hand-to-face contacts per student per hour on day 2 of the simulation. Secondary outcomes included hand-to-mucosa contacts and hand-to-nonmucosa contacts. A mixed Poisson regression model was used to derive rate ratios (RRs), adjusted for age and sex with a random intercept for class with bootstrapped 95% CIs.

RESULTS

A total of 174 students underwent randomization and 171 students (mask group, 50.6% male; control group, 52.4% male) attended school on day 2. The rate of hand-to-face contacts did not differ significantly between the mask and the control groups (88.2 vs 88.7 events per student per hour; RR, 1.00; 95% CI, 0.78-1.28; P = >.99). When compared with the control group, the rate of hand-to-mucosa contacts was significantly lower in the mask group (RR, 0.12; 95% CI, 0.07-0.21), while the rate of hand-to-nonmucosa contacts was higher (RR, 1.40; 95% CI, 1.08-1.82).

CONCLUSIONS AND RELEVANCE

In this clinical trial of simulated school attendance, hand-to-face contacts did not differ among students required to wear face masks vs students not required to wear face masks; however, hand-to-mucosa contracts were lower in the face mask group. This suggests that mask wearing is unlikely to increase infection risk through self-inoculation.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT04531254.

Codevelopment and usability testing of Patient Engagement 101: a Patient-Oriented Research Curriculum in Child Health e-learning module for health care professionals, researchers and trainees

BACKGROUND

Patient and family engagement is thought to improve the quality and relevance of child health research. We developed and evaluated the usability of Patient Engagement 101, an e-learning module designed to strengthen the patient-oriented research readiness of health care professionals, researchers, trainees and other stakeholders.

METHODS

The development of Patient Engagement 101 was co-led by a parent and a researcher and overseen by a diverse multistake-holder steering committee. The module was refined and evaluated using a mixed-methods usability testing approach with 2 iterative cycles of semistructured interviews, observations and questionnaires. We collected module feedback by way of semistructured interviews, the validated System Usability Scale, and satisfaction, knowledge and confidence questionnaires. Thematic coding of transcripts and field notes, informed by team discussions, guided the module revisions.

RESULTS

Thirty end-users completed usability testing (15 per cycle). In each cycle, we modified the module with respect to its content, learner experience, learner-centred design and aesthetic design. Participants were highly satisfied, and System Usability Scale scores indicated the module had the best imaginable usability. Substantial increases in the participants' knowledge test scores and the confidence to engage in patient-oriented research, but not self-rated knowledge, were observed after module completion.

INTERPRETATION

Codevelopment with patients and caregivers, and refinement through comprehensive end-user testing, resulted in a training resource with exceptional usability that improved knowledge and confidence to engage in patient-oriented research in child health. Patient Engagement 101 is openly available online, and the methods used to develop and evaluate it may facilitate the creation and evaluation of similar capacity-building resources.

Pediatric Endoscopy Quality Improvement Network (PEnQuIN) quality standards and indicators for pediatric endoscopy: an ASGE-endorsed guideline

BACKGROUND AND AIMS

Current endoscopy quality guidelines largely focus on cancer screening-related metrics that are not applicable to pediatric populations. Through an international Pediatric Endoscopy Quality Improvement Network (PEnQuIN), quality standards and indicators for pediatric endoscopic procedures were developed and endorsed by the American Society for Gastrointestinal Endoscopy (ASGE).

METHODS

The Appraisal of Guidelines for REsearch and Evaluation II instrument guided PEnQuIN members, from 31 centers representing 11 countries, in generating and refining proposed quality standards and indicators. Quality of evidence and strength of recommendations were rated according to the Grading of Recommendation Assessment, Development, and Evaluation approach. Consensus on reporting elements was sought with an iterative online Delphi process.

RESULTS

Forty-nine quality standards and 47 indicators, encompassing pediatric endoscopy facilities, procedures, and endoscopists, as well as 30 reporting elements essential for inclusion within a pediatric endoscopy report reached consensus. Minimal acceptable standards were defined for 3 key indicators related to pediatric lower endoscopy: terminal ileal intubation rate ≥85%, cecal intubation rate ≥90%, and rate of adequate bowel preparation ≥80%. There was strong consensus that terminal ileal intubation, rather than cecal intubation, is integral to ensuring high-quality endoscopic care in children.

CONCLUSIONS

The PEnQuIN guidelines establish international agreement on clinically meaningful metrics tailored to pediatric endoscopy that can be used to promote safe, high-quality, patient- and family-centered endoscopic care. Moving forward, it is recommended that all providers and facilities involved in endoscopy service for children adopt the PEnQuIN standards, indicators, and key reporting elements outlined in these ASGE-endorsed guidelines.

Curricula, Teaching Methods, and Success Metrics of Clinician-Scientist Training Programs: A Scoping Review

PURPOSE

To describe the literature on clinician-scientist training programs to inform the development of contemporary and inclusive training models.

METHOD

The authors conducted a scoping review, searching the PubMed/MEDLINE, CINAHL, and Embase databases from database inception until May 25, 2020. Studies presenting primary research that described and evaluated clinician-scientist training programs were identified for data abstraction. On the basis of deductive and inductive methods, information about program characteristics, curricula, teaching strategies, and success metrics was extracted. The extracted variables were analyzed using descriptive statistics.

RESULTS

From the initial 7,544 citations retrieved and 4,974 unique abstracts screened, 81 studies were included. Of the 81 included studies, 65 (80.2%) were published between 2011 and 2020, 54 (66.7%) were conducted in the United States, and 64 (79.0%) described programs that provided broad clinician-scientist training. Few programs provided funding or protected research time or specifically addressed needs of trainees from underrepresented minority groups. Curricula emphasized research methods and knowledge dissemination, whereas patient-oriented research competencies were not described. Most programs incorporated aspects of mentorship and used multiple teaching strategies, such as direct and interactive instruction. Extrinsic metrics of success (e.g., research output) were dominant in reported program outcomes compared with markers of intrinsic success (e.g., career fulfillment).

CONCLUSIONS

Although programs are providing clinician-scientists with practical skills training, opportunities exist for curricular and pedagogic optimization that may better support this complex career path. Training programs for clinician-scientists can address contemporary issues of wellness and equity by reconsidering metrics of program success and evolving the core tenets of their education models to include equity, diversity, and inclusion principles and patient-oriented research competencies.

Equity, diversity and inclusion of pediatric clinician-scientists in Canada: a thematic analysis

BACKGROUND

Underrepresented voices and perspectives are missing from academic and clinical health sciences. We aimed to define the unique opportunities and challenges of pediatric clinician-scientists related to equity, diversity and inclusion; and to identify key components of training needed to support people from equity-seeking groups as emerging and early-career pediatric clinician-scientists to generate diverse health research leaders in knowledge generation, implementation and translation.

METHODS

Using a qualitative descriptive approach, we examined the experiences of clinician stakeholders. Semistructured interviews were conducted with pediatric clinician-scientist stakeholders. Thematic analysis was performed.

RESULTS

We interviewed a total of 39 individuals. Our analysis resulted in 4 interrelated themes: the pervasiveness and invisibility of sexism; the invisibility and visibility of racism; proposed individual-level solutions to the sexism and racism; and proposed institutional and system-level changes to address the porous and leaky pipeline. These themes acknowledged that, ultimately, system change is required for addressing equity, diversity and inclusion in clinical and academic training environments.

INTERPRETATION

These findings highlight the importance of addressing systemic biases that limit the inclusion of women and racialized individuals in pediatric clinician-scientist careers. Further research is needed to explore the problem of exclusion, which will, in turn, inform education of pediatric clinician-scientists and inform better ways to promote equity, diversity and inclusivity; these steps are needed to foster systemic change in the cultures that perpetuate exclusivity in both academic and clinical communities.

A prospective observational study of video laryngoscopy-guided coaching in the pediatric intensive care unit

BACKGROUND

There are limited data on the use of video laryngoscopy for pediatric patients outside of the operating room.

AIM

Our primary aim was to evaluate whether implementation of video laryngoscopy-guided coaching for tracheal intubation is feasible with a high level of compliance and associated with a reduction in adverse tracheal intubation-associated events.

METHODS

This is a pre-post observational study of video laryngoscopy implementation with standardized coaching language for tracheal intubation in a single-center, pediatric intensive care unit. The use of video laryngoscopy as a coaching device with standardized coaching language was implemented as a part of practice improvement. All patients in the pediatric intensive care unit were included between January 2016 and December 2017 who underwent primary tracheal intubation with either video laryngoscopy or direct laryngoscopy. The uptake of the implementation, sustained compliance, tracheal intubation outcomes including all adverse tracheal intubation-associated events, oxygen desaturations (<80% SpO2), and first attempt success were measured.

RESULTS

Among 580 tracheal intubations, 284 (49%) were performed during the preimplementation phase, and 296 (51%) postimplementation. Compliance for the use of video laryngoscopy with standardized coaching language was high (74% postimplementation) and sustained. There were no statistically significant differences in adverse tracheal intubation-associated events between the two phases (pre- 9% vs. post- 5%, absolute difference -3%, CI95 : -8% to 1%, p = .11), oxygen desaturations <80% (pre- 13% vs. post- 13%, absolute difference 1%, CI95 : -6% to 5%, p = .75), or first attempt success (pre- 73% vs. post- 76%, absolute difference 4%, CI95 : -3% to 11%, p = .29). Supervisors were more likely to use the standardized coaching language when video laryngoscopy was used for tracheal intubation than with standard direct laryngoscopy (80% vs. 43%, absolute difference 37%, CI95 : 23% to 51%, p < .001).

CONCLUSIONS

Implementation of video laryngoscopy as a supervising device with standardized coaching language was feasible with high level of adherence, yet not associated with an increased occurrence of any adverse tracheal intubation-associated events and oxygen desaturation.

Advances in Pediatric Diagnostic Endoscopy: A State-of-the-Art Review

Pediatric endoscopy has revolutionized the way we diagnose and treat gastrointestinal disorders in children. Technological advances in computer processing and imaging continue to affect endoscopic equipment and advance diagnostic tools for pediatric endoscopy. Although commonly used by adult gastroenterologists, modalities, such as endomicroscopy, image-enhanced endoscopy, and impedance planimetry, are not routinely used in pediatric gastroenterology. This state-of-the-art review describes advances in diagnostic modalities, including image-enhanced endoscopy, confocal laser endomicroscopy, optical coherence tomography, endo functional luminal imaging probes, wireless motility/pH capsule, wireless colon capsule endoscopy, endoscopic ultrasound, and discusses the basic principles of each technology, including adult indications and pediatric applications, safety cost, and training data.

Variable or Fixed? Exploring Entrustment Decision Making in Workplace- and Simulation-Based Assessments

PURPOSE

Many models of competency-based medical education (CBME) emphasize assessing entrustable professional activities (EPAs). Despite the centrality of EPAs, researchers have not compared rater entrustment decisions for the same EPA across workplace- and simulation-based assessments. This study aimed to explore rater entrustment decision making across these 2 assessment settings.

METHOD

An interview-based study using a constructivist grounded theory approach was conducted. Gastroenterology faculty at the University of Toronto and the University of Calgary completed EPA assessments of trainees' endoscopic polypectomy performance in both workplace and simulation settings between November 2019 and January 2021. After each assessment, raters were interviewed to explore how and why they made entrustment decisions within and across settings. Transcribed interview data were coded iteratively using constant comparison to generate themes.

RESULTS

Analysis of 20 interviews with 10 raters found that participants (1) held multiple meanings of entrustment and expressed variability in how they justified their entrustment decisions and scoring, (2) held personal caveats for making entrustment decisions "comfortably" (i.e., authenticity, task-related variability, opportunity to assess trainee responses to adverse events, and the opportunity to observe multiple performances over time), (3) experienced cognitive tensions between formative and summative purposes when assessing EPAs, and (4) experienced relative freedom when using simulation to formatively assess EPAs but constraint when using only simulation-based assessments for entrustment decision making.

CONCLUSIONS

Participants spoke about and defined entrustment variably, which appeared to produce variability in how they judged entrustment across participants and within and across assessment settings. These rater idiosyncrasies suggest that programs implementing CBME must consider how such variability affects the aggregation of EPA assessments, especially those collected in different settings. Program leaders might also consider how to fulfill raters' criteria for comfortably making entrustment decisions by ensuring clear definitions and purposes when designing and integrating workplace- and simulation-based assessments.

How Clinical Supervisors Conceptualize Procedural Entrustment: An Interview-Based Study of Entrustment Decision Making in Endoscopic Training

PURPOSE

Entrustment is central to assessment in competency-based medical education (CBME). To date, little research has addressed how clinical supervisors conceptualize entrustment, including factors they consider in making entrustment decisions. The aim of this study was to characterize supervisors' decision making related to procedural entrustment, using gastrointestinal endoscopy as a test case.

METHOD

Using methods from constructivist grounded theory, the authors interviewed 29 endoscopy supervisors in the United States and Canada across multiple specialties (adult and pediatric gastroenterology, surgery, and family medicine). Semistructured interviews, conducted between April and November 2019, focused on how supervisors conceptualize procedural entrustment, how they make entrustment decisions, and what factors they consider. Transcripts were analyzed using constant comparison to generate an explanatory framework and themes.

RESULTS

Three themes were identified from the analysis of interview transcripts: (1) entrustment occurs in varying degrees and fluctuates over time; (2) entrustment decisions can transfer within and across procedural and nonprocedural contexts; (3a) persistent static factors (e.g., supervisor competence, institutional culture, legal considerations) influence entrustment decisions, as do (3b) fluctuating, situated dynamic factors (e.g., trainee skills, patient acuity, time constraints), which tend to change from one training encounter to the next.

CONCLUSIONS

In the process of making procedural entrustment decisions, clinical supervisors appear to synthesize multiple dynamic factors against a background of static factors, culminating in a decision of whether to entrust. Entrustment decisions appear to fluctuate over time, and assessors may transfer decisions about specific trainees across settings. Understanding which factors supervisors perceive as influencing their decision making has the potential to inform faculty development, as well as competency committees seeking to aggregate faculty judgments about trainee unsupervised practice. Those leading CBME programs may wish to invest in optimizing the observed static factors, such that these foundational factors are tuned to facilitate trainee learning and achievement of entrustment.

Pediatric Endoscopy Quality Improvement Network Quality Standards and Indicators for Pediatric Endoscopic Procedures: A Joint NASPGHAN/ESPGHAN Guideline

INTRODUCTION

High-quality pediatric gastrointestinal procedures are performed when clinically indicated and defined by their successful performance by skilled providers in a safe, comfortable, child-oriented, and expeditious manner. The process of pediatric endoscopy begins when a plan to perform the procedure is first made and ends when all appropriate patient follow-up has occurred. Procedure-related standards and indicators developed to date for endoscopy in adults emphasize cancer screening and are thus unsuitable for pediatric medicine.

METHODS

With support from the North American and European Societies of Pediatric Gastroenterology Hepatology and Nutrition (NASPGHAN and ESPGHAN), an international working group of the Pediatric Endoscopy Quality Improvement Network (PEnQuIN) used the methodological strategy of the Appraisal of Guidelines for REsearch and Evaluation (AGREE) II instrument to develop standards and indicators relevant for assessing the quality of endoscopic procedures. Consensus was sought via an iterative online Delphi process and finalized at an in-person conference. The quality of evidence and strength of recommendations were rated according to the GRADE (Grading of Recommendation Assessment, Development, and Evaluation) approach.

RESULTS

The PEnQuIN working group achieved consensus on 14 standards for pediatric endoscopic procedures, as well as 30 indicators that can be used to identify high-quality procedures. These were subcategorized into three subdomains: Preprocedural (3 standards, 7 indicators), Intraprocedural (8 standards, 18 indicators), and Postprocedural (3 standards, 5 indicators). A minimum target for the key indicator, "rate of adequate bowel preparation," was set at ≥80%.

DISCUSSION

It is recommended that all facilities and individual providers performing pediatric endoscopy worldwide initiate and engage with the procedure-related standards and indicators developed by PEnQuIN to identify gaps in quality and drive improvement.

Overview of the Pediatric Endoscopy Quality Improvement Network Quality Standards and Indicators for Pediatric Endoscopy: A Joint NASPGHAN/ESPGHAN Guideline

INTRODUCTION

Pediatric-specific quality standards for endoscopy are needed to define best practices, while measurement of associated indicators is critical to guide quality improvement. The international Pediatric Endoscopy Quality Improvement Network (PEnQuIN) working group was assembled to develop and define quality standards and indicators for pediatric gastrointestinal endoscopic procedures through a rigorous guideline consensus process.

METHODS

The Appraisal of Guidelines for REsearch and Evaluation (AGREE) II instrument guided PEnQuIN members, recruited from 31 centers of various practice types representing 11 countries, in generating and refining proposed quality standards and indicators. Consensus was sought via an iterative online Delphi process, and finalized at an in-person conference. Quality of evidence and strength of recommendations were rated according to the GRADE (Grading of Recommendation Assessment, Development, and Evaluation) approach.

RESULTS

Forty-nine quality standards and 47 indicators reached consensus, encompassing pediatric endoscopy facilities, procedures, endoscopists, and the patient experience. The evidence base for PEnQuIN standards and indicators was largely adult-based and observational, and downgraded for indirectness, imprecision, and study limitations to "very low" quality, resulting in "conditional" recommendations for most standards (45/49).

CONCLUSIONS

The PEnQuIN guideline development process establishes international agreement on clinically meaningful metrics that can be used to promote safety and quality in endoscopic care for children. Through PEnQuIN, pediatric endoscopists and endoscopy services now have a framework for auditing, providing feedback, and ultimately, benchmarking performance. Expansion of evidence and prospective validation of PEnQuIN standards and indicators as predictors of clinically relevant outcomes and high-quality pediatric endoscopic care is now a research priority.

Pediatric Endoscopy Quality Improvement Network Pediatric Endoscopy Reporting Elements: A Joint NASPGHAN/ESPGHAN Guideline

INTRODUCTION

High-quality procedure reports are a cornerstone of high-quality pediatric endoscopy as they ensure the clear communication of procedural events and outcomes, guide patient care and facilitate continuous quality improvement. The aim of this document is to outline standardized reporting elements that achieved international consensus as requirements for high-quality pediatric endoscopy procedure reports.

METHODS

With support from the North American and European Societies of Pediatric Gastroenterology, Hepatology and Nutrition (NASPGHAN and ESPGHAN), an international working group of the Pediatric Endoscopy Quality Improvement Network (PEnQuIN) used Delphi methodology to identify key elements that should be found in all pediatric endoscopy reports. Item reduction was attained through iterative rounds of anonymized online voting using a 6-point scale. Responses were analyzed after each round and items were excluded from subsequent rounds if ≤50% of panelists rated them as 5 ("agree moderately") or 6 ("agree strongly"). Reporting elements that ≥70% of panelists rated as "agree moderately" or "agree strongly" were considered to have achieved consensus.

RESULTS

Twenty-six PEnQuIN group members from 25 centers internationally rated 63 potential reporting elements that were generated from a systematic literature review and the Delphi panelists. The response rates were 100% for all three survey rounds. Thirty reporting elements reached consensus as essential for inclusion within a pediatric endoscopy report.

DISCUSSION

It is recommended that the PEnQuIN Reporting Elements for pediatric endoscopy be universally employed across all endoscopists, procedures and facilities as a foundational means of ensuring high-quality endoscopy services, while facilitating quality improvement activities in pediatric endoscopy.

Pediatric Endoscopy Quality Improvement Network Quality Standards and Indicators for Pediatric Endoscopists and Endoscopists in Training: A Joint NASPGHAN/ESPGHAN Guideline

INTRODUCTION

High-quality pediatric endoscopy requires reliable performance of procedures by competent individual providers who consistently uphold all standards determined to assure optimal patient outcomes. Establishing consensus expectations for ongoing monitoring and assessment of individual pediatric endoscopists is a method for confirming the highest possible quality of care for such procedures worldwide. We aim to provide guidance to define and measure quality of endoscopic care for children.

METHODS

With support from the North American and European Societies of Pediatric Gastroenterology Hepatology and Nutrition (NASPGHAN and ESPGHAN), an international working group of the Pediatric Endoscopy Quality Improvement Network (PEnQuIN) used the methodological strategy of the Appraisal of Guidelines for REsearch and Evaluation (AGREE) II instrument to develop standards and indicators relevant for assessing the quality of endoscopists. Consensus was sought via an iterative online Delphi process and finalized at an in-person conference. The quality of evidence and strength of recommendations were rated according to the GRADE (Grading of Recommendation Assessment, Development, and Evaluation) approach.

RESULTS

The PEnQuIN working group achieved consensus on 6 standards that all providers who perform pediatric endoscopy should uphold and 2 standards for pediatric endoscopists in training, with 7 corresponding indicators that can be used to identify high-quality endoscopists. Additionally, these can inform continuous quality improvement at the provider level. Minimum targets for defining high-quality pediatric ileocolonoscopy were set for 2 key indicators: cecal intubation rate (≥90%) and terminal ileal intubation rate (≥85%).

DISCUSSION

It is recommended that all individual providers performing or training to perform pediatric endoscopy initiate and engage with these international endoscopist-related standards and indicators developed by PEnQuIN.

Pediatric Endoscopy Quality Improvement Network Quality Standards and Indicators for Pediatric Endoscopy Facilities: A Joint NASPGHAN/ESPGHAN Guideline

INTRODUCTION

There is increasing international recognition of the impact of variability in endoscopy facilities on procedural quality and outcomes. There is also growing precedent for assessing the quality of endoscopy facilities at regional and national levels by using standardized rating scales to identify opportunities for improvement.

METHODS

With support from the North American and European Societies of Pediatric Gastroenterology Hepatology and Nutrition (NASPGHAN and ESPGHAN), an international working group of the Pediatric Endoscopy Quality Improvement Network (PEnQuIN) used the methodological strategy of the Appraisal of Guidelines for REsearch and Evaluation (AGREE) II instrument to develop standards and indicators relevant for assessing the quality of facilities where endoscopic care is provided to children. Consensus was reached via an iterative online Delphi process and subsequent in-person meeting. The quality of evidence and strength of recommendations were rated according to the GRADE (Grading of Recommendation Assessment, Development and Evaluation) approach.

RESULTS

The PEnQuIN working group achieved consensus on 27 standards for facilities supporting pediatric endoscopy, as well 10 indicators that can be used to identify high-quality endoscopic care in children. These standards were subcategorized into three subdomains: Quality of Clinical Operations (15 standards, 5 indicators); Patient and Caregiver Experience (9 standards, 5 indicators); and Workforce (3 standards).

DISCUSSION

The rigorous PEnQuIN process successfully yielded standards and indicators that can be used to universally guide and measure high-quality facilities for procedures around the world where endoscopy is performed in children. It also underscores the current paucity of evidence for pediatric endoscopic care processes, and the need for research into this clinical area.

Co-development and Usability Testing of Research 101: A Patient-Oriented Research Curriculum in Child Health (PORCCH) E-Learning Module for Patients and Families

BACKGROUND

Engaging patients and families as research partners increases the relevance, quality, and impact of child health research. However, those interested in research engagement may feel underequipped to meaningfully partner. We sought to co-develop an online learning (e-learning) module, "Research 101," to support capacity-development in patient-oriented child health research amongst patients and families.

METHODS

Module co-development was co-led by a parent and researcher, with guidance from a diverse, multi-stakeholder steering committee. A mixed-methods usability testing approach, with three iterative cycles of semi-structured interviews, observations, and questionnaires, was used to refine and evaluate the e-learning module. Module feedback was collected during testing and a post-module interview, and with the validated System Usability Scale (SUS), and satisfaction, knowledge, and self-efficacy questionnaires. Transcripts and field notes were analyzed through team discussion and thematic coding to inform module revisions.

RESULTS

Thirty participants fully tested Research 101, and another 15 completed confirmatory usability testing (32 caregivers, 6 patients, and 7 clinician-researchers). Module modifications pertaining to learner-centered design, content, aesthetic design, and learner experience were made in each cycle. SUS scores indicated the overall usability of the final version was "excellent." Participants' knowledge of patient-oriented research and self-efficacy to engage in research improved significantly after completing Research 101 (p < 0.01).

CONCLUSIONS

Co-development and usability testing facilitated the creation of an engaging and effective resource to support the scaling up of patient-oriented child health research capacity. The methods and findings of this study may help guide the integration of co-development and usability testing in creating similar resources.

Pediatric Chronic Tracheostomy Care: An Evaluation of an Innovative Competency-Based Education Program for Community Health Care Providers

OBJECTIVE

To evaluate the immediate and sustained knowledge retention and sense of self-efficacy of homecare nurses following completion of a standardized competency-based tracheostomy education course. Safe discharge of children requiring tracheostomy with or without ventilation relies on the competence of homecare nurses.

STUDY DESIGN

Pragmatic, randomized controlled trial of 44 homecare nurses. Participants were randomized into the intervention group (n = 21), which received the tracheostomy course, or the control group (n = 23), which received an enterostomy and vascular access course. Multiple-choice question (MCQ) knowledge assessments and self-efficacy questionnaires were administered to both groups pre-course and post-course at 6 week, 3 month, 6 month, and 12 month follow-ups.

RESULTS

Twenty participants in the intervention group and 19 in the control group were included. Four withdrew from the study and two crossed over from the control into the intervention arm. The change in mean self-efficacy scores (total score = 100) was significantly higher in the intervention group than in the control group at 6 weeks (intervention (mean ± SD): 18.6 ± 14.5; control: 6.6 ± 20.4; p = 0.04) and 3 months (intervention: 19.6 ± 14.2; control: 5.2 ± 17.0; p = 0.007), and trended higher at 6 months (intervention: 18.0 ± 14.5; control: 6.9 ± 24.1; p = 0.1). The change in mean MCQ assessment scores (total score = 20) trended higher in the intervention group than in the control group at 6 weeks (intervention (mean ± SD): 1.8 ± 2.2; control: 1.6, ± 2.9; p = 0.8).

CONCLUSIONS

Homecare nurses who attended the tracheostomy course demonstrated a higher sense of self-efficacy at long-term follow-up.

CLINICAL TRIAL REGISTRATION

www.ClinicalTrials.gov, identifier: NCT04559932.

Colonoscopy competence assessment tools: a systematic review of validity evidence

BACKGROUND

Assessment tools are essential for endoscopy training, being required to support feedback provision, optimize learner capabilities, and document competence. We aimed to evaluate the strength of validity evidence that supports the available colonoscopy direct observation assessment tools using the unified framework of validity.

METHODS

We systematically searched five databases for studies investigating colonoscopy direct observation assessment tools from inception until 8 April 2020. We extracted data outlining validity evidence (content, response process, internal structure, relations to other variables, and consequences) from the five sources and graded the degree of evidence, with a maximum score of 15. We assessed educational utility using an Accreditation Council for Graduate Medical Education framework and methodological quality using the Medical Education Research Quality Instrument (MERSQI).

RESULTS

From 10 841 records, we identified 27 studies representing 13 assessment tools (10 adult, 2 pediatric, 1 both). All tools assessed technical skills, while 10 each assessed cognitive and integrative skills. Validity evidence scores ranged from 1-15. The Assessment of Competency in Endoscopy (ACE) tool, the Direct Observation of Procedural Skills (DOPS) tool, and the Gastrointestinal Endoscopy Competency Assessment Tool (GiECAT) had the strongest validity evidence, with scores of 13, 15, and 14, respectively. Most tools were easy to use and interpret, and required minimal resources. MERSQI scores ranged from 9.5-11.5 (maximum score 14.5).

CONCLUSIONS

The ACE, DOPS, and GiECAT have strong validity evidence compared with other assessments. Future studies should identify barriers to widespread implementation and report on the use of these tools in credentialing examinations.

Self-assessment of Competence in Endoscopy: Challenges and Insights

BACKGROUND

Endoscopists use self-assessment to monitor the development and maintenance of their skills. The accuracy of these self-assessments, which reflects how closely one's own rating corresponds to an external rating, is unclear.

METHODS

In this narrative review, we critically examine the current literature on self-assessment in gastrointestinal endoscopy with the aim of informing training and practice and identifying opportunities to improve the methodological rigor of future studies.

RESULTS

In the seven included studies, the evidence regarding self-assessment accuracy was mixed. When stratified by experience level, however, novice endoscopists were least accurate in their self-assessments and tended to overestimate their performance. Studies examining the utility of video-based interventions using observation of expert benchmark performances show promise as a mechanism to improve self-assessment accuracy among novices.

CONCLUSIONS

Based on the results of this review, we highlight problematic areas, identify opportunities to improve the methodological rigor of future studies on endoscopic self-assessment and outline potential avenues for further exploration.

Development of the patient-oriented research curriculum in child health (PORCCH)

BACKGROUND

The Canadian Institutes for Health Research launched a national 'Strategy for Patient-Oriented Research' (SPOR) in 2011. Patient-oriented research is defined as a continuum of research that engages patients as partners, focuses on patient-identified priorities, and improves patient outcomes. Capacity development is a core element of SPOR. Barriers to patient-oriented research include unfamiliarity with the research process for patients and families and unfamiliarity with the methods of patient and family engagement for researchers.

METHODS

The aim of the Patient-Oriented Research Curriculum in Child Health (PORCCH) is to build capacity in patient-oriented research in child health among patients and families, researchers, healthcare professionals, decision-makers, and trainees through a curriculum delivered via a series of interactive online modules (e-learning). A multi-disciplinary, multi-stakeholder steering committee, which included patients and families, guided the development of the curriculum and provided feedback on individual modules. The content, design, and development of each module were co-led by a parent and researcher in an equal partnership.

RESULTS

PORCCH consists of a series of five modules. All modules are interactive and include video vignettes and knowledge comprehension questions. Access to the modules is free and each module takes approximately 30 min to complete. The five modules are: Research 101 (an Introduction to Patient-Oriented Research, parts 1 and 2), Patient Engagement 101 (an Introduction to Patient Engagement in Child Health Research, parts 1 and 2), and Research Ethics 101.

CONCLUSIONS

PORCCH was developed specifically to overcome recognized barriers to the engagement of patients and families in child health research. The aim of the curriculum is to build capacity in patient-oriented research in child health. The goal is for PORCCH to be a useful resource for all stakeholders involved in patient-oriented research: patients and families, researchers, healthcare professionals, decision-makers, and trainees.

Development and initial validation of an instrument for video-based assessment of technical skill in ERCP

BACKGROUND AND AIMS

The accurate measurement of technical skill in ERCP is essential for endoscopic training, quality assurance, and coaching of this procedure. Hypothesizing that technical skill can be measured by analysis of ERCP videos, we aimed to develop and validate a video-based ERCP skill assessment tool.

METHODS

Based on review of procedural videos, the task of ERCP was deconstructed into its basic components by an expert panel that developed an initial version of the Bethesda ERCP Skill Assessment Tool (BESAT). Subsequently, 2 modified Delphi panels and 3 validation exercises were conducted with the goal of iteratively refining the tool. Fully crossed generalizability studies investigated the contributions of assessors, ERCP performance, and technical elements to reliability.

RESULTS

Twenty-nine technical elements were initially generated from task deconstruction. Ultimately, after iterative refinement, the tool comprised 6 technical elements and 11 subelements. The developmental process achieved consistent improvements in the performance characteristics of the tool with every iteration. For the most recent version of the tool, BESAT-v4, the generalizability coefficient (a reliability index) was .67. Most variance in BESAT scores (43.55%) was attributed to differences in endoscopists' skill, indicating that the tool can reliably differentiate between endoscopists based on video analysis.

CONCLUSIONS

Video-based assessment of ERCP skill appears to be feasible with a novel instrument that demonstrates favorable validity evidence. Future steps include determining whether the tool can discriminate between endoscopists of varying experience levels and predict important outcomes in clinical practice.

A97 TOOLS FOR DIRECT OBSERVATION AND ASSESSMENT OF COLONOSCOPY: A SYSTEMATIC REVIEW OF VALIDITY EVIDENCE

Background

An increasing focus on quality and safety in colonoscopy has led to broader implementation of competency-based educational systems that enable documentation of trainees’ achievement of the knowledge, skills, and attitudes needed for independent practice. The meaningful assessment of competence in colonoscopy is critical to this process. While there are many published tools that assess competence in performing colonoscopy, there is a wide range of underlying validity evidence. Tools with strong evidence of validity are required to support feedback provision, optimize learner capabilities, and document competence.

Aims

We aimed to evaluate the strength of validity evidence that supports available colonoscopy direct observation assessment tools using the unified framework of validity.

Methods

We systematically searched five databases for studies investigating colonoscopy direct observation assessment tools from inception until April 8, 2020. We extracted data outlining validity evidence from the five sources (content, response process, internal structure, relations to other variables, and consequences) and graded the degree of evidence, with a maximum score of 15. We assessed educational utility using an Accreditation Council for Graduate Medical Education framework and methodological quality using the Medical Education Research Quality Instrument (MERSQI).

Results

From 10,841 records, we identified 27 studies representing 13 assessment tools (10 adult, 2 pediatric, 1 both). All tools assessed technical skills, while 10 assessed cognitive and integrative skills. Validity evidence scores ranged from 1–15. The Assessment of Competency in Endoscopy (ACE) tool, the Direct Observation of Procedural Skills (DOPS) tool, and the Gastrointestinal Endoscopy Competency Assessment Tool (GiECAT) had the strongest validity evidence, with scores of 13, 15, and 14, respectively. Most tools were easy to use and interpret and required minimal resources. MERSQI scores ranged from 9.5–11.5 (maximum score 14.5).

Conclusions

The ACE, DOPS, and GiECAT have strong validity evidence compared to other assessments. Future studies should identify barriers to widespread implementation and report on use of these tools in credentialing purposes.

Funding Agencies

None

A95 HOW ENDOSCOPY TEACHERS MAKE POLYPECTOMY ENTRUSTMENT DECISIONS IN CLINICAL AND SIMULATION-BASED SETTINGS

Background

Entrustment, a central construct in competency-based medical education (CBME), represents the point at which clinical supervisors trust a trainee to perform a task independently. Many implementations of CBME involve assessing entrustment through observation of entrustable professional activities (EPAs). While EPAs are frequently assessed in both clinical and simulation-based settings, research has yet to clarify how faculty who teach endoscopy form judgments of entrustment across these two contexts.

Aims

We aimed to explore the features that endoscopy teachers report as influencing their entrustment decisions regarding polypectomy across clinical and simulation-based assessment settings.

Methods

We designed an interview-based, constructivist grounded theory-informed study involving endoscopy teachers and trainees in the University of Toronto gastroenterology residency program. Teachers completed separate EPA assessments of each trainee’s performance of an endoscopic polypectomy (colonic polyps &lt; 1cm, Paris 0-Is or 0-Ip in morphology) in both settings. Teachers were interviewed after each assessment to explore how they made their entrustment decision within and across settings. Transcribed interview data were coded iteratively using constant comparison to generate themes.

Results

Based on 14 interviews with 7 endoscopy teachers, we found that they: (1) held multiple meanings of entrustment for polypectomy, both within and across participants, (2) expressed variability in how they justified their entrustment decisions, the related narrative, and numerical scoring, (3) held unique personal criteria for making decisions ‘comfortably,’ including authenticity of the task, variability in terms of polyp shape, location, and morphology, as well as the ability to assess trainee response to procedural complications (e.g., post-polypectomy bleeding), and (4) perceived a relative freedom when using simulation to make entrustment decisions due to the absence of a real patient.

Conclusions

We found that faculty who teach endoscopy defined polypectomy entrustment in a variety of ways, leading to variability in how they judged entrustment within and across trainees and assessment settings. The observed idiosyncrasies suggest gastroenterology competence committees cannot assume equivalence of EPA data obtained from different settings. Furthermore, educators designing faculty development for CBME will need to attend to the criteria that endoscopy teachers report they need to comfortably make entrustment decisions.

Funding Agencies

Royal College of Physicians and Surgeons of Canada