Self-assessment, and not continuous training, improves basic open suturing skills

BACKGROUND

To develop and maintain suturing skills, clinical exposure is important. When clinical exposure cannot be guaranteed, an adequate training schedule for suturing skills is required. This study evaluates the effect of continuous training, 'reflection before practice' and self-assessment on basic open suturing skills.

METHODS

Medical students performed four basic suturing tasks on a simulation set up before ('pre-test') and after their surgical rotation ('after-test'). Participants were divided in three groups; the 'clinical exposure group' (n = 44) had clinical exposure during their rotation only, the 'continuous training group' (n = 16) completed a suturing interval training during their rotation and the 'self-assessment group' (n = 16) also completed a suturing interval training, but with the use of reflection before practice and self-assessment. Parameters measured by a tracking system during the suturing tasks and a calculated 'composite score' were compared between groups and test-moments.

RESULTS

A significantly better composite score was found at the after-test compared to the pre-test for all groups for all basic suturing tasks (0.001 ≤ p ≤ 0.049). The self-assessment group scored better at the pre-test than the other two groups for all tasks, except for 'knot tying by hand' (0.004 ≤ p ≤ 0.063). However, this group did not score better at the after-test for all tasks, compared to the other two groups. This resulted in a smaller delta of time ('transcutaneous suture', p = 0.013), distance ('Donati suture' and 'intracutaneous suture', 0.005 ≤ p ≤ 0.009) or composite score (all tasks, except for knot tying by hand, 0.007 ≤ p ≤ 0.061) in the self-assessment group.

CONCLUSION

Reflection before practice and self-assessment during continuous training of basic open suturing tasks, may improve surgical skills at the start of the learning curve.

Society for Simulation in Healthcare Guidelines for Simulation Training

BACKGROUND

Simulation has become a staple in the training of healthcare professionals with accumulating evidence on its effectiveness. However, guidelines for optimal methods of simulation training do not currently exist.

METHODS

Systematic reviews of the literature on 16 identified key questions were conducted and expert panel consensus recommendations determined using the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) methodology.

OBJECTIVE

These evidence-based guidelines from the Society for Simulation in Healthcare intend to support healthcare professionals in decisions on the most effective methods for simulation training in healthcare.

RESULTS

Twenty recommendations on 16 questions were determined using GRADE. Four expert recommendations were also provided.

CONCLUSIONS

The first evidence-based guidelines for simulation training are provided to guide instructors and learners on the most effective use of simulation in healthcare.

Towards best practice in developing motor skills: a systematic review on spacing in VR simulator-based psychomotor training for surgical novices

OBJECTIVE

Repeated practice, or spacing, can improve various types of skill acquisition. Similarly, virtual reality (VR) simulators have demonstrated their effectiveness in fostering surgical skill acquisition and provide a promising, realistic environment for spaced training. To explore how spacing impacts VR simulator-based acquisition of surgical psychomotor skills, we performed a systematic literature review.

METHODS

We systematically searched the databases PubMed, PsycINFO, Psychology and Behavioral Sciences Collection, ERIC and CINAHL for studies investigating the influence of spacing on the effectiveness of VR simulator training focused on psychomotor skill acquisition in healthcare professionals. We assessed the quality of all included studies using the Medical Education Research Study Quality Instrument (MERSQI) and the risk of bias using the Cochrane Collaboration's risk of bias assessment tool. We extracted and aggregated qualitative data regarding spacing interval, psychomotor task performance and several other performance metrics.

RESULTS

The searches yielded 1662 unique publications. After screening the titles and abstracts, 53 publications were retained for full text screening and 7 met the inclusion criteria. Spaced training resulted in better performance scores and faster skill acquisition when compared to control groups with a single day (massed) training session. Spacing across consecutive days seemed more effective than shorter or longer spacing intervals. However, the included studies were too heterogeneous in terms of spacing interval, obtained performance metrics and psychomotor skills analysed to allow for a meta-analysis to substantiate our outcomes.

CONCLUSION

Spacing in VR simulator-based surgical training improved skill acquisition when compared to massed training. The overall number and quality of available studies were only moderate, limiting the validity and generalizability of our findings.

Current Evidence for Simulation-Based Training and Assessment of Myringotomy and Ventilation Tube Insertion: A Systematic Review

OBJECTIVE

Myringotomy and ventilation tube insertion (MT) is a key procedure in otorhinolaryngology and can be trained using simulation models. We aimed to systematically review the literature on models for simulation-based training and assessment of MT and supporting educational evidence.

DATABASES REVIEWED

PubMed, Embase, Cochrane Library, Web of Science, Directory of Open Access Journals.

METHODS

Inclusion criteria were MT training and/or skills assessment using all types of training modalities and learners. Studies were divided into 1) descriptive and 2) educational interventional/observational in the analysis. For descriptive studies, we provide an overview of available models including materials and cost. Educational studies were appraised using Kirkpatrick's level of educational outcomes, Messick's framework of validity, and a structured quality assessment tool.

RESULTS

Forty-six studies were included consisting of 21 descriptive studies and 25 educational studies. Thirty-one unique physical and three virtual reality simulation models were identified. The studies report moderate to high realism of the different simulators and trainees and educators perceive them beneficial in training MT skills. Overall, simulation-based training is found to reduce procedure time and errors, and increase performance as measured using different assessment tools. None of the studies used a contemporary validity framework and the current educational evidence is limited.

CONCLUSION

Numerous simulation models and assessment tools have been described in the literature but educational evidence and systematic implementation into training curricula is scarce. There is especially a need to establish the effect of simulation-based training of MT in transfer to the operating room and on patient outcomes.

Conceptualising spaced learning in health professions education: A scoping review

OBJECTIVES

To investigate the definitions and applications of 'spaced learning' and to propose future directions for advancing its study and practice in health professions education.

METHOD

The authors searched five online databases for articles published on spaced learning in health professions education prior to February 2018. Two researchers independently screened articles for eligibility with set inclusion criteria. They extracted and analysed key data using both quantitative and qualitative methods.

RESULTS

Of the 2972 records retrieved, 120 articles were included in the review. More than 90% of these articles were published in the last 10 years. The definition of spaced learning varied widely and was often not theoretically grounded. Spaced learning was applied in distinct contexts, including online learning, simulation training and classroom settings. There was a large variety of spacing formats, ranging from dispersion of information or practice on a single day, to intervals lasting several months. Generally, spaced learning was implemented in practice or testing phases and rarely during teaching.

CONCLUSIONS

Spaced learning is infrequently and poorly defined in the health professions education literature. We propose a comprehensive definition of spaced learning and emphasise that detailed descriptions of spacing formats are needed in future research to facilitate the operationalisation of spaced learning research and practice in health professions education.

Otologic Skills Training

This article presents a summary of the current simulation training for otologic skills. There is a wide variety of educational approaches, assessment tools, and simulators in use, including simple low-cost task trainers to complex computer-based virtual reality systems. A systematic approach to otologic skills training using adult learning theory concepts, such as repeated and distributed practice, self-directed learning, and mastery learning, is necessary for these educational interventions to be effective. Future directions include development of measures of performance to assess efficacy of simulation training interventions and, for complex procedures, improvement in fidelity based on educational goals.

Qualitative synthesis and systematic review of otolaryngology in undergraduate medical education

OBJECTIVE

Although 25% of primary care complaints are otolaryngology related, otolaryngology instruction is not required in most medical schools. Our aim was to systematically review existing literature on the inclusion of otolaryngology in undergraduate medical education.

DATA SOURCES

PubMed, Embase, Cumulative Index to Nursing and Allied Health Literature, and Education Resources Information Center.

STUDY DESIGN/REVIEW METHODS

Our search encompassed all indexed years through December 29, 2014. Inclusion criteria were English language, original human data, and a focus on medical student education. Data regarding study design, teacher, educational topic, educational methods, and setting were extracted from each article. Two investigators independently reviewed all articles.

RESULTS

Our initial search yielded 436 articles; 87 underwent full-text evaluation and 47 remained in the final review. The majority of studies were conducted in the United States (40%), United Kingdom (23%), and Canada (17%) and represented a single institutional experience. Studies were classified as needs assessments (36%), curriculum descriptions (15%), educational methods (36%), and skills assessments (32%); 81% were levels of evidence 3 or 4. Most reports indicated that otolaryngology rotations are not compulsory.

CONCLUSIONS

Studies indicated the need for increased exposure to otolaryngology. Educational methods such as team-based learning, simulation, online learning, and clinical skills assessments may offer ways to increase exposure without overburdening clinical faculty and require further study. Data suggest that a universal otolaryngology medical student curriculum would be valuable and aid in resource sharing across institutions. We recommend that an assessment be performed to determine topics and skills that should comprise this curriculum.

LEVEL OF EVIDENCE

NA.