1
|
Scully RE, Deal SB, Clark MJ, Yang K, Wnuk G, Smink DS, Fryer JP, Bohnen JD, Teitelbaum EN, Meyerson SL, Meier AH, Gauger PG, Reddy RM, Kendrick DE, Stern M, Hughes DT, Chipman JG, Patel JA, Alseidi A, George BC. Concordance Between Expert and Nonexpert Ratings of Condensed Video-Based Trainee Operative Performance Assessment. JOURNAL OF SURGICAL EDUCATION 2020; 77:627-634. [PMID: 32201143 DOI: 10.1016/j.jsurg.2019.12.016] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/09/2019] [Revised: 12/18/2019] [Accepted: 12/29/2019] [Indexed: 06/10/2023]
Abstract
OBJECTIVE We examined the impact of video editing and rater expertise in surgical resident evaluation on operative performance ratings of surgical trainees. DESIGN Randomized independent review of intraoperative video. SETTING Operative video was captured at a single, tertiary hospital in Boston, MA. PARTICIPANTS Six common general surgery procedures were video recorded of 6 attending-trainee dyads. Full-length and condensed versions (n = 12 videos) were then reviewed by 13 independent surgeon raters (5 evaluation experts, 8 nonexperts) using a crossed design. Trainee performance was rated using the Operative Performance Rating Scale, System for Improving and Measuring Procedural Learning (SIMPL) Performance scale, the Zwisch scale, and ten Cate scale. These ratings were then standardized before being compared using Bayesian mixed models with raters and videos treated as random effects. RESULTS Editing had no effect on the Operative Performance Rating Scale Overall Performance (-0.10, p = 0.30), SIMPL Performance (0.13, p = 0.71), Zwisch (-0.12, p = 0.27), and ten Cate scale (-0.13, p = 0.29). Additionally, rater expertise (evaluation expert vs. nonexpert) had no effect on the same scales (-0.16 (p = 0.32), 0.18 (p = 0.74), 0.25 (p = 0.81), and 0.25 (p = 0.17). CONCLUSIONS There is little difference in operative performance assessment scores when raters use condensed videos or when raters who are not experts in surgical resident evaluation are used. Future validation studies of operative performance assessment scales may be facilitated by using nonexpert surgeon raters viewing videos condensed using a standardized protocol.
Collapse
Affiliation(s)
- Rebecca E Scully
- Department of Surgery, Brigham and Women's Hospital, Boston, Massachusetts
| | - Shanley B Deal
- Department of Surgery, Virginia Mason Medical Center, Seattle, Washington
| | - Michael J Clark
- Consulting for Statistics, Computing, and Analytics, University of Michigan, Ann Arbor, Michigan
| | - Katherine Yang
- Consulting for Statistics, Computing, and Analytics, University of Michigan, Ann Arbor, Michigan
| | - Greg Wnuk
- Center for Surgical Training and Research, Department of Surgery, University of Michigan, Ann Arbor, Michigan
| | - Douglas S Smink
- Department of Surgery, Brigham and Women's Hospital, Boston, Massachusetts
| | - Jonathan P Fryer
- Department of Surgery, Northwestern Memorial Hospital, Chicago, Illinois
| | - Jordan D Bohnen
- Department of Surgery, Massachusetts General Hospital, Boston, Massachusetts
| | - Ezra N Teitelbaum
- Department of Surgery, Northwestern Memorial Hospital, Chicago, Illinois
| | - Shari L Meyerson
- Department of Surgery, University of Kentucky Medical Center, Lexington, Kentucky
| | - Andreas H Meier
- Department of Surgery, SUNY Upstate University Hospital, Syracuse, New York
| | - Paul G Gauger
- Center for Surgical Training and Research, Department of Surgery, University of Michigan, Ann Arbor, Michigan
| | - Rishindra M Reddy
- Center for Surgical Training and Research, Department of Surgery, University of Michigan, Ann Arbor, Michigan
| | - Daniel E Kendrick
- University Hospitals Case Western Reserve, Cleveland Ohio; Center for Surgical Training and Research, Department of Surgery, University of Michigan, Ann Arbor, Michigan
| | - Michael Stern
- Department of Surgery, University of Michigan, Ann Arbor, Michigan
| | - David T Hughes
- Department of Surgery, University of Michigan, Ann Arbor, Michigan
| | - Jeffrey G Chipman
- Department of Surgery, University of Minnesota, Minneapolis, Minnesota
| | - Jitesh A Patel
- Department of Surgery, University of Kentucky Medical Center, Lexington, Kentucky
| | - Adnan Alseidi
- Department of Surgery, Virginia Mason Medical Center, Seattle, Washington
| | - Brian C George
- Center for Surgical Training and Research, Department of Surgery, University of Michigan, Ann Arbor, Michigan
| |
Collapse
|
2
|
Akhmetshin EM, Ibatullin RR, Gapsalamov AR, Vasilev VL, Bakhvalov SY. Audiovisual aids application in the secondary-level vocational education establishments. INTERNATIONAL JOURNAL OF EDUCATIONAL MANAGEMENT 2019. [DOI: 10.1108/ijem-02-2018-0082] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
PurposeThe purpose of this paper is to analyze how the audiovisual teaching aids are applied in the modern educational environment and to assess their application efficiency in the context of the secondary-level vocational education establishments.Design/methodology/approachA pedagogical experiment was conducted to confirm this hypothesis. At the preparatory stage, the authors have analyzed the teaching and learning process, as well as students learning at the secondary-level vocational education establishment. Statistical sample was 300 people.FindingsBased on the research results, main mistakes made while applying the audiovisual teaching aids were identified, formulated and investigated. These mistakes were related to the insufficient methodological preparation. As these mistakes were eliminated, student achievements and learning skills have increased by 15–20 percent (experiment data). The average marks, obtained by students before and after eliminating the methodological mistakes, were taken in points (from 2 to 5) as achievement and learning skill criteria. Research conclusion is that audiovisual aids application quality can be improved only through the research on students’ educational and creative potential, their perception of various learning materials, and their preferences in the information structure, composition, types and forms.Originality/valueApplying audiovisual teaching aids in the learning process is a challenge. This paper is driven by the need of new unique methods for applying audiovisual aids related to identifying the optimal temporal lesson structure, as well as the composition and the amount of auxiliary teaching materials, interactive communication level and ways to stimulate the emotional and creative activity of students.
Collapse
|
3
|
Bergström H, Larsson LG, Stenberg E. Audio-video recording during laparoscopic surgery reduces irrelevant conversation between surgeons: a cohort study. BMC Surg 2018; 18:92. [PMID: 30400860 PMCID: PMC6219023 DOI: 10.1186/s12893-018-0428-x] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2018] [Accepted: 10/22/2018] [Indexed: 11/10/2022] Open
Abstract
Background The prevalence of perioperative surgical complications is a worldwide issue: In many cases, these events are preventable. Audio-video recording during laparoscopic surgery provides useful information for the purposes of education and event analyses, and may have an impact on the focus of the surgeons operating. The aim of the present study was to investigate how audio-video recording in the operating room during laparoscopic surgery affects the focus of the surgeon and his/her assistant. Methods A group of laparoscopic procedures where video recording only was performed was compared to a group where both audio and video recordings were made. All laparoscopic procedures were performed at Lindesberg Hospital, Sweden, during the period August to September 2017. The primary outcome was conversation not relevant to the ongoing procedure. Secondary outcomes were intra- and postoperative adverse events or complications, operation time and number of times the assistant was corrected by the surgeon. Results The study included 41 procedures, 20 in the video only group and 21 in the audio-video group. The material comprised laparoscopic cholecystectomies, totally extraperitoneal inguinal hernia repairs and bariatric surgical procedures. Irrelevant conversation time fell from 4.2% of surgical time to 1.4% when both audio and video recordings were made (p = 0.002). No differences in perioperative adverse event or complication rates were seen. Conclusion Audio-video recording during laparoscopic abdominal surgery reduces irrelevant conversation time and may improve intraoperative safety and surgical outcome. Trial registration Available at FOU Sweden (ID: 232771) and retrospectively at Clinical trials.gov (ID: NCT03425175; date of registration 7/2 2018).
Collapse
Affiliation(s)
- Hannah Bergström
- Department of Surgery, Faculty of Medicine and Health, Örebro University, SE-70185, Örebro, Sweden
| | - Lars-Göran Larsson
- Department of Surgery, Faculty of Medicine and Health, Örebro University, SE-70185, Örebro, Sweden
| | - Erik Stenberg
- Department of Surgery, Faculty of Medicine and Health, Örebro University, SE-70185, Örebro, Sweden.
| |
Collapse
|
4
|
Surgeon-Manipulated Live Surgery Video Recording Apparatuses: Personal Experience and Review of Literature. Aesthetic Plast Surg 2017; 41:738-746. [PMID: 28280896 DOI: 10.1007/s00266-017-0826-y] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/27/2016] [Accepted: 02/10/2017] [Indexed: 10/20/2022]
Abstract
BACKGROUND Visual recording of surgical procedures is a method that is used quite frequently in practices of plastic surgery. While presentations containing photographs are quite common in education seminars and congresses, video-containing presentations find more favour. For this reason, the presentation of surgical procedures in the form of real-time video display has increased especially recently. Appropriate technical equipment for video recording is not available in most hospitals, so there is a need to set up external apparatus in the operating room. Among these apparatuses can be listed such options as head-mounted video cameras, chest-mounted cameras, and tripod-mountable cameras. The head-mounted video camera is an apparatus that is capable of capturing high-resolution and detailed close-up footage. The tripod-mountable camera enables video capturing from a fixed point. Certain user-specific modifications can be made to overcome some of these restrictions. Among these modifications, custom-made applications are one of the most effective solutions. METHODS The article makes an attempt to present the features and experiences concerning the use of a combination of a head- or chest-mounted action camera, a custom-made portable tripod apparatus of versatile features, and an underwater camera. RESULTS The descriptions we used are quite easy-to-assembly, quickly installed, and inexpensive apparatuses that do not require specific technical knowledge and can be manipulated by the surgeon personally in all procedures. CONCLUSION The author believes that video recording apparatuses will be integrated more to the operating room, become a standard practice, and become more enabling for self-manipulation by the surgeon in the near future. LEVEL OF EVIDENCE V This journal requires that authors assign a level of evidence to each article. For a full description of these Evidence-Based Medicine ratings, please refer to the Table of Contents or the online Instructions to Authors www.springer.com/00266 .
Collapse
|
5
|
Seamans DP, Louka BF, Fortuin FD, Patel BM, Sweeney JP, Lanza LA, DeValeria PA, Ezrre KM, Ramakrishna H. The utility of live video capture to enhance debriefing following transcatheter aortic valve replacement. Ann Card Anaesth 2017; 19:S6-S11. [PMID: 27762242 PMCID: PMC5100244 DOI: 10.4103/0971-9784.192576] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022] Open
Abstract
Background: The surgical and procedural specialties are continually evolving their methods to include more complex and technically difficult cases. These cases can be longer and incorporate multiple teams in a different model of operating room synergy. Patients are frequently older, with comorbidities adding to the complexity of these cases. Recording of this environment has become more feasible recently with advancement in video and audio capture systems often used in the simulation realm. Aims: We began using live capture to record a new procedure shortly after starting these cases in our institution. This has provided continued assessment and evaluation of live procedures. The goal of this was to improve human factors and situational challenges by review and debriefing. Setting and Design: B-Line Medical's LiveCapture video system was used to record successive transcatheter aortic valve replacement (TAVR) procedures in our cardiac catheterization/laboratory. An illustrative case is used to discuss analysis and debriefing of the case using this system. Results and Conclusions: An illustrative case is presented that resulted in long-term changes to our approach of these cases. The video capture documented rare events during one of our TAVR procedures. Analysis and debriefing led to definitive changes in our practice. While there are hurdles to the use of this technology in every institution, the role for the ongoing use of video capture, analysis, and debriefing may play an important role in the future of patient safety and human factors analysis in the operating environment.
Collapse
Affiliation(s)
- David P Seamans
- Department of Anesthesiology, Mayo Clinic Arizona, AZ 85054, USA
| | - Boshra F Louka
- Division of Cardiovascular Diseases, Mayo Clinic Arizona, AZ 85054, USA
| | - F David Fortuin
- Division of Cardiovascular Diseases, Mayo Clinic Arizona, AZ 85054, USA
| | - Bhavesh M Patel
- Department of Critical Care, Mayo Clinic Arizona, AZ 85054, USA
| | - John P Sweeney
- Division of Cardiovascular Diseases, Mayo Clinic Arizona, AZ 85054, USA
| | - Louis A Lanza
- Division of Cardiovascular and Thoracic Surgery, Mayo Clinic Arizona, AZ 85054, USA
| | - Patrick A DeValeria
- Division of Cardiovascular and Thoracic Surgery, Mayo Clinic Arizona, AZ 85054, USA
| | - Kim M Ezrre
- Department of Catheterization Laboratory, Mayo Clinic Arizona, AZ 85054, USA
| | - Harish Ramakrishna
- Division of Cardiovascular and Thoracic Anesthesiology, Mayo Clinic Arizona, AZ 85054, USA
| |
Collapse
|