1
|
Cornthwaite K, Hewitt P, van der Scheer JW, Brown IAF, Burt J, Dufresne E, Dixon‐Woods M, Draycott T, Bahl R. Definition, management, and training in impacted fetal head at cesarean birth: a national survey of maternity professionals. Acta Obstet Gynecol Scand 2023; 102:1219-1226. [PMID: 37430482 PMCID: PMC10407013 DOI: 10.1111/aogs.14600] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2023] [Revised: 05/05/2023] [Accepted: 05/10/2023] [Indexed: 07/12/2023]
Abstract
INTRODUCTION This study assessed views, understanding and current practices of maternity professionals in relation to impacted fetal head at cesarean birth, with the aim of informing a standardized definition, clinical management approaches and training. MATERIAL AND METHODS We conducted a survey consultation including the range of maternity professionals who attend emergency cesarean births in the UK. Thiscovery, an online research and development platform, was used to ask closed-ended and free-text questions. Simple descriptive analysis was undertaken for closed-ended responses, and content analysis for categorization and counting of free-text responses. Main outcome measures included the count and percentage of participants selecting predefined options on clinical definition, multi-professional team approach, communication, clinical management and training. RESULTS In total, 419 professionals took part, including 144 midwives, 216 obstetricians and 59 other clinicians (eg anesthetists). We found high levels of agreement on the components of an impacted fetal head definition (79% of obstetricians) and the need for use of a multi-professional approach to management (95% of all participants). Over 70% of obstetricians deemed nine techniques acceptable for management of impacted fetal head, but some obstetricians also considered potentially unsafe practices appropriate. Access to professional training in management of impacted fetal head was highly variable, with over 80% of midwives reporting no training in vaginal disimpaction. CONCLUSIONS These findings demonstrate agreement on the components of a standardized definition for impacted fetal head, and a need and appetite for multi-professional training. These findings can inform a program of work to improve care, including use of structured management algorithms and simulation-based multi-professional training.
Collapse
Affiliation(s)
- Katie Cornthwaite
- Royal College of Obstetricians & GynaecologistsLondonUK
- Translational Health SciencesUniversity of BristolBristolUK
| | | | - Jan W. van der Scheer
- THIS Institute (The Healthcare Improvement Studies Institute), School of Clinical MedicineUniversity of CambridgeCambridgeUK
| | - Imogen A. F. Brown
- THIS Institute (The Healthcare Improvement Studies Institute), School of Clinical MedicineUniversity of CambridgeCambridgeUK
| | - Jenni Burt
- THIS Institute (The Healthcare Improvement Studies Institute), School of Clinical MedicineUniversity of CambridgeCambridgeUK
| | | | - Mary Dixon‐Woods
- THIS Institute (The Healthcare Improvement Studies Institute), School of Clinical MedicineUniversity of CambridgeCambridgeUK
| | - Tim Draycott
- Royal College of Obstetricians & GynaecologistsLondonUK
- North Bristol NHS TrustBristolUK
| | | | | | - Rachna Bahl
- Royal College of Obstetricians & GynaecologistsLondonUK
- University Hospitals Bristol and WestonBristolUK
| |
Collapse
|
2
|
Alves ÁLL, Silva LBD, Filho BJA, Nunes RD. Operative vaginal delivery. REVISTA BRASILEIRA DE GINECOLOGIA E OBSTETRÍCIA 2023; 45:422-434. [PMID: 37595600 PMCID: PMC10438968 DOI: 10.1055/s-0043-1772581] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/20/2023] Open
Affiliation(s)
| | | | - Breno José Acauan Filho
- Escola de Medicina da Pontifícia Universidade Católica do Rio Grande do Sul, Porto Alegre, RS, Brazil
| | | |
Collapse
|
3
|
van der Scheer JW, Cornthwaite K, Hewitt P, Bahl R, Randall W, Powell A, Ansari A, Attal B, Willars J, Woodward M, Brown IAF, Olsson A, Richards N, Price E, Giusti A, Leeding J, Hinton L, Burt J, Dixon-Woods M, Maistrello G, Fahy N, Lyons O, Draycott T. Training for managing impacted fetal head at caesarean birth: multimethod evaluation of a pilot. BMJ Open Qual 2023; 12:e002340. [PMID: 37524515 PMCID: PMC10391817 DOI: 10.1136/bmjoq-2023-002340] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2023] [Accepted: 07/07/2023] [Indexed: 08/02/2023] Open
Abstract
BACKGROUND Implementation of national multiprofessional training for managing the obstetric emergency of impacted fetal head (IFH) at caesarean birth has potential to improve quality and safety in maternity care, but is currently lacking in the UK. OBJECTIVES To evaluate a training package for managing IFH at caesarean birth with multiprofessional maternity teams. METHODS The training included an evidence-based lecture supported by an animated video showing management of IFH, followed by hands-on workshops and real-time simulations with use of a birth simulation trainer, augmented reality and management algorithms. Guided by the Kirkpatrick framework, we conducted a multimethod evaluation of the training with multiprofessional maternity teams. Participants rated post-training statements about relevance and helpfulness of the training and pre-training and post-training confidence in their knowledge and skills relating to IFH (7-point Likert scales, strongly disagree to strongly agree). An ethnographer recorded sociotechnical observations during the training. Participants provided feedback in post-training focus groups. RESULTS Participants (N=57) included 21 midwives, 25 obstetricians, 7 anaesthetists and 4 other professionals from five maternity units. Over 95% of participants agreed that the training was relevant and helpful for their clinical practice and improving outcomes following IFH. Confidence in technical and non-technical skills relating to managing IFH was variable before the training (5%-92% agreement with the pre-training statements), but improved in nearly all participants after the training (71%-100% agreement with the post-training statements). Participants and ethnographers reported that the training helped to: (i) better understand the complexity of IFH, (ii) recognise the need for multiprofessional training and management and (iii) optimise communication with those in labour and their birth partners. CONCLUSIONS The evaluated training package can improve self-reported knowledge, skills and confidence of multiprofessional teams involved in management of IFH at caesarean birth. A larger-scale evaluation is required to validate these findings and establish how best to scale and implement the training.
Collapse
Affiliation(s)
- Jan W van der Scheer
- THIS Institute (The Healthcare Improvement Studies Institute), Department of Public Health and Primary Care, University of Cambridge, Cambridge, UK
| | - Katie Cornthwaite
- Royal College of Obstetricians and Gynaecologists, London, UK
- Translational Health Sciences, University of Bristol, Bristol, UK
| | | | - Rachna Bahl
- Royal College of Obstetricians and Gynaecologists, London, UK
- University Hospitals Bristol and Weston NHS Foundation Trust, Bristol, UK
| | | | - Alison Powell
- THIS Institute (The Healthcare Improvement Studies Institute), Department of Public Health and Primary Care, University of Cambridge, Cambridge, UK
| | - Akbar Ansari
- THIS Institute (The Healthcare Improvement Studies Institute), Department of Public Health and Primary Care, University of Cambridge, Cambridge, UK
| | - Bothaina Attal
- THIS Institute (The Healthcare Improvement Studies Institute), Department of Public Health and Primary Care, University of Cambridge, Cambridge, UK
| | - Janet Willars
- THIS Institute (The Healthcare Improvement Studies Institute), Department of Public Health and Primary Care, University of Cambridge, Cambridge, UK
| | - Matthew Woodward
- THIS Institute (The Healthcare Improvement Studies Institute), Department of Public Health and Primary Care, University of Cambridge, Cambridge, UK
| | - Imogen A F Brown
- THIS Institute (The Healthcare Improvement Studies Institute), Department of Public Health and Primary Care, University of Cambridge, Cambridge, UK
| | - Annabelle Olsson
- THIS Institute (The Healthcare Improvement Studies Institute), Department of Public Health and Primary Care, University of Cambridge, Cambridge, UK
| | - Natalie Richards
- THIS Institute (The Healthcare Improvement Studies Institute), Department of Public Health and Primary Care, University of Cambridge, Cambridge, UK
| | - Evleen Price
- THIS Institute (The Healthcare Improvement Studies Institute), Department of Public Health and Primary Care, University of Cambridge, Cambridge, UK
| | - Alessandra Giusti
- THIS Institute (The Healthcare Improvement Studies Institute), Department of Public Health and Primary Care, University of Cambridge, Cambridge, UK
| | - Joann Leeding
- THIS Institute (The Healthcare Improvement Studies Institute), Department of Public Health and Primary Care, University of Cambridge, Cambridge, UK
| | - Lisa Hinton
- THIS Institute (The Healthcare Improvement Studies Institute), Department of Public Health and Primary Care, University of Cambridge, Cambridge, UK
| | - Jenni Burt
- THIS Institute (The Healthcare Improvement Studies Institute), Department of Public Health and Primary Care, University of Cambridge, Cambridge, UK
| | - Mary Dixon-Woods
- THIS Institute (The Healthcare Improvement Studies Institute), Department of Public Health and Primary Care, University of Cambridge, Cambridge, UK
| | | | | | - Oscar Lyons
- RAND Europe, Cambridge, UK
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - Tim Draycott
- Royal College of Obstetricians and Gynaecologists, London, UK
- North Bristol NHS Trust, Westbury on Trym, UK
| |
Collapse
|
4
|
Marschalek J, Kuessel L, Stammler-Safar M, Kiss H, Ott J, Husslein H. Comparison of a practice-based versus theory-based training program for conducting vacuum-assisted deliveries: a randomized-controlled trial. Arch Gynecol Obstet 2021; 305:365-372. [PMID: 34363518 PMCID: PMC8840931 DOI: 10.1007/s00404-021-06159-8] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2021] [Accepted: 07/21/2021] [Indexed: 10/24/2022]
Abstract
PURPOSE Vacuum-assisted deliveries (VAD) are complex procedures that require training and experience to be performed proficiently. We aimed to evaluate if a more resource intensive practice-based training program for conducting VAD is more efficient compared to a purely theory-based training program, with respect to immediate training effects and persistence of skills 4-8 weeks after the initial training. METHODS In this randomized-controlled study conducted in maternity staff, participants performed a simulated low-cavity non-rotational vacuum delivery before (baseline test) and immediately after the training (first post-training test) as well as 4-8 weeks thereafter (second post-training test). The study's primary endpoint was to compare training effectiveness between the two study groups using a validated objective structured assessment of technical skills (OSATS) rating scale. RESULTS Sixty-two participants were randomized to either the theory-based group (n = 31) or the practice-based group (n = 31). Total global and specific OSATS scores, as well as distance of cup application to the flexion point improved significantly from baseline test to the first post-training test in both groups (pall < 0.007). Skill deterioration after 4-8 weeks was only found in the theory-based group, whereas skills remained stable in the practice-based group. CONCLUSION A practice-based training program for conducting VAD results in comparable immediate improvement of skills compared to a theory-based training program, but the retention of skills 4-8 weeks after training is superior in a practice-based program. Future studies need to evaluate, whether VAD simulation training improves maternal and neonatal outcome after VAD.
Collapse
Affiliation(s)
- Julian Marschalek
- Department of Obstetrics and Gynecology, Medical University of Vienna, Spitalgasse 23, 1090, Vienna, Austria
| | - Lorenz Kuessel
- Department of Obstetrics and Gynecology, Medical University of Vienna, Spitalgasse 23, 1090, Vienna, Austria
| | - Maria Stammler-Safar
- Department of Obstetrics and Gynecology, Medical University of Vienna, Spitalgasse 23, 1090, Vienna, Austria
| | - Herbert Kiss
- Department of Obstetrics and Gynecology, Medical University of Vienna, Spitalgasse 23, 1090, Vienna, Austria
| | - Johannes Ott
- Department of Obstetrics and Gynecology, Medical University of Vienna, Spitalgasse 23, 1090, Vienna, Austria
| | - Heinrich Husslein
- Department of Obstetrics and Gynecology, Medical University of Vienna, Spitalgasse 23, 1090, Vienna, Austria.
| |
Collapse
|
5
|
Feeley C, Crossland N, Betran AP, Weeks A, Downe S, Kingdon C. Training and expertise in undertaking assisted vaginal delivery (AVD): a mixed methods systematic review of practitioners views and experiences. Reprod Health 2021; 18:92. [PMID: 33952309 PMCID: PMC8097768 DOI: 10.1186/s12978-021-01146-3] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/10/2020] [Accepted: 04/26/2021] [Indexed: 11/25/2022] Open
Abstract
BACKGROUND During childbirth, complications may arise which necessitate an expedited delivery of the fetus. One option is instrumental assistance (forceps or a vacuum-cup), which, if used with skill and sensitivity, can improve maternal/neonatal outcomes. This review aimed to understand the core competencies and expertise required for skilled use in AVD in conjunction with reviewing potential barriers and facilitators to gaining competency and expertise, from the point of view of maternity care practitioners, funders and policy makers. METHODS A mixed methods systematic review was undertaken in five databases. Inclusion criteria were primary studies reporting views, opinions, perspectives and experiences of the target group in relation to the expertise, training, behaviours and competencies required for optimal AVD, barriers and facilitators to achieving practitioner competencies, and to the implementation of appropriate training. Quality appraisal was carried out on included studies. A mixed-methods convergent synthesis was carried out, and the findings were subjected to GRADE-CERQual assessment of confidence. RESULTS 31 papers, reporting on 27 studies and published 1985-2020 were included. Studies included qualitative designs (3), mixed methods (3), and quantitative surveys (21). The majority (23) were from high-income countries, two from upper-middle income countries, one from a lower-income country: one survey included 111 low-middle countries. Confidence in the 10 statements of findings was mostly low, with one exception (moderate confidence). The review found that AVD competency comprises of inter-related skill sets including non-technical skills (e.g. behaviours), general clinical skills; and specific technical skills associated with particular instrument use. We found that practitioners needed and welcomed additional specific training, where a combination of teaching methods were used, to gain skills and confidence in this field. Clinical mentorship, and observing others confidently using the full range of instruments, was also required, and valued, to develop competency and expertise in AVD. However, concerns regarding poor outcomes and litigation were also raised. CONCLUSION Access to specific AVD training, using a combination of teaching methods. Complements, but does not replace, close clinical mentorship from experts who are positive about AVD, and opportunities to practice emerging AVD skills with supportive supervision. Further research is required to ascertain effective modalities for wider training, education, and supportive supervision for optimal AVD use.
Collapse
Affiliation(s)
- Claire Feeley
- School of Community Health and Midwifery, University of Central Lancashire, Preston, PR1 2HE, UK.
| | - Nicola Crossland
- School of Community Health and Midwifery, University of Central Lancashire, Preston, PR1 2HE, UK
| | - Ana Pila Betran
- Department of Reproductive Health and Research, World Health Organisation, 1211, Geneva 27, Switzerland
| | - Andrew Weeks
- Sanyu Research Unit, Liverpool Women's Hospital Women and Children's Health, University of Liverpool, Liverpool, L87SS, UK
| | - Soo Downe
- School of Community Health and Midwifery, University of Central Lancashire, Preston, PR1 2HE, UK
| | - Carol Kingdon
- School of Community Health and Midwifery, University of Central Lancashire, Preston, PR1 2HE, UK
| |
Collapse
|
6
|
Hotton EJ, Merialdi M, Crofts JF. Simulation for intrapartum care: from training to novel device innovation. Minerva Obstet Gynecol 2020; 73:82-93. [PMID: 33196635 DOI: 10.23736/s2724-606x.20.04669-9] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Improving maternal and perinatal care is a global priority. Simulation training and novel applications of simulation for intrapartum care may help to reduce preventable deaths worldwide. Evaluation studies have published details of the effectiveness of simulation training for obstetric emergencies, exploring clinical and non-clinical factors as well as the impact on patient outcomes (both maternal and neonatal). This review summarized the many uses of simulation in obstetric emergencies from training to assessment. It also described the adaption of training in low-resource settings and the evidence behind the equipment recommended to support simulation training. The review also discussed novel applications for simulation such as its use in the development of a new device for assisted vaginal birth and its potential role in Cesarean section training. This study analyzed the financial implications of simulation training and how this may impact the delivery of such training packages, considering that simulation should be developed and utilized as a key tool in the development of safe intrapartum care in both emergency and non-emergency settings, in innovation and product development.
Collapse
Affiliation(s)
- Emily J Hotton
- Department of Women and Children's Research, Southmead Hospital, Translational Health Sciences, University of Bristol, Bristol, UK -
| | | | - Joanna F Crofts
- Department of Women and Children's Research, Southmead Hospital, Translational Health Sciences, University of Bristol, Bristol, UK
| |
Collapse
|
7
|
|
8
|
Skills training for operative vaginal birth. Best Pract Res Clin Obstet Gynaecol 2019; 56:11-22. [DOI: 10.1016/j.bpobgyn.2018.10.001] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2018] [Revised: 09/21/2018] [Accepted: 10/05/2018] [Indexed: 11/19/2022]
|
9
|
Murphy DJ. Medico-legal considerations and operative vaginal delivery. Best Pract Res Clin Obstet Gynaecol 2019; 56:114-124. [PMID: 30827818 DOI: 10.1016/j.bpobgyn.2019.01.012] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2019] [Accepted: 01/29/2019] [Indexed: 10/27/2022]
Abstract
Women undergo operative vaginal delivery (OVD) as an alternative to caesarean section when complications arise in the second stage of labour. The perinatal mortality associated with OVD is very low, and most of the perinatal morbidity is minor. However, when serious adverse events occur, such as traumatic birth injury, shoulder dystocia, cerebral palsy and perinatal death, there are medico-legal implications. There is also the potential for litigation in relation to maternal pelvic floor injury, which is increased with OVD. Obstetricians performing and supervising OVDs need to be aware of the potential pitfalls and minimise the risk of adverse outcomes. Given that most obstetricians will be involved in adverse birth-related events, it is important that they are aware of the legal processes that may ensue. It is also important when reviewing adverse OVD-related outcomes that association is differentiated from causation. These issues are addressed in the current chapter with attention drawn to the Montgomery ruling, which redefines the legal standards expected in relation to informed consent.
Collapse
|
10
|
Walker S, Scamell M, Parker P. Standards for maternity care professionals attending planned upright breech births: A Delphi study. Midwifery 2016; 34:7-14. [DOI: 10.1016/j.midw.2016.01.007] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2015] [Revised: 01/14/2016] [Accepted: 01/18/2016] [Indexed: 10/22/2022]
|
11
|
Secter MB, Simpson AN, Gurau D, Snelgrove JW, Hodges R, Mocarski E, Pittini R, Windrim R, Higgins M. Learning From Experience: Qualitative Analysis to Develop a Cognitive Task List for Vaginal Breech Deliveries. JOURNAL OF OBSTETRICS AND GYNAECOLOGY CANADA 2015; 37:966-74. [DOI: 10.1016/s1701-2163(16)30046-9] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
|
12
|
Learning From Experience: Development of a Cognitive Task List to Perform a Safe and Successful Non-Rotational Forceps Delivery. JOURNAL OF OBSTETRICS AND GYNAECOLOGY CANADA 2015; 37:589-597. [DOI: 10.1016/s1701-2163(15)30196-1] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
13
|
Hodges R, Simpson A, Gurau D, Secter M, Mocarski E, Pittini R, Snelgrove J, Windrim R, Higgins M. Learning from Experience: Development of a Cognitive Task-List to Assess the Second Stage of Labour for Operative Delivery. JOURNAL OF OBSTETRICS AND GYNAECOLOGY CANADA 2015; 37:354-361. [DOI: 10.1016/s1701-2163(15)30287-5] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
14
|
What should the ideal HIV self-test look like? A usability study of test prototypes in unsupervised HIV self-testing in Kenya, Malawi, and South Africa. AIDS Behav 2014; 18 Suppl 4:S422-32. [PMID: 24947852 DOI: 10.1007/s10461-014-0818-8] [Citation(s) in RCA: 78] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
Abstract
HIV self-testing (HIVST) is increasingly being sought and offered globally, yet there is limited information about the test features that will be required for an HIV self-test to be easy to use, acceptable to users, and feasible for manufacturers to produce. We conducted formative usability research with participants who were naïve to HIVST using five prototypes in Kenya, Malawi, and South Africa. The tests selected ranged from early-stage prototypes to commercially ready products and had a diverse set of features. A total of 150 lay users were video-recorded conducting unsupervised self-testing and interviewed to understand their opinions of the test. Participants did not receive a test result, but interpreted standardized result panels. This study demonstrated that users will refer to the instructions included with the test, but these can be confusing or difficult to follow. Errors were common, with less than 25% of participants conducting all steps correctly and 47.3% of participants performing multiple errors, particularly in sample collection and transfer. Participants also had difficulty interpreting results. To overcome these issues, the ideal HIV self-test requires pictorial instructions that are easy to understand, simple sample collection with integrated test components, fewer steps, and results that are easy to interpret.
Collapse
|
15
|
Qualitative analysis by interviews and video recordings to establish the components of a skilled rotational forceps delivery. Eur J Obstet Gynecol Reprod Biol 2013; 170:341-7. [DOI: 10.1016/j.ejogrb.2013.06.034] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2012] [Revised: 04/16/2013] [Accepted: 06/15/2013] [Indexed: 11/21/2022]
|
16
|
Decision-making in operative vaginal delivery: when to intervene, where to deliver and which instrument to use? Qualitative analysis of expert clinical practice. Eur J Obstet Gynecol Reprod Biol 2013; 170:333-40. [DOI: 10.1016/j.ejogrb.2013.06.033] [Citation(s) in RCA: 22] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2012] [Revised: 04/16/2013] [Accepted: 06/15/2013] [Indexed: 11/17/2022]
|
17
|
Kasangaki A, Macnab A, Cannon W. Videotaped interviews as a medium to enhance cross-cultural programme evaluation. Health Promot Int 2012; 27:74-81. [DOI: 10.1093/heapro/dar098] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2022] Open
|
18
|
A cohort study of maternal and neonatal morbidity in relation to use of sequential instruments at operative vaginal delivery. Eur J Obstet Gynecol Reprod Biol 2011; 156:41-5. [DOI: 10.1016/j.ejogrb.2011.01.004] [Citation(s) in RCA: 119] [Impact Index Per Article: 9.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2010] [Revised: 10/06/2010] [Accepted: 01/07/2011] [Indexed: 11/20/2022]
|
19
|
Ennen CS, Satin AJ. Training and assessment in obstetrics: the role of simulation. Best Pract Res Clin Obstet Gynaecol 2010; 24:747-58. [DOI: 10.1016/j.bpobgyn.2010.03.003] [Citation(s) in RCA: 46] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2010] [Accepted: 03/22/2010] [Indexed: 12/20/2022]
|
20
|
Williams JB, McDonough MA, Hilliard MW, Williams AL, Cuniowski PC, Gonzalez MG. Intermethod reliability of real-time versus delayed videotaped evaluation of a high-fidelity medical simulation septic shock scenario. Acad Emerg Med 2009; 16:887-93. [PMID: 19845552 DOI: 10.1111/j.1553-2712.2009.00505.x] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
Abstract
OBJECTIVES High-fidelity medical simulation (HFMS) is increasingly utilized in resident education and evaluation. No criterion standard of assessing performance currently exists. This study compared the intermethod reliability of real-time versus videotaped evaluation of HFMS participant performance. METHODS Twenty-five emergency medicine residents and one transitional resident participated in a septic shock HFMS scenario. Four evaluators assessed the performance of participants on technical (26-item yes/no completion) and nontechnical (seven item, five-point Likert scale assessment) scorecards. Two evaluators provided assessment in real time, and two provided delayed videotape review. After 13 scenarios, evaluators crossed over and completed the scenarios in the opposite method. Real-time evaluations were completed immediately at the end of the simulation; videotape reviewers were allowed to review the scenarios with no time limit. Agreement between raters was tested using the intraclass correlation coefficient (ICC), with Cronbach's alpha used to measure consistency among items on the scores on the checklists. RESULTS Bland-Altman plot analysis of both conditions revealed substantial agreement between the real-time and videotaped review scores by reviewers. The mean difference between the reviewers was 0.0 (95% confidence interval [CI] = -3.7 to 3.6) on the technical evaluation and -1.6 (95% CI = -11.4 to 8.2) on the nontechnical scorecard assessment. Comparison of evaluations for the videotape technical scorecard demonstrated a Cronbach's alpha of 0.914, with an ICC of 0.842 (95% CI = 0.679 to 0.926), and the real-time technical scorecard demonstrated a Cronbach's alpha of 0.899, with an ICC of 0.817 (95% CI = 0.633 to 0.914), demonstrating excellent intermethod reliability. Comparison of evaluations for the videotape nontechnical scorecard demonstrated a Cronbach's alpha of 0.888, with an ICC of 0.798 (95% CI = 0.600 to 0.904), and the real-time nontechnical scorecard demonstrated a Cronbach's alpha of 0.833, with an ICC of 0.714 (95% CI = 0.457 to 0.861), demonstrating substantial interrater reliability. The raters were consistent in agreement on performance within each level of training, as the analysis of variance demonstrated no significant differences between the technical scorecard (p = 0.176) and nontechnical scorecard (p = 0.367). CONCLUSIONS Real-time and videotaped-based evaluations of resident performance of both technical and nontechnical skills during an HFMS septic shock scenario provided equally reliable methods of assessment.
Collapse
Affiliation(s)
- Justin B Williams
- Department of Emergency Medicine, San Antonio Military Medical Center-North, USA.
| | | | | | | | | | | |
Collapse
|