Objective assessment of obstetrics residents' surgical skills in caesarean: Development and evaluation of a specific rating scale

OBJECTIVE

To develop a modified version of Objective Structured Assessment of Technical Skill (OSATS) rating scale for evaluation of surgical skills specific to caesarean and to assess its relevance in documenting the residents' learning curve during their training. Secondarily, to verify the scale's stability to caesarean's level of difficulty and comparing self-assessment to hetero-assessment in order to propose a practical application of this rating scale during residency.

STUDY DESIGN

We conducted a multicentre observational prospective study, from May 2018 to November 2018. All residents at that time could participate and fill in the rating scale after caesarean. Senior surgeons had to fill in the same rating scale. We analysed correlation between self-assessments and hetero-assessments and sensitivity to change of the rating scale. Analysis of feature's relevance was performed by principal component analysis, factor analysis and reliability analysis.

RESULTS

In total, 234 rating scales were completed evaluating 18 residents. Our study demonstrated that our rating scale could be used to evaluate surgical skills of residents during caesarean and distinguish their year of residency (p < 0.001) with a high correlation between self and hetero-assessment (Intraclass Correlation coefficient for global score: 0.78; 95% CI 0.68-0.86). The principal component analysis revealed two dimensions corresponding to the two parts of the rating scale and the factorial analysis allowed us to confirm distribution of features according to these two dimensions. Cronbach's alpha allowed us to highlight the percentage of representation of the scale's features in relation to all potential theoretical features (0.93, 95% CI 0.82-0.95).

CONCLUSION

Our rating scale could be used for self-assessment during residency and as a hetero-assessment tool for validating defined stages of the internship.

Prevalence and characterization of postoperative pain in the Postanaesthesia Care Unit

INTRODUCTION

Immediate postoperative pain occurs initially after surgery, while the patient is in the Post-Anaesthesia Recovery Unit. Very few studies assess this pain in this most immediate phase.

OBJECTIVE

Cross-sectional study of the prevalence and characteristics of immediate postoperative pain in patients after surgery.

MATERIAL AND METHODS

Between August 2014 and February 2015, a sample of 503 patients from the Post-Anaesthesia Recovery Unit was followed. Immediate postoperative pain was assessed (by the patient and the researcher) using the visual analogue scale (VAS; range 0-10) on 5 occasions after surgery. The impact of numerous factors (age, gender, type of surgery, type of anaesthesia and analgesic) on the pain, as well as variation in vital signs and the presence of side effects, were analysed.

RESULTS

Assessment of the pain showed overall VAS values of 2.2±2.8 on all occasions. Pain was reported to be of greatest intensity 20min after the patients' arrival in the Post-Anaesthesia Recovery Unit (P<.001). The VAS values reported by the researcher (1.4±2.0) were lower than those reported by the patients. Although there was a very strong correlation (R²=0.82; P<.001) and they followed a parallel distribution, there was moderate concordance (kappa=0.4). Plastic surgery and neurosurgery were the specialties with the highest percentages of VAS values in the strong intensity range (8-10). Patients with regional block techniques (with or without general anaesthesia) had lower VAS values than other general anaesthesia groups. Male patients and older patients displayed less pain than female and young patients, respectively (P<.001).

CONCLUSIONS

Studying the characteristics of postoperative pain at such an early stage allows for improved management. It helps to predict, according to the type of surgery and the anaesthesia used, those patients in which higher VAS values may be seen and to better adapt analgesic therapy.