Evaluation of Key Performance Indicators (KPIs) for Sustainable Postgraduate Medical Training: An Opportunity for Implementing an Innovative Approach to Advance the Quality of Training Programs at the Saudi Commission for Health Specialties (SCFHS)

Key Performance Indicators: A Framework for Allied Healthcare Educational Institutions

Background

Performance evaluation in the allied healthcare education sector is complex, making it essential for policymakers and managers to approach it comprehensively and thoughtfully to understand their performance. Hence, the development and monitoring of Key Performance Indicators (KPIs) in this domain must be considered one of the key priorities for the policymakers in AHIs.

Aim

This study aims to develop a framework for the AHIs to extract and profile the indicators, measure, and report the results appropriately.

Methods

The authors adopted a general review of the literature approach to study the primary goals of the institutional KPI framework, emphasizing the need for benchmarking while implementing KPIs and how to track performance using a KPI dashboard.

Results

The study provides the scope, relevant KPI categories, and a list of KPIs for evaluating the effectiveness of allied healthcare programs. The study findings also emphasized the need for benchmarking the KPIs and establishing a KPI dashboard while measuring and monitoring performance.

Conclusion

KPIs are considered an invaluable tool that contributes immensely to the performance monitoring process of AHIs, irrespective of the specialties. This helps to identify and guide AHIs for developing KPIs and the associated minimum data set to measure organizational performance and monitor the quality of teaching and learning. In addition, the KPI framework reported in this study is a tool to assist performance monitoring that can subsequently contribute to the overall quality of AHIs.

Effectiveness and Preparedness of Institutions' E-Learning Methods During the COVID-19 Pandemic for Residents' Medical Training in Saudi Arabia: A Pilot Study

Background: Under the urgent circumstances of the COVID-19 pandemic, higher education institutions of an international scale have resorted to online education methods, exclusive or not. Among those, medical institutions are under double pressure, fighting the pandemic's effects and, at the same time providing efficient clinical training to their residents. The main aim of the study is to evaluate the preparedness of the educational institutions for the e-learning platform transition for the delivery of medical training and also to evaluate the overall satisfaction level of the participants with their e-learning experience. Methods: This is an observational cross-sectional study design. The survey's sample included 300 medical students and residents of multiple training levels and specialties, coming from more than 15 different cities of Saudi Arabia. Filling the questionnaire required specific inclusion criteria and all obtained data were secured by the Saudi Commission of Health specialty. The main objective was to evaluate the quality of e-learning methods provided by medical universities. For the collection of the data, Survey Monkey software was used and the analysis was conducted with SPSS. Results: The study found that the frequency of digital education use increased by ~61% during the coronavirus crisis, while almost 9 out of 10 residents have used some e-learning platform. It was reported that before the pandemic, participants' online training was deemed to be rather ineffective, given the rate of 3.65 out of 10. However, despite the increase in e-learning use after COVID-19, many obstacles arose duringcthe adaptation process. According to our survey: lectures and training sessions were not conducted as per the curriculum (56.33%); both students and instructors' academic behavior and attitude changed (48.33%); engagement, satisfaction, and motivation in class were rated low (5.93, 6.33, and 6.54 out of 10 accordingly), compared to the desired ones. Still, participants accredited e-learning as a potential mandatory tool (77.67%) and pinpointed the qualifications that in their opinion will maximize educational impact. Conclusion: The study concluded that innovative restructuring of online education should be based on defined critical success factors (technical support, content enhancement, pedagogy etc.) and if possible, set priority levels, so that a more permanent e-learning practice is achievable. Also our study confirmed that students were overall satisfied with the e-learning support of the training method.

Challenges and Obstacles Faced by Trainee Female Physicians: An Integrative Research on Gender Discrimination, Stress, Depression and Harassment

This study's purpose is to assess the challenges and obstacles faced by female trainee physicians and suggest solutions that could resolve these issues and improve their performance. The study utilized an observational, analytical, cross-sectional design based on a self-administered open-ended and validated questionnaire which was distributed to 133 recruited female resident trainees of medical units in Jeddah, Saudi Arabia. The findings of the study revealed that 52% female trainees experienced gender discrimination, mostly (65%) by their superiors, while 40% were regularly harassed. About half (53%) of the interviewees were severely depressed, resulting in their reconsidering their career in medicine. A total of 14% thought of suicide, while four planned to end and five had attempted to end their life. However, only eight (6%) participants officially reported the cases of harassment to the accountable superiors. Half of them felt neglected by the healthcare administration, and one-fourth (24%) were underachieving in their studies and work. The study concluded that work dissatisfaction, limited clinical correspondence, high depression, burnout, stress and drop-out rates-all deriving from common gender discrimination-compose the alarming and complex challenges that female trainee residents in Jeddah of various levels and specialties have to face.

Residents’ Training in COVID-19 Pandemic Times: An Integrated Survey of Educational Process, Institutional Support, Anxiety and Depression by the Saudi Commission for Health Specialties (SCFHS)

In late December of 2019, the outbreak of coronavirus disease (COVID-19) was first reported in the city of Wuhan, the capital of Hubei province in China, and was declared a pandemic by the World Health Organization in March 2020. Globally, as of 8 July 2020, there have been 11,669,259 confirmed cases of COVID-19, including 539,906 deaths. In Saudi Arabia, the confirmed cases have already reached 223,327, with 161,096 patients confirmed to have recovered, and 2100 deaths. This study aims to determine the effect of the COVID-19 pandemic on the training programs of the Saudi Commission for Health Specialties (SCFHS) and assess trainees’ mental health status (i.e., anxiety and depression). Trainee evaluations on training programs were also sought in order to obtain insights for strategic planning necessary for curricular modifications or improvements to address the clinical learning needs of trainees during this pandemic. The main contribution of our work is an investigation of the incidence of depression and anxiety regarding COVID-19 within the community of residents and fellows. Furthermore, we elaborate on key responsive actions towards the enhancement of the mental health of trainees. Last but not least, we propose the Saudi Commission for Health Specialties (SCFHS) Model for Residents’ Mental Health Enhancement during the COVID-19 Pandemic, which consists of five integrative value layers for medical education and training, namely: the knowledge creation process and innovation; technological capabilities for personalized medicine and patient-centric healthcare with a social impact; innovative applications of technology-enhanced learning and web-based active learning approaches for medical training and education; residents’ wellbeing and the impact of COVID-19 in strategic layers. In our future work, we intend to enhance the proposed framework with studies on trainee satisfaction and the efficiency of different technology-enhanced learning platforms for medical education.