Creating a Framework to Integrate Residency Program and Medical Center Approaches to Quality Improvement and Patient Safety Training

A review of ophthalmology education in the era of generative artificial intelligence

PURPOSE

To explore the integration of generative AI, specifically large language models (LLMs), in ophthalmology education and practice, addressing their applications, benefits, challenges, and future directions.

DESIGN

A literature review and analysis of current AI applications and educational programs in ophthalmology.

METHODS

Analysis of published studies, reviews, articles, websites, and institutional reports on AI use in ophthalmology. Examination of educational programs incorporating AI, including curriculum frameworks, training methodologies, and evaluations of AI performance on medical examinations and clinical case studies.

RESULTS

Generative AI, particularly LLMs, shows potential to improve diagnostic accuracy and patient care in ophthalmology. Applications include aiding in patient, physician, and medical students' education. However, challenges such as AI hallucinations, biases, lack of interpretability, and outdated training data limit clinical deployment. Studies revealed varying levels of accuracy of LLMs on ophthalmology board exam questions, underscoring the need for more reliable AI integration. Several educational programs nationwide provide AI and data science training relevant to clinical medicine and ophthalmology.

CONCLUSIONS

Generative AI and LLMs offer promising advancements in ophthalmology education and practice. Addressing challenges through comprehensive curricula that include fundamental AI principles, ethical guidelines, and updated, unbiased training data is crucial. Future directions include developing clinically relevant evaluation metrics, implementing hybrid models with human oversight, leveraging image-rich data, and benchmarking AI performance against ophthalmologists. Robust policies on data privacy, security, and transparency are essential for fostering a safe and ethical environment for AI applications in ophthalmology.

Early Immersion in Team-Based Event Review: Experiential Patient Safety Education for PGY 1 Internal Medicine Residents

Introduction

In recent years, there has been a national push to incorporate high-fidelity quality improvement and patient safety (QIPS) education into physician training programs. In fact, integration of robust patient safety education became an Accreditation Council for Graduate Medical Education (ACGME) Common Program Requirement for residency programs in 2017. We developed a curriculum to not only fulfill the ACGME's requirement but also provide PGY 1 internal medicine residents with the skills needed to become active participants in ongoing patient safety work throughout their training and careers.

Methods

Our patient safety curriculum was woven into residents' existing protected educational time and supported by a standardized facilitator guide and participant workbook. It combined didactic prework with the review of recent near-miss or low-harm patient safety events, empowering residents to identify root causes and propose interventions.

Results

We successfully delivered our patient safety curriculum to 80 PGY 1 residents over the course of 2 academic years. Residents rated the curriculum as a valuable educational experience, and the event reviews they completed met most of the criteria for high-quality patient safety reviews according to the Strong String Assessment.

Discussion

Implementation of this standardized curriculum has allowed us to reliably and consistently incorporate experiential patient safety education into the first year of training for internal medicine residents. Unlike purely didactic sessions, our curriculum encourages active learning, building muscle memory for event reviews that enables future engagement in patient safety activities.

A theoretical and practical approach to quality improvement education

Quality Improvement (QI) knowledge and skills are required at all levels of physician training. System improvement efforts need to include understanding of health disparities and design of interventions to reduce those disparities, thus health equity needs to be integrated into QI education. Payors, accreditation bodies and health systems' emphases on QI result in the need for QI curricula that meet the needs of diverse learners. This article presents a theoretical background and practical tools for designing, implementing, and evaluating a QI educational program across the spectrum of physician training with an emphasis on competency-based education and a goal of continuous practice improvement. Practice-based learning and improvement and systems-based practice are two core domains of competencies for readiness to practice. These competencies can be met through the health systems science framework for studying improvement in patient care and health care delivery coupled with QI science. Curricula should incorporate interactive learning of theory and principles of QI as well as mentored, experiential QI project work with multidisciplinary teams. QI projects often develop ideas and implement changes but are often inconsistent in studying intervention impacts or reaching the level of patient outcomes. Curriculum design should incorporate adult learning principles, competency based medical education, environmental and audience factors, and formats for content delivery. Key QI topics and how they fit into the clinical environment and teaching resources are provided, as well as options for faculty development. Approaches to evaluation are presented, along with tools for assessing learner's beliefs and attitudes, knowledge and application of QI principles, project evaluation, competency and curriculum evaluation. If the goal is to empower the next generation of change agents, there remains a need for development of scientific methodology and scholarly work, as well as faculty development and support by institutions.

Strategies for developing faculty confidence and competencies to mentor quality improvement DNP projects

DNP faculty who mentor students in quality improvement (QI) DNP projects often lack essential knowledge of QI principles. The purpose of this article is to guide DNP programs in developing confident and competent faculty mentors for QI DNP projects, facilitating DNP student success. At a multi-campus practice- and research-intensive university, strategies employed to teach College of Nursing faculty essential knowledge of QI principles comprise structural and process components. Structural supports standardize faculty workload, promote potential for collaborative scholarship, and provide instructional and resource support for faculty mentors. Organizational processes facilitate identification of practice sites and meaningful projects. A College of Nursing and university Institutional Review Board collaboration established policy to guide human subjects protection regarding DNP project activity, streamlining and standardizing the process. Library support mechanisms, access to ongoing faculty QI training and resources, and faculty feedback processes to improve QI faculty development are ongoing and sustained. Peer coaching provides continued support for faculty development. Initial process outcomes indicate that implemented strategies are well-received by faculty. The transition to competency-based education provides opportunities to create tools to measure multiple student quality and safety competencies highlighted in Domain 5 of The Essentials: Core Competencies for Professional Nursing Education and inform future directions for faculty development essential to support student success.

Outcomes in quality improvement and patient safety training: moving from in-person to synchronous distance education

BACKGROUND

The COVID-19 pandemic necessitated increased synchronous distance education (SDE) in graduate medical education, presenting challenges for Quality Improvement and Patient Safety (QIPS) best practices, which call for integration with daily clinical care and investigation of real patient safety events.

OBJECTIVE

To evaluate educational outcomes for QIPS training after conversion of a mature, in-person curriculum to SDE.

METHODS

68 postgraduate year (PGY)-1 residents were surveyed before and after the SDE Culture of Patient Safety training in June 2020, and 59 PGY-2s were administered the Quality Improvement Knowledge Application Tool-Revised (QIKAT-R) before and after the SDE QIPS seminar series in July-August 2020. Values before and after training were compared using sign tests for matched pairs (PGY-1) and Wilcoxon signed-rank tests (PGY-2).

RESULTS

100% (68 of 68) of PGY-1s and 46% (27 of 59) of PGY-2s completed precourse and postcourse surveys. Before the course, 55 PGY-1s (81%) strongly agreed that submitting patient safety event reports are a physician's responsibility, and 63 (93%) did so after (15% increase, p=0.004). For PGY-2s, the median composite QIKAT-R score was 17 (IQR 14.5-20) before and 22.5 (IQR 20-24.5) after the seminars, with a median difference of 4.5 (IQR 1.5-7), a 32% increase in QIPS competency (p=0.001).

CONCLUSIONS

Patient safety attitudes and quality improvement knowledge increased after SDE QIPS training at comparable levels to previously published results for in-person training, supporting SDE use in future hybrid curricula to optimise educational value and reach.

Scholarship in anesthesiology: the role of critical appraisal, literature review, quality improvement, journal club, and presentation skills

If asked to describe the term "anesthesiologist scholar", one may receive a variety of definitions depending on the individual's area of practice, location in the world, and the generation in which they trained. In this article, we review the roles of five core elements that make an anesthesiologist a "scholar": skills in critical appraisal, literature review, quality improvement, journal club participation, and presentation delivery. Although this list of scholarly components is not comprehensive, review of each element's role in the everyday practice and training of physicians will offer insight into their evolution and may offer a glimpse into the future of anesthesiologist scholars. Overall, through the dissemination, recognition, and support of scholarship through these practices, we will continue to achieve meaningful outcomes for our patients and promote a culture of collaboration worldwide. We should ensure that these topic areas become a bedrock of medical education globally, and we must foster opportunities for those who have already completed training to develop and master these skills as a part of their clinical and academic practice.

Supporting a culture of patient safety: Resident-led patient safety event reviews in a pathology residency training program

Patient safety is a critical component of quality patient care at any healthcare institution. In order to support a culture of patient safety, and in the context of a hospital-wide patient safety initiative at our institution, we have created and implemented a new patient safety curriculum within our training program. The curriculum is embedded in an introductory course for first-year residents, in which residents gain an understanding of the multifaceted role of the pathologist in patient care. The patient safety curriculum is a resident-centered event review process and includes 1) identification and reporting of a patient safety event, 2) event investigation and review, and 3) presentation of findings to the residency program including core faculty and safety champions for the consideration of implementation of the identified systems solution. Here we discuss the development of our patient safety curriculum, which was trialed over a series of seven event reviews conducted between January 2021 and June 2022. Resident involvement in patient safety event reporting and patient safety event review outcomes were measured. All event reviews conducted thus far have resulted in the implementation of the solutions discussed during event review presentations based on cause analysis and identification of strong action items. Ultimately this pilot will serve as the basis by which we implement a sustainable curriculum in our pathology residency training program centered on supporting a culture of patient safety, and in line with ACGME requirements.