Online learning in health professions education. Part 2: Tools and practical application: AMEE Guide No. 163

Blended e-learning and certification for medicines development professionals: results of a 7-year collaboration between King's College, London and the GMDP Academy, New York

Introduction

The field of Medicines Development faces a continuous need for educational evolution to match the interdisciplinary and global nature of the pharmaceutical industry. This paper discusses the outcomes of a 7-year collaboration between King's College London and the Global Medicines Development Professionals (GMDP) Academy, which aimed to address this need through a blended e-learning program.

Methods

The collaboration developed a comprehensive curriculum based on the PharmaTrain syllabus, delivered through a combination of asynchronous and synchronous e-learning methods. The program targeted a diverse range of professionals serving in areas related to Medical Affairs.

Results

Over seven annual cohorts, 682 participants from eighty-six countries were enrolled in the program. The program's effectiveness was assessed using Kirkpatrick's model, showing elevated levels of satisfaction (over 4.0 on a five-point scale), suggesting significant gains in competence at the cognitive level and leveraged performance. Notably, 70% of responding alumni reported significant improvement in their functions, corroborated by 30% of their supervisors. The further long-term impact of the program on their respective organization has not been established.

Discussion

The GMDP Academy's program has significantly contributed to life-long learning in Medicines Development, addressing educational gaps and fostering interdisciplinary collaboration. Its success highlights the importance of continuous education in keeping pace with the industry's evolving demands and underscores the potential of blended learning in achieving educational objectives in pharmaceutical medicine.

The future of health professions education

The need for a fit-for-purpose curriculum with a closer alignment of health professions education with society's needs was addressed at the International Conference on the Future of Health Professions Education held in Miami in November 2022. Issues discussed at the Conference were equity, competency-based education, technology enhanced learning, interprofessional education, lifelong learning, international collaborations, and the changing role of students.

A case study: lessons learned from online tutorial to improve practice readiness for family medicine residents in Palestine

BACKGROUND

Geopolitical and socioeconomic challenges limit faculty development and clinical teaching in Palestine and many other developing countries. The first, and still only, Family Medicine (FM) residency program is a four-year program based out of An-Najah University in the West Bank. Training in primary care clinics occurs in the final two years and there are many challenges to adequate supervision in the clinical setting that were exacerbated during the pandemic. To improve the readiness for practice skills of 13 Palestinian FM residents a three-month tutorial program was organized in 2020. A nongovernmental organization (NGO) that has worked to support Family Medicine development in the region engaged experienced British and American General Practitioners trained as tutors to offer online tutorials. We examined the program as a case study to understand the factors that facilitated or impaired a positive virtual learning environment in a middle/low income country.

METHODS

The tutors and residents were divided into groups and met virtually between June and September 2020. Evaluations and session reports collected during the program, the text of an online chat, and responses to an online survey two years later were collected. Using thematic analysis techniques, we evaluated the value for the residents at the time and two years later and identified factors that facilitated or impaired a positive virtual learning environment.

RESULTS

Themes of knowledge, skills, attitudes, cultural disconnects, and tutorial logistics emerged. The group with the most stable tutor pairing, including one Arabic-speaker familiar with the context, was the most engaged. The all-female group formed a chat group to share real-time case questions during clinical practice and focused on skills (e.g. conducting a thorough medication review) and attitudes (e.g. open to sharing and discussing uncertainties). Other groups were less cohesive.

CONCLUSIONS

Transnational tutorials that focused on clinical thinking and decision-making skills were most successful when the tutorial pair was stable, offered familiarity with the language and addressed cultural differences. Intrinsic factors such as lacking the motivation to participate and extrinsic factors such as unstable internet and rolling electric cuts, and clinical structures that made applying new skills challenging were more difficult to address but must be considered.

Increasing Realism and Variety of Virtual Patient Dialogues for Prenatal Counseling Education Through a Novel Application of ChatGPT: Exploratory Observational Study

BACKGROUND

Using virtual patients, facilitated by natural language processing, provides a valuable educational experience for learners. Generating a large, varied sample of realistic and appropriate responses for virtual patients is challenging. Artificial intelligence (AI) programs can be a viable source for these responses, but their utility for this purpose has not been explored.

OBJECTIVE

In this study, we explored the effectiveness of generative AI (ChatGPT) in developing realistic virtual standardized patient dialogues to teach prenatal counseling skills.

METHODS

ChatGPT was prompted to generate a list of common areas of concern and questions that families expecting preterm delivery at 24 weeks gestation might ask during prenatal counseling. ChatGPT was then prompted to generate 2 role-plays with dialogues between a parent expecting a potential preterm delivery at 24 weeks and their counseling physician using each of the example questions. The prompt was repeated for 2 unique role-plays: one parent was characterized as anxious and the other as having low trust in the medical system. Role-play scripts were exported verbatim and independently reviewed by 2 neonatologists with experience in prenatal counseling, using a scale of 1-5 on realism, appropriateness, and utility for virtual standardized patient responses.

RESULTS

ChatGPT generated 7 areas of concern, with 35 example questions used to generate role-plays. The 35 role-play transcripts generated 176 unique parent responses (median 5, IQR 4-6, per role-play) with 268 unique sentences. Expert review identified 117 (65%) of the 176 responses as indicating an emotion, either directly or indirectly. Approximately half (98/176, 56%) of the responses had 2 or more sentences, and half (88/176, 50%) included at least 1 question. More than half (104/176, 58%) of the responses from role-played parent characters described a feeling, such as being scared, worried, or concerned. The role-plays of parents with low trust in the medical system generated many unique sentences (n=50). Most of the sentences in the responses were found to be reasonably realistic (214/268, 80%), appropriate for variable prenatal counseling conversation paths (233/268, 87%), and usable without more than a minimal modification in a virtual patient program (169/268, 63%).

CONCLUSIONS

Generative AI programs, such as ChatGPT, may provide a viable source of training materials to expand virtual patient programs, with careful attention to the concerns and questions of patients and families. Given the potential for unrealistic or inappropriate statements and questions, an expert should review AI chat outputs before deploying them in an educational program.