A novel approach to needs assessment in curriculum development: going beyond consensus methods

Using interprofessional education to build dynamic teams to help drive collaborative, coordinated and effective newborn care

BACKGROUND

As countries strive to achieve sustainable development goal 3.2, high-quality medical education is crucial for high-quality neonatal care. Women are encouraged to deliver in health units attended by a skilled team. Traditionally, the team is doctors and nurses, but they are members of a large group of interdependent experts from other disciplines. Each discipline trains separately, yet the goal of good neonatal care is common to all. The use of interprofessional education breaks down these professional silos improving collaborative practice and promoting excellent clinical care. Introduction of new educational materials and training requires a rigorous approach to ensure sustainability.

METHODS

An extensive needs assessment identified gaps in neonatal training. Specifically, there was a lack of inclusion of medical devices used in clinical care. In each country, national key stakeholders came together to develop and revise their own neonatal curricula, trainings or guidelines. A core writing education team were tasked to develop evidence-based materials on pertinent medical devices to include in these national materials. These then underwent internal and external review. A provider course for biomedical engineers and technicians was introduced. Skills labs were established to improve practical skills teaching. To improve the quality of teaching, a NEST360 generic instructors course (GIC) was developed.

RESULTS

Twenty modules, 14 scenarios, 17 job aids and 34 videos have been published to date. Materials have been embedded into neonatal curricula and national trainings. Forty-one skills labs were installed in pre-service learning institutions and, up to June 2022, have been used by 7281 students. Pre- and in-service interprofessional training was implemented at all NEST360 institutions (clinical and biomedical). GIC courses were conducted at least twice a year in all countries. Three hundred seventeen nurses, biomedical and clinical staff have undertaken the GIC in all four countries. GIC participants report that the course has very positively influenced their teaching practice.

CONCLUSIONS

Inclusion of key stakeholders throughout has ensured training is embedded within the four countries. Use of interprofessional education and inclusion of biomedical engineers and technicians has been very successful. Introduction of the GIC has developed a pool of high-quality educators for neonatal care. This approach has ensured that high-quality interprofessional neonatal training is included within national agendas for neonatal care and beyond.

Evaluating the knowledge on microbiome and dysbiosis in allergic diseases among medical sciences students in Saudi Arabia

BACKGROUND

Microbiome science deals with the development of diseases that are derived from the interaction between the host immune system and microbes. Microbiome disturbance or dysbiosis has been increasingly recognized as an important contributor to the pathogenesis of allergic diseases. Thus, this field is pivotal in the management of allergic disorders. Despite the increasing prevalence of allergic disorders in Saudi Arabia, medical students lack knowledge of microbiome science. Therefore, this study aimed to assess the level of knowledge of medical sciences students on the human microbiome, dysbiosis, and management of the impaired microbiome with a focus on allergic diseases and asthma.

METHODS

An online survey was designed, validated, and distributed to 100 final-year students and interns majoring in clinical nutrition, public health, and clinical laboratory sciences at a single university in Saudi Arabia. The study period was from November 2020 to January 2021.

RESULTS

The overall knowledge of the human microbiome was adequate among the participants, but their understanding of dysbiosis and management of the impaired microbiome was low to moderate. Knowledge of dysbiosis management was significantly higher in students majoring in clinical nutrition than in those majoring in public health and clinical laboratory sciences.

CONCLUSIONS

Collectively, this study provides the first evidence that knowledge of specific domains of microbiome science among a cohort of medical sciences students in Saudi Arabia is insufficient. Large-scale studies are warranted to confirm these observations at a national level, and specific curriculum modifications are necessary to improve the knowledge of future healthcare professionals about clinical applications of microbiome science.

Determining electrocardiography training priorities for medical students using a modified Delphi method

BACKGROUND

Although electrocardiography is considered a core learning outcome for medical students, there is currently little curricular guidance for undergraduate ECG training. Owing to the absence of expert consensus on undergraduate ECG teaching, curricular content is subject to individual opinion. The aim of this modified Delphi study was to establish expert consensus amongst content and context experts on an ECG curriculum for medical students.

METHODS

The Delphi technique, an established method of obtaining consensus, was used to develop an undergraduate ECG curriculum. Specialists involved in ECG teaching were invited to complete three rounds of online surveys. An undergraduate ECG curriculum was formulated from the topics of ECG instruction for which consensus (i.e. ≥75% agreement) was achieved.

RESULTS

The panellists (n = 131) had a wide range of expertise (42.8% Internal Medicine, 22.9% Cardiology, 16% Family Medicine, 13.7% Emergency Medicine and 4.6% Health Professions Education). Topics that reached consensus to be included in the undergraduate ECG curriculum were classified under technical aspects of performing ECGs, basic ECG analysis, recognition of the normal ECG and abnormal rhythms and waveforms and using electrocardiography as part of a clinical diagnosis. This study emphasises that ECG teaching should be framed within the clinical context. Course conveners should not overload students with complex and voluminous content, but rather focus on commonly encountered and life-threatening conditions, where accurate diagnosis impacts on patient outcome. A list of 23 "must know" ECG diagnoses is therefore proposed.

CONCLUSION

A multidisciplinary expert panel reached consensus on the ECG training priorities for medical students.

Transition to active learning in rural Nepal: an adaptable and scalable curriculum development model

BACKGROUND

Traditional medical education in much of the world has historically relied on passive learning. Although active learning has been in the medical education literature for decades, its incorporation into practice has been inconsistent. We describe and analyze the implementation of a multidisciplinary continuing medical education curriculum in a rural Nepali district hospital, for which a core objective was an organizational shift towards active learning.

METHODS

The intervention occurred in a district hospital in remote Nepal, staffed primarily by mid-level providers. Before the intervention, education sessions included traditional didactics. We conducted a mixed-methods needs assessment to determine the content and educational strategies for a revised curriculum. Our goal was to develop an effective, relevant, and acceptable curriculum, which could facilitate active learning. As part of the intervention, physicians acted as both learners and teachers by creating and delivering lectures. Presenters used lecture templates to prioritize clarity, relevance, and audience engagement, including discussion questions and clinical cases. Two 6-month curricular cycles were completed during the study period. Daily lecture evaluations assessed ease of understanding, relevance, clinical practice change, and participation. Periodic lecture audits recorded learner talk-time, the proportion of lecture time during which learners were talking, as a surrogate for active learning. Feedback from evaluation and audit results was provided to presenters, and pre- and post-curriculum knowledge assessment exams were conducted.

RESULTS

Lecture audits showed a significant increase in learner talk-time, from 14% at baseline to 30% between months 3-6, maintained at 31% through months 6-12. Lecture evaluations demonstrated satisfaction with the curriculum. Pre- and post-curriculum knowledge assessment scores improved from 50 to 64% (difference 13.3% ± 4.5%, p = 0.006). As an outcome for the measure of organizational change, the curriculum was replicated at an additional clinical site.

CONCLUSION

We demonstrate that active learning can be facilitated by implementing a new educational strategy. Lecture audits proved useful for internal program improvement. The components of the intervention which are transferable to other rural settings include the use of learners as teachers, lecture templates, and provision of immediate feedback. This curricular model could be adapted to similar settings in Nepal, and globally.

Comparison of simulation debriefs with traditional needs assessment methods: a qualitative exploratory study in a critical care community setting

OBJECTIVE

To better understand the potential of a needs assessment approach using qualitative data from manikin-based and virtual patient simulation debriefing sessions compared with traditional data collection methods (ie, focus groups and interviews).

DESIGN

Original data from simulation debrief sessions was compared and contrasted with data from an earlier assessment of critical care needs in a community setting (using focus groups and interviews), thus undertaking secondary analysis of data. Time and cost data were also examined. Debrief sessions were coded using deductive and inductive techniques. Matrices were used to explore the commonalities, differences and emergent findings across the methods.

SETTING

Critical care unit in a community hospital setting.

RESULTS

Interviews and focus groups yielded 684 and 647 min of audio-recordings, respectively. The manikin-based debrief recordings averaged 22 min (total=130 min) and virtual patient debrief recordings averaged 31 min (total=186 min). The approximate cost for the interviews and focus groups was $13 560, for manikin-based simulation debriefs was $4030 and for the virtual patient debriefs was $3475. Fifteen of 20 total themes were common across the simulation debriefs and interview/focus group data. Simulation-specific themes were identified, including fidelity (environment, equipment and psychological) and the multiple roles of the simulation instructor (educative, promoting reflection and assessing needs).

CONCLUSIONS

Given current fiscal realities, the dual benefit of being educative and identifying needs is appealing. While simulation is an innovative method to conduct needs assessments, it is important to recognise that there are trade-offs with the selection of methods.

Creation and Dissemination of a Multispecialty Graduate Medical Education Curriculum in Pediatric and Adolescent Gynecology: The North American Society for Pediatric and Adolescent Gynecology Resident Education Committee Experiences

STUDY OBJECTIVE

The goal was to develop a multispecialty committee to address deficiencies in pediatric and adolescent gynecology (PAG) resident education through curricular development under the auspices of the North American Society for Pediatric and Adolescent Gynecology. DESIGN, SETTING, PARTICIPANTS, INTERVENTIONS, AND MAIN OUTCOME MEASURES: A multispecialty North American committee was organized to develop short as well as long curricula in PAG through a combination of conference calls and face-to-face meetings. Content was guided by objectives of national accrediting organizations. The curricula used print as well as interactive electronic resources.

RESULTS

After publication of the short and long curricula, a dissemination strategy was developed to present the information at national meetings. A curricular study was performed after introduction of the curriculum to evaluate its efficacy. Long-term plans for further curricular components and expansion of educational tools are ongoing.

CONCLUSION

We gathered a diverse multispecialty group of doctors to collaborate on a unified educational goal. This committee developed and disseminated resident PAG curricula using a variety of learning tools. This curricular development and implementation can occur with a minimal financial burden.

Precepting at the time of a natural disaster

BACKGROUND

Natural disasters strike communities that have varied degrees of preparedness, both physical and psychological. Rural communities may be particularly vulnerable as they often do not have the infrastructure or resources to prepare in advance. The psychological impact of a natural disaster is amplified in learners who may be temporary members of the community and therefore cannot draw on personal support during the crisis. They may turn to their clinical preceptors for guidance.

CONTEXT

The Slave Lake fire (population 6782) in May 2011 and the High River flood (population 12 920) in June 2013 are examples of natural disasters that have occurred in rural Alberta, Canada. At the time of these critical incidents, three medical students and one family medicine resident from the two provincial medical schools were participating in rotations in these communities.

INNOVATION

Although disasters occur rarely, there is a need for guidelines for preceptors from the learner perspective. Accordingly, using a modified Delphi approach, we captured the experiences of learners that were then refined into two themes, each containing three recommendations: considerations for action during a natural disaster and considerations for action after the acute crisis has passed. Although disasters occur rarely, there is a need for guidelines for preceptors from the learner perspective IMPLICATIONS: Our recommendations provide suggestions for practical solutions that build on the usual expectations of mentors and may benefit the student-teacher relationship at the time of a disaster and beyond. They are meant to initiate discussion regarding further study aimed towards creating recommendations for preceptor response that may cross disciplines.