1
|
Albrecht L, Pratt M, Ng R, Olivier J, Sampson M, Fahey N, Gibson J, Lobos AT, O'Hearn K, Newhook D, Sutherland S, McNally D. Measuring continuing medical education conference impact and attendee experience: a scoping review. INTERNATIONAL JOURNAL OF MEDICAL EDUCATION 2024; 15:15-33. [PMID: 38431868 DOI: 10.5116/ijme.65cc.8c88] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/06/2023] [Accepted: 02/14/2024] [Indexed: 03/05/2024]
Abstract
Objectives The aim was to comprehensively identify published research evaluating continuing medical education conferences, to search for validated tools and perform a content analysis to identify the relevant domains for conference evaluation. Methods We used scoping review methodology and searched MEDLINE® for relevant English or French literature published between 2008 and 2022 (last search June 3, 2022). Original research (including randomized controlled trials, non-randomized studies, cohort, mixed-methods, qualitative studies, and editorial pieces) where investigators described impact, experience, or motivations related to conference attendance were eligible. Citations were assessed in triplicate, and data extracted in duplicate. Results Eighty-three studies were included, 69 (83%) of which were surveys or interview based, with the majority conducted at the end of or following conference conclusion. Of the 74 tools identified, only one was validated and was narrowly focused on a specific conference component. A total of 620 items were extracted and categorized into 4 a priori suggested domains (engagement-networking, education-learning, impact, scholarship), and an additional 4 identified through content analysis (value-satisfaction, logistics, equity-diversity-inclusivity, career influences). Time trends were evident, including the absence of items related to equity-diversity-inclusivity prior to 2019, and a focus on logistics, particularly technology and virtual conferences, since 2020. Conclusions This study identified 8 major domains relevant for continuing medical education conference evaluation. This work is of immediate value to individuals and organizations seeking to either design or evaluate a conference and represents a critical step in the development of a standardized tool for conference evaluation.
Collapse
Affiliation(s)
- Lisa Albrecht
- Children's Hospital of Eastern Ontario Research Institute, Ottawa, Canada
| | | | | | - Jeremy Olivier
- Children's Hospital of Eastern Ontario Research Institute, Ottawa, Canada
| | - Margaret Sampson
- Children's Hospital of Eastern Ontario Research Institute, Ottawa, Canada
| | | | | | | | - Katie O'Hearn
- Children's Hospital of Eastern Ontario Research Institute, Ottawa, Canada
| | - Dennis Newhook
- Children's Hospital of Eastern Ontario Research Institute, Ottawa, Canada
| | | | - Dayre McNally
- Children's Hospital of Eastern Ontario, Ottawa, Canada
| |
Collapse
|
2
|
Moritz S, Halawi A, Proksch C, Werner JM, Paulsson M, Rothschild M, Stosch C. Studies on acceptance, evaluation and impact of the Cologne program "Research and Medical Studies". GMS JOURNAL FOR MEDICAL EDUCATION 2020; 37:Doc5. [PMID: 32270019 PMCID: PMC7105762 DOI: 10.3205/zma001298] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Figures] [Subscribe] [Scholar Register] [Received: 06/05/2019] [Revised: 10/15/2019] [Accepted: 12/12/2019] [Indexed: 06/11/2023]
Abstract
Introduction: The curricular implementation of events (or programs) for science-related training in human medicine has been on the agenda of the medical faculties since the publication of the Federal-State Working Group [1]. The Medical Faculty of the University of Cologne developed and established a systematic, longitudinal science curriculum together with the start of the model curriculum in human medicine in 2003. Here, we investigate the questions of whether the described (para-) curricular elements are accepted by students and lecturers and how they are evaluated, especially by students. In addition, we investigate whether selected parameters can be used to demonstrate changes in the students' scientific activities. Project description: The program "Research and Medical Studies" (RaMS) consists of several components: these elements of the mandatory curricular (Scientific Projects, SP) and optional components (Research in Medical Studies (RiMS), Research Track (RT), Research Fair Cologne (RFC)) are described here. Results were recorded at various levels: Likert Scale evaluation of the event's elements were collected as satisfaction parameters from the studentsProcess data on participation in the voluntary events were collected and evaluated as absolute and relational figures (WS 12/13-SS 17). Data on the outcome of the RaMS program were collected: Type of scientific projects in the academic years 2011/12-2014/15), number and type of available projects offered at the RFC (in the years 2011-18) and number of student research funding applications in a comparison of the periods 2010-13 vs. 2014-17). Results: The students' acceptance of mandatory and paracurricular courses of the RaMS program is pleasingly high, which is not surprising, at least in the case of the voluntary courses. The participation of students in RiMS, RT and RFC is satisfactory for voluntary courses. In the case of the RT, with certified participation of approximately 47% of all registrations (corresponding to 10% of the total cohort), this is comparable to similar programs. It can be shown that the number of experimental science projects has more than doubled over time in parallel with the development of RaMS. The average number of provided projects according to the RFC is 42 (which corresponds to a placement rate of approx. 1:4). The number of successful student applications for a research support grant during the period the measures were implemented has doubled. Discussion and conclusion: The RaMS program shows a route for the implementation of the SP required by the next licensing regulations in medical education, which was initially supported and expanded solitarily, later by further elements (RiMS), also in the sense of a science-based career development (RT, RFC). The student acceptance and the measured success, in the form of successful participation in the Research Track, increased choice of experimental projects, significant increase of submitted as well as approved research grants and the high project placement rate of the Research Fair, encourage the further development of the program, which is indicated in the conclusion.
Collapse
Affiliation(s)
- Sören Moritz
- University of Cologne, Medical Faculty, Vice Dean's Office for Research, Cologne, Germany
- University of Cologne, Medical Faculty, Vice Dean's Office for Teaching and Studies, Cologne, Germany
| | - Abdul Halawi
- University of Cologne, Medical Faculty, Vice Dean's Office for Research, Cologne, Germany
- University of Cologne, Medical Faculty, Vice Dean's Office for Teaching and Studies, Cologne, Germany
| | - Charlotte Proksch
- University of Cologne, Medical Faculty, Vice Dean's Office for Research, Cologne, Germany
- University of Cologne, Medical Faculty, Vice Dean's Office for Teaching and Studies, Cologne, Germany
| | - Jan-Michael Werner
- University of Cologne, Medical Faculty, Medical Student Council, Cologne, Germany
| | - Mats Paulsson
- University of Cologne, Medical Faculty, Medical Student Council, Cologne, Germany
| | - Markus Rothschild
- University of Cologne, Medical Faculty, Vice Dean's Office for Teaching and Studies, Cologne, Germany
| | - Christoph Stosch
- University of Cologne, Medical Faculty, Vice Dean's Office for Teaching and Studies, Cologne, Germany
| |
Collapse
|
3
|
Stone C, Dogbey GY, Klenzak S, Van Fossen K, Tan B, Brannan GD. Contemporary global perspectives of medical students on research during undergraduate medical education: a systematic literature review. MEDICAL EDUCATION ONLINE 2018; 23:1537430. [PMID: 30372403 PMCID: PMC6211259 DOI: 10.1080/10872981.2018.1537430] [Citation(s) in RCA: 39] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/28/2018] [Revised: 07/23/2018] [Accepted: 10/12/2018] [Indexed: 06/02/2023]
Abstract
BACKGROUND The need for increased expertise in evidence-based medicine and concerns about the decreasing numbers of physician-scientists have underscored the need for promoting and encouraging research in medical education. The critical shortage of physician-scientists has assumed a dimension demanding a coordinated global response. This systematic review examined the perceptions of medical students regarding research during undergraduate medical school from a global perspective. METHODS Articles for this review were searched using PubMed, SCOPUS and Cochrane. Studies published within the last 10 years of the start date of the study that met specified criteria were included. Identified articles were initially screened by title as well as keywords and their abstracts were further screened to determine relevance. Full-text of screened articles were read for validation prior to inclusion. RESULTS A total of 26 articles from the literature met the set criteria for final inclusion. Contents of the abstracts and corresponding full-text articles were analyzed for themes on the research perspectives of medical students. The themes derived comprised: research interest, physician-scientist decline and shortage, responses to physician-scientist shortage, curriculum issues, skills (motivation and self-efficacy), research needs, socioeconomic and cultural issues, and barriers. CONCLUSION Despite the wide variations in medical education systems worldwide, the perspectives of medical students on research in undergraduate medical education shared many common themes. Globally, medical students underscored the necessity and importance of research in medical education as reflected by many students reporting positive attitudes and interest in research endeavors. Moreover, a worldwide consensus emerged regarding the decline in the numbers of physician-scientists and the necessity for a reversal of that trend. Various barriers to research engagement and participation were highlighted.
Collapse
Affiliation(s)
- C. Stone
- School of Osteopathic Medicine, Campbell University, Lillington, NC, USA
| | - G. Y. Dogbey
- School of Osteopathic Medicine, Campbell University, Lillington, NC, USA
| | - S. Klenzak
- Graduate Medical Education Department, Cape Fear Valley Health System, Fayetteville, NC, USA
| | - K. Van Fossen
- Graduate Medical Education Department, Cape Fear Valley Health System, Fayetteville, NC, USA
| | - B. Tan
- School of Osteopathic Medicine, Campbell University, Lillington, NC, USA
| | - G. D. Brannan
- School of Osteopathic Medicine, Campbell University, Lillington, NC, USA
| |
Collapse
|
4
|
Nicolai L, Gradel M, Antón S, Pander T, Kalb A, Köhler L, Fischer MR, Dimitriadis K, von der Borch P. The Doktabörse - an innovative online platform for research projects at the medical faculty of the LMU Munich. GMS JOURNAL FOR MEDICAL EDUCATION 2017; 34:Doc30. [PMID: 28890921 PMCID: PMC5569987 DOI: 10.3205/zma001107] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Subscribe] [Scholar Register] [Received: 04/16/2017] [Revised: 05/17/2017] [Accepted: 06/20/2017] [Indexed: 05/26/2023]
Abstract
Introduction: One of the most important extracurricular aspects of medical studies in Germany is a research thesis completed by most students. This research project often times conveys relevant competencies for the physician's role as scientist. Nevertheless, the choice of the right project remains a challenge. Reasons for this are among others, missing structures for a comprehensive overview of research groups and their respective projects. Description of the project: We developed the online platform Doktabörse as an online marketplace for doctoral research projects. The platform enables authorized researchers to create working groups and upload, deactivate and change research projects within their institute. For interested students, a front end with integrated search function displays these projects in a structured and well-arranged way. In parallel, the Doktabörse provides for a comprehensive overview of research at the medical faculty. We evaluated Researchers' and students' use of the platform. Results: 96,6% of students participating in the evaluation (n=400) were in favor of a centralized research platform at the medical faculty. The platform grew at a steady pace and included 120 research groups in June 2016. The students appreciated the structure and design of the Doktabörse. Two thirds of all uploaded projects matched successfully with doctoral students via the platform and over 94% of researchers stated that they did not need technical assistance with uploading projects and handling the platform. Discussion: The Doktabörse represents an innovative and well accepted platform for doctoral research projects. The platform is perceived positively by researchers and students alike. However, students criticized limited extent and timeliness of offered projects. In addition, the platform serves as databank of research at the medical faculty of the LMU Munich. The future potential of this platform is to provide for an integrated management solution of doctoral thesis projects, possibly beyond the medical field and faculty.
Collapse
Affiliation(s)
- Leo Nicolai
- Klinikum der LMU München, Institut für Didaktik und Ausbildungsforschung in der Medizin, München, Germany
| | - Maximilian Gradel
- Klinikum der LMU München, Institut für Didaktik und Ausbildungsforschung in der Medizin, München, Germany
| | - Sofia Antón
- Klinikum der LMU München, Institut für Didaktik und Ausbildungsforschung in der Medizin, München, Germany
| | - Tanja Pander
- Klinikum der LMU München, Institut für Didaktik und Ausbildungsforschung in der Medizin, München, Germany
| | - Anke Kalb
- Klinikum der LMU München, MeCuM-Mentor, München, Germany
| | - Lisa Köhler
- Klinikum der LMU München, MeCuM-Mentor, Doktamed, München, Germany
| | - Martin R. Fischer
- Klinikum der LMU München, Institut für Didaktik und Ausbildungsforschung in der Medizin, München, Germany
| | - Konstantinos Dimitriadis
- Klinikum der LMU München, Institut für Didaktik und Ausbildungsforschung in der Medizin, München, Germany
- LMU München, Neurologische Klinik und Poliklinik, München, Germany
| | - Philip von der Borch
- Klinikum der LMU München, Institut für Didaktik und Ausbildungsforschung in der Medizin, München, Germany
- Klinikum der LMU München, Medzinische Klinik und Poliklinik IV, München, Germany
| |
Collapse
|
5
|
Can E, Richter F, Valchanova R, Dewey M. Supervisors' perspective on medical thesis projects and dropout rates: survey among thesis supervisors at a large German university hospital. BMJ Open 2016; 6:e012726. [PMID: 27742631 PMCID: PMC5073490 DOI: 10.1136/bmjopen-2016-012726] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/03/2022] Open
Abstract
OBJECTIVES To identify underlying causes for failure of medical thesis projects and the constantly high drop-out rate in Germany from the supervisors' perspective and to compare the results with the students' perspective. SETTING Cross-sectional survey. Online questionnaire for survey of medical thesis supervisors among the staff of Charité-Universitätsmedizin Berlin, Germany. Published, earlier longitudinal survey among students for comparison. PARTICIPANTS 1069 thesis supervisors participated. DATA EXTRACTION AND SYNTHESIS Data are presented using descriptive statistics, and the χ2 test served to compare the results among supervisors with the earlier data from the longitudinal survey of doctoral students. PRIMARY AND SECONDARY OUTCOMES Not applicable. This survey is an observational study. RESULTS Of 3653 potential participants, 1069 (29.3%) supervising 3744 doctoral candidates participated in the study. Supervisors considered themselves to be highly motivated and to offer adequate supervision. On the other hand, 87% stated that they did not feel well prepared for thesis supervision. Supervisors gave lack of timeliness of doctoral students and personal differences (p=0.024 and p=0.001) as the main reasons for terminating thesis projects. Doctoral students predominantly mentioned methodological problems and difficult subjects as critical issues (p=0.001 and p<0.001). Specifically, students felt ill prepared for the statistical part of their research-49.5% stated that they never received statistical assistance, whereas 97% of supervisors claimed to help their students with statistical analysis. CONCLUSIONS The authors found that both thesis supervisors and medical students feel ill prepared for their roles in the process of a medical dissertation. Contradictory reasons for terminating medical thesis projects based on supervisors' and students' self-assessment suggest a lack of communication and true scientific collaboration between supervisors and doctoral students as the major underlying issue that requires resolution.
Collapse
Affiliation(s)
- Elif Can
- Charité Graduate Programme, Charité—Universitätsmedizin Berlin, Germany
| | - Felicitas Richter
- Department of Radiology, Charité—Universitätsmedizin Berlin, Germany
| | | | - Marc Dewey
- Charité Graduate Programme, Charité—Universitätsmedizin Berlin, Germany
- Department of Radiology, Charité—Universitätsmedizin Berlin, Germany
| |
Collapse
|