1
|
Walden D, Rawls M, Santen SA, Feldman M, Vinnikova A, Dow A. Rapid Feedback: Assessing Pre-clinical Teaching in the Era of Online Learning. MEDICAL SCIENCE EDUCATOR 2022; 32:819-826. [PMID: 35729989 PMCID: PMC9198414 DOI: 10.1007/s40670-022-01573-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Accepted: 05/29/2022] [Indexed: 06/15/2023]
Abstract
INTRODUCTION Medical schools vary in their approach to providing feedback to faculty. The purpose of this study was to test the effects of rapid student feedback in a course utilizing novel virtual learning methods. METHODS Second-year medical students were supplied with an optional, short questionnaire at the end of each class session and asked to provide feedback within 48 h. At the close of each survey, results were emailed to faculty. After the course, students and faculty were asked to rate the effectiveness of this method. This study did not affect administration of the usual end-of-course summative evaluations. RESULTS Ninety-one percent of students who participated noted increased engagement in the feedback process, but only 18% on average chose to participate. Faculty rated rapid feedback as more actionable than summative feedback (67%), 50% rated it as more specific, and 42% rated it as more helpful. Some wrote that comments were too granular, and others noted a negative personal emotional response. CONCLUSION Rapid feedback engaged students, provided actionable feedback, and increased communication between students and instructors, suggesting that this approach added value. Care must be taken to reduce the student burden and support relational aspects of the process.
Collapse
Affiliation(s)
- Daniel Walden
- Virginia Commonwealth University School of Medicine, Richmond, VA USA
| | - Meagan Rawls
- Office of Assessment, Evaluation, and Scholarship, Virginia Commonwealth University School of Medicine, Richmond, VA USA
| | - Sally A. Santen
- Office of Assessment, Evaluation, and Scholarship, Virginia Commonwealth University School of Medicine, Richmond, VA USA
- University of Cincinnati College of Medicine, Cincinnati, USA
| | - Moshe Feldman
- Office of Assessment, Evaluation, and Scholarship, Virginia Commonwealth University School of Medicine, Richmond, VA USA
| | - Anna Vinnikova
- Department of Internal Medicine, Virginia Commonwealth University School of Medicine, Richmond, VA USA
| | - Alan Dow
- Department of Internal Medicine, Virginia Commonwealth University School of Medicine, Richmond, VA USA
| |
Collapse
|
2
|
Hwang JE, Kim NJ, Song M, Cui Y, Kim EJ, Park IA, Lee HI, Gong HJ, Kim SY. Individual class evaluation and effective teaching characteristics in integrated curricula. BMC MEDICAL EDUCATION 2017; 17:252. [PMID: 29233131 PMCID: PMC5728067 DOI: 10.1186/s12909-017-1097-7] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/07/2017] [Accepted: 12/06/2017] [Indexed: 06/07/2023]
Abstract
BACKGROUND In an integrated curriculum, multiple instructors take part in a course in the form of team teaching. Accordingly, medical schools strive to manage each course run by numerous instructors. As part of the curriculum management, course evaluation is conducted, but a single, retrospective course evaluation does not comprehensively capture student perception of classes by different instructors. This study aimed to demonstrate the need for individual class evaluation, and further to identify teaching characteristics that instructors need to keep in mind when preparing classes. METHODS From 2014 to 2015, students at one medical school left comments on evaluation forms after each class. Courses were also assessed after each course. Their comments were categorized by connotation (positive or negative) and by subject. Within each subject category, test scores were compared between positively and negatively mentioned classes. The Mann-Whitney U test was performed to test group differences in scores. The same method was applied to the course evaluation data. RESULTS Test results for course evaluation showed group difference only in the practice/participation category. However, test results for individual class evaluation showed group differences in six categories: difficulty, main points, attitude, media/contents, interest, and materials. That is, the test scores of classes positively mentioned in six domains were significantly higher than those of negatively mentioned classes. CONCLUSIONS It was proved that individual class evaluation is needed to manage multi-instructor courses in integrated curricula of medical schools. Based on the students' extensive feedback, we identified teaching characteristics statistically related to academic achievement. School authorities can utilize these findings to encourage instructors to develop effective teaching characteristics in class preparation.
Collapse
Affiliation(s)
- Jung Eun Hwang
- Department of Pathology, College of Medicine, The Catholic University of Korea, Seoul, Republic of Korea
| | - Na Jin Kim
- Master Center for Medical Education Support, College of Medicine, The Catholic University of Korea, 222 Banpo-daero, Seocho-gu, Seoul, 06591 Republic of Korea
| | - Meiying Song
- Department of Pathology, College of Medicine, The Catholic University of Korea, Seoul, Republic of Korea
| | - Yinji Cui
- Department of Pathology, College of Medicine, The Catholic University of Korea, Seoul, Republic of Korea
| | - Eun Ju Kim
- Master Center for Medical Education Support, College of Medicine, The Catholic University of Korea, 222 Banpo-daero, Seocho-gu, Seoul, 06591 Republic of Korea
| | - In Ae Park
- Master Center for Medical Education Support, College of Medicine, The Catholic University of Korea, 222 Banpo-daero, Seocho-gu, Seoul, 06591 Republic of Korea
| | - Hye In Lee
- Master Center for Medical Education Support, College of Medicine, The Catholic University of Korea, 222 Banpo-daero, Seocho-gu, Seoul, 06591 Republic of Korea
| | - Hye Jin Gong
- Master Center for Medical Education Support, College of Medicine, The Catholic University of Korea, 222 Banpo-daero, Seocho-gu, Seoul, 06591 Republic of Korea
| | - Su Young Kim
- Department of Pathology, College of Medicine, The Catholic University of Korea, Seoul, Republic of Korea
- Master Center for Medical Education Support, College of Medicine, The Catholic University of Korea, 222 Banpo-daero, Seocho-gu, Seoul, 06591 Republic of Korea
| |
Collapse
|
3
|
Turato ER, Machado AC, Silva DF, de Carvalho GM, Verderosi NR, de Souza TF. Research publications in the field of health: omission of hypotheses and presentation of common-sense conclusions. SAO PAULO MED J 2006; 124:228-33. [PMID: 17086306 DOI: 10.1590/s1516-31802006000400011] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/06/2006] [Accepted: 07/06/2006] [Indexed: 11/22/2022] Open
Abstract
CONTEXT AND OBJECTIVE Medical literature should consist of knowledge applicable to professional education; nevertheless, the profusion of articles in databases provokes disquiet among students. The authors considered the premise that scientific production in the field of health follows a mechanical description of phenomena without the clarity of motivating questions. The aim was to interpret material from expert reports, applied by medical students to analyze articles from renowned journals. DESIGN AND SETTING This research project was exploratory, searching for latent meanings regarding methodological problems in a sample of papers. It was performed in a Brazilian medical school. METHODS The sample was intentionally built, consisting of articles related to original research in the field of health, published over the previous five years. The results came from text content analysis, performed by a professor and his medical students. RESULTS (1) Failure to state a hypothesis is an equivocal practice: articles did not show clarity of hypothesis to demonstrate that their authors had epistemological knowledge of the methods chosen. (2) There is a certain belief that in normal scientific practice, hypotheses are unnecessary: studies without explicit hypotheses led to suppositions that they merely repeat dominant models. (3) Presentation of common sense as scientific conclusions: research brings together what would have mobilized the researchers initially. CONCLUSIONS Absence of formal hypotheses leaves scientific production vulnerable when put under epistemological discussion. Conclusions from scientific articles are often confounded with common-sense statements. Quantitative research is suggested, for studying the frequency of occurrence of these dubious methodological points.
Collapse
Affiliation(s)
- Egberto Ribeiro Turato
- Laboratory of Clinical-Qualitative Research, Faculty of Medical Sciences, Universidade Estadual de Campinas, Campinas, São Paulo, Brazil.
| | | | | | | | | | | |
Collapse
|
4
|
Beier-Holgersen R, van Diest R, Resti CV. Evaluation of training of trainers courses for Oromia (Ethiopia) health professional schools' tutors*. Int Nurs Rev 2004; 51:185-92. [PMID: 15285745 DOI: 10.1111/j.1466-7657.2004.00245.x] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
Abstract
BACKGROUND In Ethiopia training tutors in the health system are part of a major health programme. A previous study disclosed that tutors felt they lacked sufficient teaching skills. AIM The Teaching Methodology Course (TMC) described here was designed to correct these deficiencies. The aim of the study was firstly to evaluate the usefulness of questionnaires in terms of TMC quality control and secondly to evaluate whether the subcourses differed in terms of self-progress evaluation and course evaluation. CONTENT The TMC consists of eight subcourses and is evaluated according to a quality circle described previously. METHODS Two questionnaires were used as part of the TMC quality control, one to assess tutors' self-progress and the other to examine tutors' opinion about the course instructors' pre-defined teaching skills. RESULTS In the questionnaires a distinction was made between 'good' and 'bad' subcourses. Moreover, the quantitative evaluation of subcourses was in accord with the tutors' written qualitative comments. CONCLUSION The questionnaires can be used for TMC quality control in order to improve at least some subcourses.
Collapse
|