Concept and benefits of the Inverted Classroom method for a competency-based biochemistry course in the pre-clinical stage of a human medicine course of studies

Background: Medical students often have a problem recognising the relevance of basic science subjects for their later professional work in the pre-clinical stage of their studies. This can lead to a lower motivation to learn biochemical content and dissatisfaction in the courses amongst the students. Alternative teaching methods such as the Inverted Classroom (IC) method can address this deficiency. The goal of this study was: to analyse the motivation and satisfaction of the students in a biochemistry seminar through the use of the e-learning-based IC method, to investigate the acceptance against the IC teaching method in biochemistry, and to compare the learning success achieved using the IC approach with that of a traditional course. We also investigated how a biochemistry course in the pre-clinical stage of a human medicine course of studies can be successfully organised according to the IC method. Furthermore, we examined the benefits of the IC method over conventional teaching formats. Method: The IC method was implemented in accordance with the guidelines of the GMA committee "New Media" [30] in a biochemistry seminar for two student IC intervention groups with 42 students. A part of the factual knowledge from the on-site phase in the form of teaching videos together with self-learning control tasks were provided online before the seminar for both IC intervention groups. Exporting content to the self-learning phase creates new free time in the on-site phase, during which the content can be critically considered and processed and additional competency-based learning objectives can be taught. Identical biochemistry teaching content was taught in parallel control groups (14 student groups with n=299 students), but no material was handed out beforehand for a self-learning phase. These students only received the materials after the on-site phase. Motivation and satisfaction as well as the acceptance for the teaching methods were recorded by questionnaires, the acquisition of knowledge by MC exams. Results: On a Likert scale from 1 (strongly disagree) to 6 (strongly agree), the students in the IC intervention groups could be seen to be much more motivated (5.53) than students in the control group (4.01). Students in the IC intervention groups also recognised the relevance of the learning content much more clearly (5.44) than students in the control group (4.01). Furthermore, the IC group also observed that additional competencies were trained in addition to the biochemistry content. In addition, the IC intervention group award the event a school grade of 1.53, the traditional control group a grade of 2.96. The teaching videos were rated very positively by both groups with an average school grade of 1.3 in each case. A qualitative analysis showed that the motivation and a positive attitude of the lecturers played a decisive role in the successful implementation of the IC method. Discussion and conclusion: Pre-clinical students display a high acceptance of the e-learning-based IC method. Teaching communication competencies in a biochemistry seminar was also rated very positively by the students. The quality of the teaching video and the motivation of the lecturers were shown to be a critical parameter for the successful performance of the IC method. What's more, the IC method can contribute to implementing a competence orientation in medical studies.

Overview and current management of computerized adaptive testing in licensing/certification examinations

Computerized adaptive testing (CAT) has been implemented in high-stakes examinations such as the National Council Licensure Examination-Registered Nurses in the United States since 1994. Subsequently, the National Registry of Emergency Medical Technicians in the United States adopted CAT for certifying emergency medical technicians in 2007. This was done with the goal of introducing the implementation of CAT for medical health licensing examinations. Most implementations of CAT are based on item response theory, which hypothesizes that both the examinee and items have their own characteristics that do not change. There are 5 steps for implementing CAT: first, determining whether the CAT approach is feasible for a given testing program; second, establishing an item bank; third, pretesting, calibrating, and linking item parameters via statistical analysis; fourth, determining the specification for the final CAT related to the 5 components of the CAT algorithm; and finally, deploying the final CAT after specifying all the necessary components. The 5 components of the CAT algorithm are as follows: item bank, starting item, item selection rule, scoring procedure, and termination criterion. CAT management includes content balancing, item analysis, item scoring, standard setting, practice analysis, and item bank updates. Remaining issues include the cost of constructing CAT platforms and deploying the computer technology required to build an item bank. In conclusion, in order to ensure more accurate estimations of examinees' ability, CAT may be a good option for national licensing examinations. Measurement theory can support its implementation for high-stakes examinations.

Investigating Interrater Reliability in an Online RN-to-BSN Program: Disparate Conclusions

BACKGROUND

Interrater reliability of student-written assignments within a nursing education program is a desirable characteristic to ensure uniform quality of academic work. As online programs that advance RNs to baccalaureate-prepared nurses (i.e., RN-to-BSN programs) grow in popularity, the challenges of quality control increase.

METHOD

Grading data representing mean, median, mode, and range from 19 course sections in an online RN-to-BSN program were submitted. Data were analyzed for measures of central tendency with a query of interrater reliability.

RESULTS

The data indicate that instructors assess student performance at a uniformly high level.

CONCLUSION

The data lead to two disparate conclusions: student performance is high and is reliably assessed as such, or the online program suffers from grade inflation. Such disparate conclusions are uniquely endemic to any program that serves the RN-to-BSN population, typically high-performing students who have established prior mastery on licensure examinations. [J Nurs Educ. 2017;56(6):360-363.].

Evidence-Based Principles for Using Technology-Enhanced Learning in the Continuing Professional Development of Health Professionals

Increasingly, health professional training involves the use of educational technologies through what is broadly termed "Technology-Enhanced Learning" (TEL). TEL includes hardware, such as computers and mobile devices, and software, such as software applications (apps), learning management systems, and discussion boards. For many years, TEL has formed an integral part of health professional programs and is growing in acceptance, if not expectation, in postgraduate training and continuing education. TEL generally aims to be flexible, engaging, learner focused and interactive, and may involve collaboration and communication. It offers many benefits for learning and teaching, whether used on its own or in conjunction with face-to-face teaching through blended learning. The ubiquity of mobile devices in clinical settings means TEL is ideal for busy clinicians, both as learners and teachers. TEL enables participants to learn at a time and place that is convenient to them, so learners living in geographically dispersed locations can access standardized courses. To realize these potential benefits, we recommend that those developing TEL programs for health professionals take a systematic approach to planning, development, implementation, and evaluation. To that end, we propose 10 principles: clarify purpose and conduct a needs assessment; allocate adequate time and technology; incorporate proven approaches to improve learning; consider the need for a skills component; enable interaction between learners and with others; create different resources for different groups; pilot before implementing; incorporate measures to retain learners; provide opportunities for revision to aid retention; and evaluate learning outcomes, not just satisfaction.

A holistic model for evaluating the impact of individual technology-enhanced learning resources

BACKGROUND

The use of technology within education has now crossed the Rubicon; student expectations, the increasing availability of both hardware and software and the push to fully blended learning environments mean that educational institutions cannot afford to turn their backs on technology-enhanced learning (TEL). The ability to meaningfully evaluate the impact of TEL resources nevertheless remains problematic.

AIMS

This paper aims to establish a robust means of evaluating individual resources and meaningfully measure their impact upon learning within the context of the program in which they are used.

METHODS

Based upon the experience of developing and evaluating a range of mobile and desktop based TEL resources, this paper outlines a new four-stage evaluation process, taking into account learner satisfaction, learner gain, and the impact of a resource on both the individual and the institution in which it has been adapted.

RESULTS

A new multi-level model of TEL resource evaluation is proposed, which includes a preliminary evaluation of need, learner satisfaction and gain, learner impact and institutional impact. Each of these levels are discussed in detail, and in relation to existing TEL evaluation frameworks.

CONCLUSIONS

This paper details a holistic, meaningful evaluation model for individual TEL resources within the specific context in which they are used. It is proposed that this model is adopted to ensure that TEL resources are evaluated in a more meaningful and robust manner than is currently undertaken.

Genetics and Type 1 Diabetes: Online Resources for Patients

PURPOSE

This Web-based review was undertaken to compile online resources for diabetes educators on genetics--specifically, the genetics of type 1 diabetes--and to provide helpful and accurate information for the public.

METHODS

Keyword searches were performed to identify Web sites for genetics education for the lay public and for sites specifically geared toward children/young adults. Web sites were critiqued based on credibility (source, currency, relevance/utility), content (accuracy), and design (accessibility, logical organization). Additional keyword searches were conducted to find sites describing the genetics of type 1 diabetes, which were evaluated for content validity.

RESULTS

The Web sites selected for general genetics education contain accessible, credible, and accurate information about basic genetics in an easy-to-follow format with both text and visual aides. Although these sites adequately educate the public about genetics, only diabetes-specific Web sites discussed the relationship between genetics and risk for type 1 diabetes associated with high-risk HLA alleles.

CONCLUSIONS

In this genomic age, it is important for healthcare professionals to provide genetics information. Educational tools that specifically address the genetics of type 1 diabetes are urgently needed to fill the current information gaps on the Internet.

Quality specifications in postgraduate medical e-learning: an integrative literature review leading to a postgraduate medical e-learning model

BACKGROUND

E-learning is driving major shifts in medical education. Prioritizing learning theories and quality models improves the success of e-learning programs. Although many e-learning quality standards are available, few are focused on postgraduate medical education.

METHODS

We conducted an integrative review of the current postgraduate medical e-learning literature to identify quality specifications. The literature was thematically organized into a working model.

RESULTS

Unique quality specifications (n = 72) were consolidated and re-organized into a six-domain model that we called the Postgraduate Medical E-learning Model (Postgraduate ME Model). This model was partially based on the ISO-19796 standard, and drew on cognitive load multimedia principles. The domains of the model are preparation, software design and system specifications, communication, content, assessment, and maintenance.

CONCLUSION

This review clarified the current state of postgraduate medical e-learning standards and specifications. It also synthesized these specifications into a single working model. To validate our findings, the next-steps include testing the Postgraduate ME Model in controlled e-learning settings.

Physiotherapy students' perspectives of online e-learning for interdisciplinary management of chronic health conditions: a qualitative study

BACKGROUND

To qualitatively explore physiotherapy students' perceptions of online e-learning for chronic disease management using a previously developed, innovative and interactive, evidence-based, e-learning package: Rheumatoid Arthritis for Physiotherapists e-Learning (RAP-eL).

METHODS

Physiotherapy students participated in three focus groups in Perth, Western Australia. Purposive sampling was employed to ensure maximum heterogeneity across age, gender and educational background. To explore students' perspectives on the advantages and disadvantages of online e-learning, ways to enhance e-learning, and information/learning gaps in relation to interdisciplinary management of chronic health conditions, a semi-structured interview schedule was developed. Verbatim transcripts were analysed using inductive methods within a grounded theory approach to derive key themes.

RESULTS

Twenty-three students (78 % female; 39 % with previous tertiary qualification) of mean (SD) age 23 (3.6) years participated. Students expressed a preference for a combination of both online e-learning and lecture-style learning formats for chronic disease management, citing flexibility to work at one's own pace and time, and access to comprehensive information as advantages of e-learning learning. Personal interaction and ability to clarify information immediately were considered advantages of lecture-style formats. Perceived knowledge gaps included practical application of interdisciplinary approaches to chronic disease management and developing and implementing physiotherapy management plans for people with chronic health conditions.

CONCLUSIONS

Physiotherapy students preferred multi-modal and blended formats for learning about chronic disease management. This study highlights the need for further development of practically-oriented knowledge and skills related to interdisciplinary care for people with chronic conditions among physiotherapy students. While RAP-eL focuses on rheumatoid arthritis, the principles of learning apply to the broader context of chronic disease management.

Viability of a Web-Based Module for Teaching Electrocardiogram Reading Skills to Psychiatry Residents: Learning Outcomes and Trainee Interest

OBJECTIVE

Web-based instruction in post-graduate psychiatry training has shown comparable effectiveness to in-person instruction, but few topics have been addressed in this format. This study sought to evaluate the viability of a web-based curriculum in teaching electrocardiogram (EKG) reading skills to psychiatry residents. Interest in receiving educational materials in this format was also assessed.

METHODS

A web-based curriculum of 41 slides, including eight pre-test and eight post-test questions with emphasis on cardiac complications of psychotropic medications, was made available to all psychiatry residents via email.

RESULTS

Out of 57 residents, 30 initiated and 22 completed the module. Mean improvement from pre-test to post-test was 25 %, and all 22 completing participants indicated interest in future web-based instruction.

CONCLUSIONS

This pilot study suggests that web-based instruction is feasible and under-utilized as a means of teaching psychiatry residents. Potential uses of web-based instruction, such as tracking learning outcomes or patient care longitudinally, are also discussed.

Performance of undergraduate dental students on ICDAS clinical caries detection after different learning strategies

AIM

This study aimed to evaluate the effect of a digital learning tool on undergraduate dental students' performance in detecting dental caries using ICDAS.

METHODS

An experimental digital learning tool (DLT) was created using digital photographs of sound and carious teeth. Thirty-nine students were divided into three groups (n = 13) and each assessed 12 randomly allocated patients before and after learning strategies: G1, ICDAS e-learning program; G2, ICDAS e-learning program plus DLT; G3, no learning strategy. Students (n = 32) reassessed patients 2 weeks after training.

RESULTS

Comparing before and after the learning strategies, any difference in the values of specificity and area under the ROC curve for all groups was found. Sensitivity was statistically significantly higher for G1 and G2. Comparing the groups, G2 showed a significant increase in sensitivity at the D2 and D3 thresholds. Spearman's correlations with the gold standard before and after the learning strategy were 0.60 and 0.61 for G1, 0.57 and 0.63 for G2, and 0.54 and 0.54 for G3, respectively. The Wilcoxon test showed a statistically significant difference between the values obtained before and after learning strategies for G1 and G2.

CONCLUSIONS

Use of the DLT after the ICDAS e-learning program tended to increase the sensitivity of ICDAS used by undergraduate dental students. The DLT appeared to improve dental students' ability to use ICDAS.

Electronic learning in advanced resuscitation training: The perspective of the candidate

BACKGROUND

Studies have shown that blended approaches combining e-learning with face-to-face training reduces costs whilst maintaining similar learning outcomes. The preferences in learning approach for healthcare providers to this new style of learning have not been comprehensively studied. The aim of this study is to evaluate the acceptability of blended learning to advanced resuscitation training.

METHODS

Participants taking part in the traditional and blended electronic advanced life support (e-ALS) courses were invited to complete a written evaluation of the course. Participants' views were captured on a 6-point Likert scale and in free text written comments covering the content, delivery and organisation of the course. Proportional-odds cumulative logit models were used to compare quantitative responses. Thematic analysis was used to synthesise qualitative feedback.

RESULTS

2848 participants from 31 course centres took part in the study (2008-2010). Candidates consistently scored content delivered face-to-face over the same content delivered over the e-learning platform. Candidates valued practical hands on training which included simulation highly. Within the e-ALS group, a common theme was a feeling of "time pressure" and they "preferred the face-to-face teaching". However, others felt that e-ALS "suited their learning style", was "good for those recertifying", and allowed candidates to "use the learning materials at their own pace".

CONCLUSIONS

The e-ALS course was well received by most, but not all participants. The majority felt the e-learning module was beneficial. There was universal agreement that the face-to-face training was invaluable. Individual learning styles of the candidates affected their reaction to the course materials.

Accuracy and readability of cardiovascular entries on Wikipedia: are they reliable learning resources for medical students?

OBJECTIVE

To evaluate accuracy of content and readability level of English Wikipedia articles on cardiovascular diseases, using quality and readability tools.

METHODS

Wikipedia was searched on the 6 October 2013 for articles on cardiovascular diseases. Using a modified DISCERN (DISCERN is an instrument widely used in assessing online resources), articles were independently scored by three assessors. The readability was calculated using Flesch-Kincaid Grade Level. The inter-rater agreement between evaluators was calculated using the Fleiss κ scale.

RESULTS

This study was based on 47 English Wikipedia entries on cardiovascular diseases. The DISCERN scores had a median=33 (IQR=6). Four articles (8.5%) were of good quality (DISCERN score 40-50), 39 (83%) moderate (DISCERN 30-39) and 4 (8.5%) were poor (DISCERN 10-29). Although the entries covered the aetiology and the clinical picture, there were deficiencies in the pathophysiology of diseases, signs and symptoms, diagnostic approaches and treatment. The number of references varied from 1 to 127 references; 25.9±29.4 (mean±SD). Several problems were identified in the list of references and citations made in the articles. The readability of articles was 14.3±1.7 (mean±SD); consistent with the readability level for college students. In comparison, Harrison's Principles of Internal Medicine 18th edition had more tables, less references and no significant difference in number of graphs, images, illustrations or readability level. The overall agreement between the evaluators was good (Fleiss κ 0.718 (95% CI 0.57 to 0.83).

CONCLUSIONS

The Wikipedia entries are not aimed at a medical audience and should not be used as a substitute to recommended medical resources. Course designers and students should be aware that Wikipedia entries on cardiovascular diseases lack accuracy, predominantly due to errors of omission. Further improvement of the Wikipedia content of cardiovascular entries would be needed before they could be considered a supplementary resource.

Online technology use in physiotherapy teaching and learning: a systematic review of effectiveness and users' perceptions

BACKGROUND

The use of online technologies in health professionals' education, including physiotherapy, has been advocated as effective and well-accepted tools for enhancing student learning. The aim of this study was to critically review the effectiveness, and user perceptions of online technology for physiotherapy teaching and learning.

METHODS

Following databases were systematically searched on the 31(st) of August 2013 for articles describing implementation of online technologies into physiotherapy teaching and learning: ERIC, CINAHL, Web of Science, Academic search complete, ProQuest Nursing and Allied Health Source, Medline, Embase, and Scopus. No language, design or publishing date restrictions were imposed. Risk of bias was assessed using the 2011 Mixed Methods Appraisal Tool checklist (MMAT).

RESULTS

A total of 4133 articles were retrieved; 22 articles met the inclusion criteria and were accepted for final analysis: 15 on the effectiveness of technology, and 14 on users' perceptions. Included studies used three designs: case study (14 articles), controlled trial (3), and randomized controlled trial (5). Studies investigated both pre-registration physiotherapy students (1523) and physiotherapy professionals (171). The quality of studies ranged from 67 to 100 % on the MMAT checklist which can be considered moderate to excellent. More than half of the studies (68 %) received scores greater than 80 %. Studies typically investigated websites and discussion boards. The websites are effective in enhancing practical skills performance, and discussion boards in knowledge acquisition, as well as in development of critical and reflective thinking. Students' perceptions of the use of websites were mostly positive, providing students with entertaining, easy accessible resources. Perceived barriers to the use of websites included difficulties with internet connection, insufficiently interactive material, or personal preference for paper-based materials. Discussion boards were perceived as deepening students' thinking and facilitating reflection, allowing for learning from multiple perspectives, and providing easy communication and support.

CONCLUSIONS

The results of this review suggest that online technologies (i.e., websites and discussion boards) have many benefits to offer for physiotherapy teaching and learning; There was minimal evidence of barriers for the use of online technologies, however, addressing the identified ones could enhance adherence to use of online technologies in health professionals' education.

Improving consistency in large laboratory courses: a design for a standardized practical exam

Laboratory courses serve as important gateways to science, technology, engineering, and mathematics education. One of the challenges in assessing laboratory learning is to conduct meaningful and standardized practical exams, especially for large multisection laboratory courses. Laboratory practical exams in life sciences courses are frequently administered by asking students to move from station to station to answer questions, apply knowledge gained during laboratory experiments, interpret data, and identify various tissues and organs using various microscopic and gross specimens. This approach puts a stringent time limit on all questions regardless of the level of difficulty and also invariably increases the potential risk of cheating. To avoid potential cheating in laboratory courses with multiple sections, the setup for practical exams is often changed in some way between sections. In laboratory courses with multiple instructors or teaching assistants, practical exams may be handled inconsistently among different laboratory sections, due to differences in background knowledge, perceptions of the laboratory goals, or prior teaching experience. In this article, we describe a design for a laboratory practical exam that aims to align the assessment questions with well-defined laboratory learning objectives and improve the consistency among all laboratory sections.

Twelve tips for improving the effectiveness of web-based multimedia instruction for clinical learners

Using educational technology does not necessarily make medical education more effective. There are many different kinds of technology available to the contemporary medical teacher and what constitutes effective use may depend on the technology, the learning situation and many other factors. Web-based multimedia instruction (WBMI) provides learners with self-directed independent learning opportunities based on didactic material enhanced with multimedia features such as video and animations. WBMI may be used to replace other didactic events (e.g. lectures) or it may be provided in addition to other learning opportunities. Clinical educators looking to use WBMI need to make sure that it will meet both their learners' needs and the program's needs, and it has to align to the contexts in which it is used. The following 12 tips have been developed to help guide faculty through some of the key features of the effective use of WBMI in clinical teaching programs. These tips are based on more than a decade developing, using and appraising WBMI in support of surgical clerkship education across the USA and beyond and they are intended both to inform individual uses of WBMI in clinical training and to guide the strategic use of WBMI in clinical clerkship curricula.

Cost-effectiveness of electronic training in domestic violence risk assessment: ODARA 101

The need for domestic violence training has increased with the development of evidence-based risk assessment tools, which must be scored correctly for valid application. Emerging research indicates that training in domestic violence risk assessment can increase scoring accuracy, but despite the increasing popularity of electronic training, it is not yet known whether it can be an effective method of risk assessment training. In the present study, 87 assessors from various professions had training in the Ontario Domestic Assault Risk Assessment either face-to-face or using an electronic training program. The two conditions were equally effective, as measured by performance on a post-training skill acquisition test. Completion rates were 100% for face-to-face and 86% for electronic training, an improvement over a previously evaluated manual-only condition. The estimated per-trainee cost of electronic training was one third that of face-to-face training and expected to decrease. More rigorous evaluations of electronic training for risk assessment are recommended.

Evaluating technology-enhanced learning: A comprehensive framework

BACKGROUND

The absence of a standard, comprehensive approach to evaluating technology-enhanced learning (TEL) limits the utility of individual evaluations, and impedes the integration and synthesis of results across studies.

PURPOSE

To outline a comprehensive framework for approaching TEL evaluation in medical education, and to develop instruments for measuring the perceptions of TEL learners and instructors.

METHODS AND RESULTS

Using both theoretical constructs of inquiry in education and a synthesis of existing models and instruments, we outlined a general model for evaluation that links utility, principles, and practices. From this we derived a framework for TEL evaluation that identifies seven data collection activities: needs analysis; documentation of processes, decisions, and final product; usability testing; observation of implementation; assessment of participant experience; assessment of learning outcomes; and evaluation of cost, reusability, and sustainability. We then used existing quality standards and approaches to develop instruments for assessing the experiences of learners and instructors using TEL.

CONCLUSIONS

No single evaluation is likely to collect all of this information, nor would any single audience likely find all information elements equally useful. However, consistent use of a common evaluation framework across different courses and institutions would avoid duplication of effort and allow cross-course comparisons.

Effects of computer-based graphic organizers to solve one-step word problems for middle school students with mild intellectual disability: A preliminary study

The purpose of this study was to examine the effects of computer-based graphic organizers, using Kidspiration 3© software, to solve one-step word problems. Participants included three students with mild intellectual disability enrolled in a functional academic skills curriculum in a self-contained classroom. A multiple probe single-subject research design (Horner & Baer, 1978) was used to evaluate the effectiveness of computer-based graphic organizers to solving mathematical one-step word problems. During the baseline phase, the students completed a teacher-generated worksheet that consisted of nine functional word problems in a traditional format using a pencil, paper, and a calculator. In the intervention and maintenance phases, the students were instructed to complete the word problems using a computer-based graphic organizer. Results indicated that all three of the students improved in their ability to solve the one-step word problems using computer-based graphic organizers compared to traditional instructional practices. Limitations of the study and recommendations for future research directions are discussed.