Introduction of blended learning in a master program: Developing an integrative mixed method evaluation framework

An MDRE approach to promoting students' learning performances in the era of the pandemic: A quasi-experimental design

Educators have indicated the need to foster students' ability to solve problems by acquiring up-to-date knowledge as well as promoting their competences for making decisions from diverse perspectives based on the acquired knowledge. Traditional courses mainly use lecture-based instruction without providing sufficient opportunities for students to practice and interact with the teacher; therefore, it is difficult to deliver such up-to-date knowledge via traditional instruction, not to mention fostering students' critical thinking. In this study, the Mobile technology-supported Decision, Reflection and Exercise (MDRE) model is proposed to address this problem. Moreover, a learning system is developed based on the proposed approach. To evaluate the effectiveness of the proposed approach, a quasi-experiment was conducted in a university with a two-group pretest posttest design to assess participants' learning achievement, critical thinking and learning satisfaction. The participants were two classes of undergraduate students. One class with 37 students was the experimental group learning with the MDRE learning approach, whereas the other class with 37 students was the control group learning with the conventional technology-based learning approach. Analysis of covariance was performed to evaluate the effect of the intervention on the target outcomes. It was found that the experimental group showed better learning achievement, critical thinking and learning satisfaction than the control group. This implies that the MDRE approach has good potential in helping learners think from diverse perspectives and promoting their learning performance and engagement, which is important in higher education aimed at fostering students' competence of acquiring up-to-date knowledge for solving problems.

Applying a mixed methods design for needs assessment of an international fellowship training program for Mongolian health professions

PURPOSE

Continuing professional development is essential for improving health care services, especially in developing countries. Most of the training programs in Mongolia were not based on a targeted needs assessment. Therefore, we aimed to apply a mixed methods design to assess the training needs of Mongolian health professions.

METHODS

We conducted a needs assessment using a convergent parallel mixed methods design in two steps. The survey and interview questions were developed to identify priority areas, targeted trainees, and effective training methods. A survey on 60 respondents, 15 individual interviews, and a focus group interview with 14 participants were conducted in the first step. In the second step, 12 representatives of key stakeholders were invited to a second focus group interview.

RESULTS

Current health policy areas, areas related to future national plans, and areas not currently receiving governmental or international support were suggested as the main priorities. The stakeholder suggested that trainees should be selected based on their professional experience and language level, as well as each hospital's needs. Building teams including various professions, such as nurses, technicians, and biomedical engineers, was recommended as a way to exchange ideas with each other and to build teamwork for future collaboration.

CONCLUSION

Medical training needs are dynamic and complex; therefore, a deep understanding of the context and setting is necessary. In this study, we assessed the targeted training needs of Mongolian health professions through a mixed methods design, which could be an effective way to conduct needs assessments for training programs.

Evaluation frameworks in health services: An integrative review of use, attributes and elements

AIMS AND OBJECTIVE

To synthesise the evidence on the use of evaluation frameworks by nurses and midwives in research designed to improve healthcare services and practice. A secondary aim was to identify the attributes and elements of evaluation frameworks.

BACKGROUND

Evaluation is an integral component of any initiative to improve outcomes or change clinical practice. Yet often an evaluation may not yield the information required to sustain or integrate an initiative into practice. Evaluation frameworks can support effective evaluations, but there is a lack of consensus regarding elements and attributes of frameworks that support use.

METHODS

We undertook an integrative review to synthesise the use of evaluation frameworks in practice guided by the Preferred Reporting Items for Systematic review and Meta-Analysis flow diagram and checklist 2009 (Supporting Information File 4). The protocol was registered with PROSPERO (CRD42018087033). A broad range of electronic databases were systematically searched using keywords.

FINDINGS

Twenty-five papers were included from a diverse range of clinical areas and across high-, middle- and low-income nations. Twenty of the research projects had used nine existing frameworks, and five had developed an evaluation specific to an initiative. Frameworks supported the processes of evaluation and made them more meaningful by simplifying a complex process (providing structure and guidance for the evaluation processes); identifying and including stakeholders; explaining reasons for outcomes; generating transferable lessons; and identifying the mechanisms driving or inhibiting change.

CONCLUSION

Nurses and midwives reported that frameworks were useful in undertaking evaluations. Each framework had positive attributes and missing or confusing elements. When undertaking an evaluation, it is pertinent to review the elements and attributes of a framework to ensure it includes evaluation measures that are relevant to specific projects.

RELEVANCE TO CLINICAL PRACTICE

Nurses are actively involved in evaluation of clinical practice. This review identifies important elements to consider when choosing a framework for evaluation.

A Web-Based Course on Public Health Principles in Disaster and Medical Humanitarian Response: Survey Among Students and Faculty

BACKGROUND

Web-based public health courses are becoming increasingly popular. "Public Health Principles in Disaster and Medical Humanitarian Response" is a unique Web-based course in Hong Kong. This course aimed to fill a public health training gap by reaching out to postgraduates who are unable to access face-to-face learning.

OBJECTIVE

The aim of this paper was to use a structured framework to objectively evaluate the effectiveness of a Web-based course according to Greenhalgh et al's quality framework and the Donabedian model to make recommendations for program improvement.

METHODS

An interim evaluation of the first cohort of students in 2014 was conducted according to the Donabedian model and a quality framework by Greenhalgh et al using objective and self-reported data.

RESULTS

Students who registered for the first cohort (n=1152) from June 16, 2014 to December 15, 2014 (6 months) were surveyed. Two tutors and the course director were interviewed. The Web-based course was effective in using technology to deliver suitable course materials and assessment and to enhance student communication, support, and learning. Of the total number of students registered, 59.00% (680/1152) were nonlocal, originating from 6 continents, and 72.50% (835/1152) possessed a bachelor's or postgraduate degree. The completion rate was 20.00% (230/1152). The chi-square test comparing students who completed the course with dropouts showed no significant difference in gender (P=.40), age (P=.98), occupation (P=.43), or qualification (P=.17). The cost (HK $272 per student) was lower than that of conducting a face-to-face course (HK $4000 per student).

CONCLUSIONS

The Web-based course was effective in using technology to deliver a suitable course and reaching an intended audience. It had a higher completion rate than other Web-based courses. However, sustainable sources of funding may be needed to maintain the free Web-based course.