Evaluation of an online Diabetes Needs Assessment Tool (DNAT) for health professionals: a randomised controlled trial

The effectiveness of internet-based e-learning on clinician behavior and patient outcomes: a systematic review protocol

REVIEW QUESTION/OBJECTIVE

The objective of this systematic review is to identify, appraise and synthesize the best available evidence for the effectiveness of internet-based e-learning programs on health care professional behavior and patient outcomes.

BACKGROUND

Technological innovation has not only impacted social change in recent years but has been the prime driver of educational transformation.The newest consumers of post-secondary education, the so-called 'digital natives', have come to expect education to be delivered in a way that offers increased usability and convenience. Health care professionals (HCPs) in the clinical setting, particularly those in rural and remote communities, are no different. Today's health workforce has a professional responsibility to maintain competency in practice through achieving a minimum number of hours of continuing professional development. Consequently, HCPs seeking professional development opportunities are reliant on sourcing these independently according to individual learning needs. However, difficulties exist in some health professionals' access to ongoing professional development opportunities, particularly those with limited access face-to-face educationdue to geographical isolation or for those not enrolled in a formal program of study.These issues challenge traditional methods of teaching delivery; electronic learning (e-learning) is at the nexus of overcoming these challenges.The term e-learning originated in the mid-1990s as the internet began to gather momentum.Electronic learning can be broadly defined as any type of educational media that is delivered in an electronic form.Terms such as computer-assisted learning, online learning, web-based learning and e-learning are often used synonymously but all reflect knowledge transfer via an electronic device. This broad definition allows for a gamut of multimedia to be used for the purpose of constructing and assessing knowledge. Multimedia typically used in e-learning range from the now archaic Compact Disc Read-Only Memory (CD-ROMs), to the simple Microsoft PowerPoint, or the more advanced and complex virtual worlds such a second life. Electronic learning can be delivered in asynchronous or synchronous formats, with the latter (for example interactive online lectures via platforms such as BlackboardCollaborate or WebEx) more commonly used in formal educational settings according to set timetables of study.Person-to-person interactivity is an important enabler of knowledge generation and while functionalities such as web 1.0 (discussion board and email) and more recently web 2.0 (Wikis and blogs) allow for this to occur both synchronously and asynchronously, it is usually utilized in formal educational contexts only. However, the economy of formal education does not allow for free access to courses which proves challenging for HCPs seeking quality educational opportunities who choose not to undergo a formal program of study or are just looking to meet a specific learning need. Alternatively, asynchronous e-learning is a more learner-centred approach that affords the opportunity to engage in learning at a time and location that is convenient and enables the learner to balance professional development with personal and work commitments.These learning opportunities are self-directed and do not require a human to facilitate learning, rather, technology officiates/facilitates the learning process and, in the asynchronous e-learning context, the learner negotiates meaning independently.Health-related e-learning research has focused on several domains including media comparative designs, self-efficacy, user satisfaction, instructional design, knowledge outcomes, clinical skills development, and facilitators/barriers to its use.The benefits of e-learning are well documented in terms of increased accessibility to education, efficacy, cost effectiveness, learner flexibility and interactivity.However, some fundamental methodological and philosophical flaws exist in e-learning research, not least the use of comparative design studies. Comparison between e-learning and traditional teaching methods are illogical and methodologically flawed because comparison groups are heterogeneous, lack uniformity and have multiple confounders that cannot be adjusted for.As early as 1994, researchersin computer-assisted learning were citing these limitations and called for a fresh research agenda in this area. Cookrepeated this call in 2005 and again in 2009 and noted a paucity of research related to patient or clinical practice outcomes. Electronic learning is not an educational panacea and research needs to progress from pre- and post-interventional and comparative designs that evaluate knowledge increases and user satisfaction. It is time to move towards determining whether improved self-efficacy or knowledge gained through e-learning improves patient outcomes or influences clinical behavior change and whether these changes are sustained. In order to develop the empirical evidence base in e-learning, research needs to be guided by established theoretical frameworks and use validated instruments to move from assessing knowledge generation towards improving our understanding of whether e-learning improves HCP behavior and more importantly, patient outcomes.One suitable framework that is congruent with e-learning research is Kirkpatrick'sfour levels of evaluation. Kirkpatrick's model is hierarchically based with level one relating to student reaction and how well the learner is satisfied with the education program. Level two pertains to learning and the evaluation of knowledge, level three expands on this and considers whether the education has influenced behavior. In the context of this review, behavior change is any practice that is intrinsically linked with the outcomes of the e-learning program undertaken. Finally, level four evaluates the impact on outcomes such as cost benefit or quality improvements.The majority of e-learning research has focused on participant experience and knowledge acquisition, outcomes that correspond with the first two levels of Kirkpatrick's model.To date, few studies have examined the effectiveness of internet-based e-learning programs on HCP behavior, which aligns with Level 3 of Kirkpatrick's model.Studies exist that use self-reported measures of intention to change behavior, however self-reported intention to change does not necessarily translate into actual behavior change. Studies that have not used self-reported measures of behavior change have used objectively measured evaluation criteria including objective structured assessment of technical skills (OSATS) using various methods including simulation task trainers and clinical simulations using standardized patients scored by a panel of experts using standardized assessment tools. Carney et al. used a national reporting and data system to measure the impact of a single one hour e-learning program undertaken by radiologists (n=31) aimed at reducing unnecessary recall during mammography screening. Carney et al. reported a null effect and attributed this to the complexities of behavior change, suggesting that longer term reinforcement of principles relating to mammography recall was required to effect behavior change. These findings also suggest that a multi-modal intervention may be required in order to reduce excessive recall rates in this area, rather than a single intervention. Contrary to Carney et al., Pape-Koehler et al. and Smeekins et al. reported positive findings using randomized controlled designs to test the efficacy of e-learning interventions on individual's surgical performance and the detection of child abuse, respectively. Pape-Koehler et al. used a 2x2 factorial design to demonstrate that an e-learning intervention significantly improved novice surgeon (n=70) surgical performance of a laparoscopic cholecystectomy (change between pre-post test OSATS p 0.001) when used in isolation or in combination with a practical training session compared to practical training alone. Smeekins et al. demonstrated that a 2 hour e-learning program improved nurses' (n=25) ability to detect child abuse in an emergency department. The nurses in the intervention (n=13) group demonstrated significantly better (p=0.022) questioning techniques and consequently, higher quality history taking, to determine children at risk of child abuse when compared with the control group who received no training at all.These three exemplar studies demonstrate the broad range of applications e-learning has in HCP education, as each study used different designs, had different subject areas and target health care professionals. This reflects the conceptual and practical challenges of the area of research that addresses levels three of Kirkpatrick's model. For this reason, the e-learning research agenda in health should focus on whether knowledge generated through e-learning is able to be re-contextualized into clinical practice, and influence sustained clinical behavior change and patient outcomes.A preliminary search of PubMed, CINAHL, The Cochrane Library, The JBI Database of Systematic Reviews and Implementation Reports, ERIC and PROSPERO was conducted to determine if a systematic review on the topic of interest already existed. This search identified four systematic reviews that specifically reviewed outcome measures of knowledge and skill improvement in the domain of e-learning. Two examined research conducted in nursing, with the other two in orthodontics. Lahti et al. systematic review examined the impact of e-learning on nurses' and nursing students' knowledge, skills and satisfaction. Lahti et al. were unable to demonstrate a statistical difference between cohorts undertaking e-learning compared to conventional teaching methods, findings that were not replicated by Du et al. This may be due to the decision by Lahti et al. (ABSTRACT TRUNCATED)

The effectiveness of Internet-based e-learning on clinician behaviour and patient outcomes: A systematic review

BACKGROUND

The contemporary health workforce has a professional responsibility to maintain competency in practice. However, some difficulties exist with access to ongoing professional development opportunities, particularly for staff in rural and remote areas and those not enrolled in a formal programme of study. E-learning is at the nexus of overcoming these challenges. The benefits of e-learning have been reported in terms of increased accessibility to education, improved self-efficacy, knowledge generation, cost effectiveness, learner flexibility and interactivity. What is less clear, is whether improved self-efficacy or knowledge gained through e-learning influences healthcare professional behaviour or skill development, whether these changes are sustained, and whether these changes improve patient outcomes.

OBJECTIVE

To identify, appraise and synthesise the best available evidence for the effectiveness of e-learning programmes on health care professional behaviour and patient outcomes.

DESIGN

A systematic review of randomised controlled trials was conducted to assess the effectiveness of e-learning programmes on clinician behaviour and patient outcomes. Electronic databases including CINAHL, Embase, ERIC, MEDLINE, Mosby's Index, Scopus and Cochrane - CENTRAL were searched in July 2014 and again in July 2015.

QUALITY ASSESSMENT AND DATA EXTRACTION

Studies were reviewed and data extracted by two independent reviewers using the Joanna Briggs Institute standardised critical appraisal and data extraction instruments.

DATA SYNTHESIS

Seven trials met the inclusion criteria for the analysis. Due to substantial instructional design, subject matter, study population, and methodological variation between the identified studies, statistical pooling was not possible and a meta-analysis could not be performed. Consequently, the findings of this systematic review are presented as a narrative review.

RESULTS

The results suggest that e-learning was at least as effective as traditional learning approaches, and superior to no instruction at all in improving health care professional behaviour. There was variation in behavioural outcomes depending on the skill being taught, and the learning approach utilised. No papers were identified that reported the effectiveness of an e-learning programme on patient outcomes.

CONCLUSION

This review found insufficient evidence regarding the effectiveness of e-learning on healthcare professional behaviour or patient outcomes, consequently further research in this area is warranted. Future randomised controlled trials should adhere to the CONSORT reporting guidelines in order to improve the quality of reporting, to allow evaluation of the effectiveness of e-learning programmes on healthcare professional behaviour and patient outcomes.

Patient-centred care, health behaviours and cardiovascular risk factor levels in people with recently diagnosed type 2 diabetes: 5-year follow-up of the ADDITION-Plus trial cohort

OBJECTIVE

To examine the association between the experience of patient-centred care (PCC), health behaviours and cardiovascular disease (CVD) risk factor levels among people with type 2 diabetes.

DESIGN

Population-based prospective cohort study.

SETTING

34 general practices in East Anglia, UK, delivering organised diabetes care.

PARTICIPANTS

478 patients recently diagnosed with type 2 diabetes aged between 40 and 69 years enrolled in the ADDITION-Plus trial.

MAIN OUTCOME MEASURES

Self-reported and objectively measured health behaviours (diet, physical activity, smoking status), CVD risk factor levels (blood pressure, lipid levels, glycated haemoglobin, body mass index, waist circumference) and modelled 10-year CVD risk.

RESULTS

Better experiences of PCC early in the course of living with diabetes were not associated with meaningful differences in self-reported physical activity levels including total activity energy expenditure (β-coefficient: 0.080 MET h/day (95% CI 0.017 to 0.143; p=0.01)), moderate-to-vigorous physical activity (β-coefficient: 5.328 min/day (95% CI 0.796 to 9.859; p=0.01)) and reduced sedentary time (β-coefficient: -1.633 min/day (95% CI -2.897 to -0.368; p=0.01)). PCC was not associated with clinically meaningful differences in levels of high-density lipoprotein cholesterol (β-coefficient: 0.002 mmol/L (95% CI 0.001 to 0.004; p=0.03)), systolic blood pressure (β-coefficient: -0.561 mm Hg (95% CI -0.653 to -0.468; p=0.01)) or diastolic blood pressure (β-coefficient: -0.565 mm Hg (95% CI -0.654 to -0.476; p=0.01)). Over an extended follow-up of 5 years, we observed no clear evidence that PCC was associated with self-reported, clinical or biochemical outcomes, except for waist circumference (β-coefficient: 0.085 cm (95% CI 0.015 to 0.155; p=0.02)).

CONCLUSIONS

We found little evidence that experience of PCC early in the course of diabetes was associated with clinically important changes in health-related behaviours or CVD risk factors.

TRIAL REGISTRATION NUMBER

ISRCTN99175498; Post-results.

Online Neonatal Training and Orientation Programme in India (ONTOP-IN)--the way forward for distance education in developing countries

BACKGROUND

Internet-based distance learning combined with local hands-on skill enhancement can provide high-quality standardized education to in-service healthcare professionals in a wide geographical area.

OBJECTIVE

Primary objective of this study was to evaluate the efficacy of internet-based distance learning in conjunction with local hands-on skill enhancement in improving knowledge and skills of essential newborn care among in-service nursing health professionals.

METHODS

A total of 98 participants from seven health facilities in India and Maldives were enrolled in the study. Delivery of course material staggered over 5 weeks in the form of two lessons every week was moderated by two to three online tutors at each site. Participants managed actual case scenarios, participated in discussion forums and synchronous chat sessions within a closed group. Skill learning was administered by local tutor at the partnering health facilities. Knowledge and skill enhancement were evaluated by administering online multiple-choice questions (MCQs) test and on-site objective structured clinical evaluation (OSCE) stations before and after completion of the course. Participants' satisfaction was evaluated on a five-point Likert scale.

RESULTS

Among 98 participants enrolled in the study, 78 (79%) completed the post-test assessment. There was significant increase in knowledge and skills scores (MCQ test: mean difference: 6.4 (95% CI: 5.6-7.17), OSCE: mean difference: 15.4 (95% CI: 12.7-18.1). All the participants expressed satisfaction with content and delivery of the learning module.

CONCLUSION

To conclude, online training and teaching in essential newborn care is feasible and acceptable for in-service nursing professionals and serves as a useful tool for professional development of their practical skills and knowledge.

Evaluation of an online interactive Diabetes Needs Assessment Tool (DNAT) versus online self-directed learning: a randomised controlled trial

BACKGROUND

Methods for the dissemination, understanding and implementation of clinical guidelines need to be examined for their effectiveness to help doctors integrate guidelines into practice. The objective of this randomised controlled trial was to evaluate the effectiveness of an interactive online Diabetes Needs Assessment Tool (DNAT) (which constructs an e-learning curriculum based on individually identified knowledge gaps), compared with self-directed e-learning of diabetes guidelines.

METHODS

Health professionals were randomised to a 4-month learning period and either given access to diabetes learning modules alone (control group) or DNAT plus learning modules (intervention group). Participants completed knowledge tests before and after learning (primary outcome), and surveys to assess the acceptability of the learning and changes to clinical practice (secondary outcomes).

RESULTS

Sixty four percent (677/1054) of participants completed both knowledge tests. The proportion of nurses (5.4%) was too small for meaningful analysis so they were excluded. For the 650 doctors completing both tests, mean (SD) knowledge scores increased from 47.4% (12.6) to 66.8% (11.5) [intervention group (n = 321, 64%)] and 47.3% (12.9) to 67.8% (10.8) [control group (n = 329, 66%)], (ANCOVA p = 0.186). Both groups were satisfied with the usability and usefulness of the learning materials. Seventy seven percent (218/284) of the intervention group reported combining the DNAT with the recommended reading materials was "very useful"/"useful". The majority in both groups (184/287, 64.1% intervention group and 206/299, 68.9% control group) [95% CI for the difference (-2.8 to 12.4)] reported integrating the learning into their clinical practice.

CONCLUSIONS

Both groups experienced a similar and significant improvement in knowledge. The learning materials were acceptable and participants incorporated the acquired knowledge into practice.

TRIAL REGISTRATION

ISRCTN: ISRCTN67215088.

International challenges without borders: a descriptive study of family physicians' educational needs in the field of diabetes

BACKGROUND

The optimal care of persons with diabetes by general practitioners and family physicians (GP/FP) is complex and requires multiple competencies. This is a fairly unrecognized key challenge in the healthcare systems. In some cases, local and national Continuous Professional Development (CPD) initiatives target these challenges; however there have been few international initiatives, possibly because challenges emerging from different studies have not been linked across national boundaries. In this context, the authors have compiled data about gaps and/or barriers inherent to GP/FP care of persons with type 2 diabetes from Austria, Canada, Germany and the United Kingdom.

METHODS

Secondary analyzes of pre-existing studies were conducted to identify challenges in the care of patients with type 2 diabetes as faced by GPs/FPs. Two sources of data were reviewed: unpublished research data from collaborating organizations and articles from a literature search (in English and German). Articles retrieved were scanned by the research team for relevance to the study objectives and to extract existing gaps and barriers. The identified challenges were then categorized along three major axes: (1) phase of the continuum of care {from screening to management}; (2) learning domain {knowledge, skills, attitudes, behavior, context}; and (3) by country/region. Compilation and categorization were performed by qualitative researchers and discrepancies were resolved through discussion until concordance was achieved.

RESULTS AND DISCUSSION

Thirteen challenges faced by GPs/FPs in the care for patients with type 2 diabetes were common in at least 3 of the 4 targeted countries/regions. These issues were found across the entire continuum of care and included: pathophysiology of diabetes, diagnostic criteria, treatment targets assessment, drugs' modes of action, decision-making in therapies, treatment guidelines, insulin therapy, adherence, management of complications, lifestyle changes, team integration, bureaucracy and third-party payers. The issues reported were not restricted to the physicians' knowledge, but also related to their skills, attitudes, behaviours and context.

CONCLUSIONS

This study revealed challenges faced by GPs/FPs when caring for patients with diabetes, which were similar across international and health system borders. Common issues might be addressed more efficiently through international educational designs, adapted to each country's healthcare system, helping develop and maintain physicians' competencies.