Completeness of the reporting of evidence-based practice educational interventions: a review

Developing multisectoral strategies to promote evidence-based practice in rehabilitation: findings from an end-of-grant knowledge translation symposium

PURPOSE

Following a longitudinal study to understand how evidence-based practice evolves during the initial years of occupational therapy (OT) and physiotherapy (PT) practice, we held an end-of-grant symposium with representatives from education, practice, research, and policy. The objectives were to: (1) elicit feedback on the implications of the study results; and (2) co-develop a list of actionable recommendations for each sector.

METHODS

Qualitative participatory approach. The symposium was held over two half days and consisted of a presentation of study findings, a discussion on the implications of the research for each sector and future recommendations. Discussions were audio recorded, transcribed verbatim and analyzed using qualitative thematic analysis.

RESULTS

The themes related to implications of the longitudinal study included: (1) A need to rethink what evidence-based practice (EBP) really is; (2) How to practice EBP; and (3) The continuing challenge of measuring EBP. The co-development of actionable recommendations resulted in nine strategies.

CONCLUSIONS

This study highlighted how we may collectively promote EBP competencies in future OTs and PTs. We generated sector-specific avenues that may be pursued to promote EBP and argued for the importance of pooling efforts from the four sectors so that we may achieve the intended ethos of EBP.IMPLICATIONS FOR REHABILITATIONThere is a need to revisit the definition of evidence-based practice (EBP) and the traditional 3-circle model in rehabilitation to include a broader conceptualization of what constitutes evidence.We recommend using EBP measures as tools for self-reflection and professional development that can support practitioners to be reflective and accountable evidence-based practitioners.Optimal promotion of EBP competencies in occupational therapists and physiotherapists should rest upon collaborative efforts from the education, practice, research, and policy sectors.

Assessing the educational quality of shared decision-making interventions for residents: A systematic review

OBJECTIVES

Many studies on educational interventions to enhance residents' shared decision-making (SDM) skills show limited improvement in SDM skills and clinical outcomes. One plausible explanation for these suboptimal results is the insufficient emphasis on the educational quality of training interventions.

METHODS

This review evaluates interventions' educational quality using an evaluation framework based on a previous study on effective skills transfer and a well-known SDM model. A systematic review was conducted, searching three databases until December 13, 2022. We assessed study quality by calculating MERSQI scores, examined the levels of study effects based on Kirkpatrick's model, and applied our evaluation framework to assess the interventions' educational quality. Given the heterogeneity among the studies, a meta-analysis was not feasible.

RESULTS

Twenty-six studies were included. Role-play and feedback were common training characteristics (65% and 54% of interventions). Only four studies (15%) met our framework's high educational quality threshold. No correlation was found between MERSQI scores and educational quality.

CONCLUSIONS

This review is a valuable attempt to assess the educational quality of SDM interventions beyond measuring study outcomes.

PRACTICE IMPLICATIONS

Future evaluation frameworks should consider study results, training characteristics, and training content. Our framework offers a sound basis for such an evaluation framework.

Completeness of intervention reporting of nutrition-focused weight management interventions adjunct to metabolic and bariatric surgery: effect of the TIDieR checklist

Nutrition-focused interventions are essential to optimize the bariatric care process and improve health and weight outcomes over time. Clear and detailed reporting of these interventions in research reports is crucial for understanding and applying the findings effectively in clinical practice and research replication. Given the importance of reporting transparency in research, this study aimed to use the Template for Intervention Description and Replication (TIDieR) checklist to evaluate the completeness of intervention reporting in nutritional weight management interventions adjunct to metabolic and bariatric surgery (MBS). The secondary aim was to examine the factors associated with better reporting. A literature search in PubMed, PsychINFO, EMBASE, Scopus, and the Cochrane Controlled Register of Trials was conducted to include randomized controlled trials (RCT), quasi-RCTs and parallel group trials. A total of 22 trials were included in the final analysis. Among the TIDieR 12 items, 6.6 ± 1.9 items were fully reported by all studies. None of the studies completely reported all intervention descriptors. The main areas where reporting required improvement were providing adequate details of the materials and procedures of the interventions, intervention personalization, and intervention modifications during the study. The quality of intervention reporting remained the same after vs. before the release of the TIDieR guidelines. Receiving funds from industrial organizations (p = 0.02) and having the study recorded within a registry platform (p = 0.08) were associated with better intervention reporting. Nutritional weight management interventions in MBS care are still below the desirable standards for reporting. The present study highlights the need to improve adequate reporting of such interventions, which would allow for greater replicability, evaluation through evidence synthesis studies, and transferability into clinical practice.

Educational strategies used in master's and doctoral nursing education: A scoping review

BACKGROUND

Advanced practice nurses and future nursing researchers must be adequately educated with the best available evidence. However, we know little about educational strategies and their characteristics used explicitly to educate advanced practice nurses and future researchers.

METHOD

A scoping review was used to map the latest educational strategies used in master's and doctoral nursing education between 2011 and 2021. Components of educational strategies were extracted based on the Guideline for Reporting Evidence-Based Practice Educational Interventions and Teaching and the Saskatchewan Education Department Framework of Professional Practice. The New World Kirkpatrick Model was used to categorize the associated learning outcomes. A narrative description approach was used to synthesize the findings.

RESULTS

A total of 56 studies were included. Several information was missing regarding the theoretical foundations of the educational strategies. A total of 158 educational strategies were identified. Individual work (e.g., homework) was the most popular educational strategy. Most studies assessed learning outcomes related to reactions (e.g., satisfaction) or learning (e.g., knowledge).

CONCLUSION

More studies should be done using interactive instruction or multimodal approaches, while the authors should better describe intervention components. A systematic review of effectiveness needs to be conducted to evaluate the best educational strategies in the master's and doctoral nursing education.

Development and Piloting of a Web-Based Tool to Teach Relative and Absolute Risk Reductions

Interpreting study results is an essential component of decision-making. Both laypeople and healthcare professionals often misinterpret treatment effects that are presented as relative risk reduction. Therefore, we developed and piloted a web-based tool to teach the difference between relative and absolute risk reductions. This project follows the UKMRC-guidance for complex interventions. The tool was developed based on adult learning and design theories. This was followed by a qualitative feasibility study focusing on acceptance, applicability, and comprehensibility with healthcare professionals and laypersons. We conducted think-aloud and semi-structured interviews and analysed them using qualitative content analysis. In addition, we explored calculation skills. Between January 2020 and April 2021, we conducted 22 interviews with 8 laypeople and 14 healthcare professionals from different settings. Overall, the tool proved to be feasible and relevant. With regard to comprehension, we observed an awareness of the interpretation of risk reduction, presented therapy effects were questioned more critically, and the influence of relative effects was recognized. Nevertheless, there were comprehension problems in some of the participants, especially with calculations in connection with low mathematical skills. The tool can be used to improve the interpretation of risk reductions in various target groups and to supplement existing educational programs.

Cognitive and Academic Outcomes of Fundamental Motor Skill and Physical Activity Interventions Designed for Children with Special Educational Needs: A Systematic Review

This systematic review aimed to investigate the methodological quality and the effects of fundamental motor skills and physical activity interventions on cognitive and academic skills in 3- to 7-year-old children with special educational needs. The review was reported in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA 2020) statement. A literature search was carried out in April 2020 (updated in January 2022) using seven electronic databases, including ERIC, Scopus, Web of Science, PsycINFO, CINAHL, PubMed, and SPORTDiscus. The methodological quality of the studies was assessed with Effective Public Health Practice Project (EPHPP) Quality Assessment Tool. Cohen’s d effect sizes and post-hoc power analyses were conducted for the included studies. Altogether 22 studies (1883 children) met the inclusion criteria, representing children at-risk for learning difficulties, due to family background (n_studies = 8), children with learning difficulties (n_studies = 7), learning disabilities (n_studies = 5), and physical disabilities (n_studies = 2). Two of the included 22 studies displayed strong, one moderate, and 19 studies weak methodological quality. The intervention effects appeared to be somewhat dependent on the severity of the learning difficulty; in cognitive and language skills, the effects were largest in children at-risk due to family background, whereas in executive functions the effects were largest in children with learning disabilities. However, due to the vast heterogeneity of the included studies, and a rather low methodological quality, it is challenging to summarize the findings in a generalizable manner. Thus, additional high-quality research is required to determine the effectiveness of the interventions.

Pragmatic evaluation of methods for retrieving unpublished information on comparator interventions in a systematic review of smoking cessation trials

OBJECTIVE

Reporting of the content and delivery characteristics of comparator interventions in published articles is often incomplete. This study examines the feasibility and validity of two methods for collecting additional information on comparator interventions from trial authors.

METHODS & MEASURES

In a systematic review of smoking cessation trials (IC-Smoke), all trial authors were asked to send unpublished comparator intervention materials and complete a specially-developed comparator intervention checklist. All published and additionally obtained information from authors were coded for behaviour change techniques (BCTs) and other characteristics (type of comparator, provider, provider training, delivery mode and treatment duration). To assess representativeness, we assessed the amount of additional information obtained from trial authors compared with the amount that was published. We examined known-group and convergent validity of comparator intervention data when using only published or also unpublished information.

RESULTS

Additional information were obtained from 91/136 (67%) of trial authors. Representativeness, known-group and convergent validity improved substantially based on the data collected by means of the comparator intervention checklist, but not by requesting authors to send any existing comparator materials.

CONCLUSIONS

Requesting authors for unpublished comparator intervention data, using specially-developed checklists and unpublished materials, substantially improves the quality of data available for systematic reviews.

Fatigue self-management education in persons with disease-related fatigue: A comprehensive review of the effectiveness on fatigue and quality of life

OBJECTIVES

To systematically synthesize the effectiveness of fatigue self-management education (SME) on fatigue and quality of life (QoL) in persons with disease-related fatigue, and to describe the intervention characteristics.

METHODS

We systematically reviewed the literature on SMEs in people with disease-related fatigue. We included randomized controlled trials (RCT), which aimed to improve self-management skills for fatigue in daily life. We synthesized the effectiveness and mapped the intervention characteristics.

RESULTS

We included 26 RCTs studying samples from eight disease groups. At follow-up, 46% studies reported statistically significant improvements on fatigue and 46% on QoL. For persons with cancer 6/8 and multiple sclerosis 8/10 RCTs showed positive evidence in favor of SME. The range of effect sizes was wide (d: 0.0 ->0.8). Delivery modalities (inpatient, outpatient, home), interactions (individual, group, remote), and duration [range (h): 1-17.5] varied.

CONCLUSIONS

The overall evidence on the effectiveness of SMEs on fatigue and QoL is limited and inconsistent. For persons with cancer and multiple sclerosis, the evidence provides a positive effect. The RCTs with medium to large effect on QoL indicate the potential benefit of SMEs.

PRACTICAL IMPLICATION

Duration and peer interaction should be considered when tailoring SMEs to populations and contexts.

From Evidence Synthesis to Transfer: Results from a Qualitative Case Study with the Perspectives of Participants

The increase in health research brings challenges to the production, synthesis, and use of research findings in clinical practice. In the case of undergraduate training in nursing, it is necessary to think about the curricular contents and create opportunities to develop skills for learning evidence-based practice. The objective of this study was to analyze nurses’ perspectives regarding the effects of their participation in a project of translation of knowledge into clinical practice during undergraduate nursing education, specifically involving knowledge, attitudes, and competencies related to the use of evidence. This is a qualitative case study grounded in the knowledge-to-action theoretical framework. The participants were 13 nurses who were involved in a project about the translation of knowledge into clinical practice during the last term of their undergraduate course. The data were collected by applying interviews between December 2020 and April 2021. Content analysis was carried out by using the qualitative data analysis software tool webQDA^®. The following categories emerged from the content analysis carried out on the material gathered during the interviews: understanding evidence; learning how to use evidence; transferring evidence; adjusting to the context; and observing the advantages of evidence-based practice. Extracurricular activities were perceived as an opportunity to understand what evidence is and observe in loco the advantages of health care for clients, teams, and services. During the project, the participants developed cross-sectional competencies and envisaged changes to their professional activity as a result of changes in their attitude regarding evidence and its use. We concluded that the opportunity to develop evidence-related activities allows for the development of skills and influences the attitude towards evidence-based practice and knowledge use.

Vitalizing the evaluation of curricular implementation: a framework for attending to the "how and whys" of curriculum evolution

As curricular reforms are implemented, there is often urgency among scholars to swiftly evaluate curricular outcomes and establish whether desired impacts have been realized. Consequently, many evaluative studies focus on summative program outcomes without accompanying evaluations of implementation. This runs the risk of Type III errors, whereby outcome evaluations rest on unverified assumptions about the appropriate implementation of prescribed curricular activities. Such errors challenge the usefulness of the evaluative studies, casting doubt on accumulated knowledge about curricular innovations, and posing problems for educational systems working to mobilize scarce resources. Unfortunately, however, there is long-standing inattention to the evaluation of implementation in health professions education (HPE). To address this, we propose an accessible framework that provides substantive guidance for evaluative research on implementation of curricular innovations. The Prescribed-Intended-Enacted-Sustainable (PIES) framework that is articulated in this paper, introduces new concepts to HPE-with a view to facilitating more nuanced examination of the evolution of curricula as they are implemented. Critically, the framework is theoretically grounded, integrating evaluation and implementation science as well as education theory. It outlines when, how, and why evaluators need to direct attention to curricular implementation, providing guidance on how programs can map out meaningful evaluative research agendas. Ultimately, this work is intended to support evaluators and educators, seeking to design evaluation studies that provide more faithful, useful representations of the intricacies of curricular change implementation.

The Development of Research Skills in Nursing Postgraduate Training

The objective of this study was to understand the contribution of postgraduate training to the development of research skills, aiming at their application in clinical practice. Method: This was a qualitative, exploratory, and descriptive study conducted with eight nurses in the Local Health Unit of Baixo Alentejo, in Portugal, who had postgraduate training. The researchers conducted a group interview, or discussion group, using a semi-structured interview, which was assessed by two reviewers. The data were submitted to content analysis, and the results underwent a validation process with the participants and two reviewers. This study was approved by the institution’s ethics committee. Result: In terms of the research skills developed in nursing postgraduate education, the following indicators emerged from the participants’ discourse: understanding the research process, searching databases, developing literature reviews, assessing the quality of articles, developing research projects, communicating about science, and translating knowledge into clinical practice. Conclusion: The participants developed research skills in their nursing postgraduate training and reported developing these skills in their clinical practice.

Effective online learning strategies for leadership and policy undergraduate courses for nursing students: a rapid review

OBJECTIVES

Due to the importance of developing leadership competencies during nursing education, it is critical to make evidence-based decisions regarding the transformation from face-to-face to online delivery of leadership and policy courses for nursing students in the wake of the COVID-19 pandemic. This rapid review aims to identify effective learning strategies for creating online leadership and policy courses for undergraduate nursing students.

DATA SOURCES AND REVIEW METHODS

A rapid review methodology was used. Searches in CINAHL and ERIC yielded 4112 records. After screening, seven articles were included. The Criteria for Describing and Evaluating Training Interventions in Healthcare Professions (CRe-DEPTH) tool was used for quality appraisal and data extraction. A narrative synthesis approach was used to summarize the data.

RESULTS

The learning activities were heterogeneous in terms of content and format. Articles described the use of discussion forums, case studies, virtual clinical learning experiences, microblogging, and video clips. The methods of evaluation for these learning activities also varied greatly.

CONCLUSION

The findings will act as a steppingstone to help develop an online undergraduate leadership and policy nursing course. This review also demonstrated the need for rigorous evaluation of learning activities. The use of a tool such as the CRe-DEPTH can help instructors plan and report on their learning interventions or courses.

Educational interventions to improve literature searching skills in the health sciences: a scoping review

Objective:

The authors reviewed educational interventions for improving literature searching skills in the health sciences.

Methods:

We performed a scoping review of experimental and quasi-experimental studies published in English and German, irrespective of publication year. Targeted outcomes were objectively measurable literature searching skills (e.g., quality of search strategy, study retrieval, precision). The search methods consisted of searching databases (CINAHL, Embase, MEDLINE, PsycINFO, Web of Science), tracking citations, free web searching, and contacting experts. Two reviewers performed screening and data extraction. To evaluate the completeness of reporting, the Template for Intervention Description and Replication (TIDieR) was applied.

Results:

We included 6 controlled trials and 8 pre-post trials from the 8,484 references that we screened. Study participants were students in various health professions and physicians. The educational formats of the interventions varied. Outcomes clustered into 2 categories: (1) developing search strategies (e.g., identifying search concepts, selecting databases, applying Boolean operators) and (2) database searching skills (e.g., searching PubMed, MEDLINE, or CINAHL). In addition to baseline and post-intervention measurement, 5 studies reported follow-up. Almost all studies adequately described their intervention procedures and delivery but did not provide access to the educational material. The expertise of the intervention facilitators was described in only 3 studies.

Conclusions:

The results showed a wide range of study populations, interventions, and outcomes. Studies often lacked information about educational material and facilitators' expertise. Further research should focus on intervention effectiveness using controlled study designs and long-term follow-up. To ensure transparency, replication, and comparability, studies should rigorously describe their intervention.

Library involvement in health informatics education for health professions students and practitioners: a scoping review

OBJECTIVE

The purpose of this scoping review is to evaluate the extent of library or librarian involvement in informatics education in the health domain.

METHODS

We searched eight databases from their inception to 2019 for reports of informatics educational activities for health professionals or health professions students that involved library staff or resources. Two reviewers independently screened all titles/abstracts (n=2,196) and resolved inclusion decisions by consensus. From the full text of the 36 papers that met the inclusion criteria, we extracted data on 41 educational activities.

RESULTS

The most frequent coded purposes of activities were "teaching clinical tools" (n=19, 46.3%) and "technology" (n=17; 41.5%). Medical students were the most frequent primary audience (34.1%), though 41.5% of activities had multiple audiences. Evaluation was reported for 24 activities (58.5%), only a few of which assessed short or post-activity impact on attitudes, knowledge, or skills. The most common long-term outcome was applying skills in other courses or clinical experiences. Thematic analysis yielded three areas of outcomes and issues for the library and organizational partners: expanded opportunities, technology and resource issues, and value demonstration.

CONCLUSIONS

Limited published examples of health informatics educational activities provide models for library roles in informatics education. More librarians should report on their informatics educational activities and provide sufficient details on the interventions and their evaluation. This would strengthen the evidence base about the potential impact of libraries within informatics education.

Underreporting of the active content of behavioural interventions: a systematic review and meta-analysis of randomised trials of smoking cessation interventions

Despite its importance, underreporting of the active content of experimental and comparator interventions in published literature has not been previously examined for behavioural trials. We assessed completeness and variability in reporting in 142 randomised controlled trials of behavioural interventions for smoking cessation published between 1/1996 and 11/2015. Two coders reliably identified the potential active components of experimental and comparator interventions (activities targeting behaviours key to smoking cessation and qualifying as behaviour change techniques, BCTs) in published, and in unpublished materials obtained from study authors directly. Unpublished materials were obtained for 129/204 (63%) experimental and 93/142 (65%) comparator groups. For those, only 35% (1200/3403) of experimental and 26% (491/1891) of comparator BCTs could be identified in published materials. Reporting quality (#published BCTs/#total BCTs) varied considerably between trials and between groups within trials. Experimental (vs. comparator) interventions were better reported (B(SE) = 0.34 (0.11), p < .001). Unpublished materials were more often obtained for recent studies (B(SE) = 0.093 (0.03), p = .003) published in behavioural (vs. medical) journals (B(SE) = 1.03 (0.41), p = .012). This high variability in underreporting of active content compromises reader's ability to interpret the effects of individual trials, compare and explain intervention effects in evidence syntheses, and estimate the additional benefit of an experimental intervention in other settings.

Impact of a videoconferencing educational programme for the management of concurrent disorders on nurses' competency development and clinical practice: protocol for a convergent mixed methods study

INTRODUCTION

Extension for Community Healthcare Outcomes (Project ECHO©) is an innovative model for continuing professional development that uses videoconferencing technology to support and train general practitioners remotely. The model has been replicated to a variety of settings and locations for capacity building in healthcare professionals caring for patients with chronic and complex health conditions. Limited research has been conducted so far on the impact of ECHO in the field of concurrent mental health and substance use disorders (ie, concurrent disorders (CDs)). Therefore, this mixed methods study aims to develop a comprehensive understanding of an ECHO programme impact for CD management on nurses' competency development and clinical practice.

METHODS AND ANALYSIS

The proposed mixed methods study, based on a convergent parallel design, will be conducted in the province of Quebec, Canada, to collect, analyse and interpret quantitative (QUAN) and qualitative (QUAL) data from a specific ECHO Program on CDs. In the QUAN component, an observational prospective cohort study will be conducted over a 12-month period. All nurses who participated in the programme between 2018 and 2020 and who consent to research will be recruited to collect data on the extent of their learning and practice outcomes at three time points. Alongside the surveys, nurses will be invited to participate in individual semistructured interviews. In-depth QUAL data will be subjected to a thematic analysis and will assist in exploring how and in which conditions nurses developed and mobilised their competencies in clinical practice. A comparison-of-results strategy will be used in the final integration component of the study.

ETHICS AND DISSEMINATION

This study protocol was approved by the Ethics Committee of the Université de Montréal Hospital Center (#19.295) and the Université de Montréal Ethics Committee (CERSES-20-017 R). We aim to disseminate the findings through international academic conferences, international peer-reviewed journals and professional media.

Prevention programmes for children of parents with a mood/anxiety disorder: Systematic review of existing programmes and meta-analysis of their efficacy

Objectives

To systematically describe the characteristics and techniques of prevention programmes for children of parents with mood/anxiety disorders. In addition, recruitment approaches and difficulties were identified and a meta‐analysis was conducted to examine the efficacy of these prevention programmes.

Methods

Randomized controlled trials assessing the efficacy of a prevention programme for children (6–25 years) of parents with mood and/or anxiety disorders were included. A systematic literature search was conducted in PubMed, PsychINFO, and CENTRAL from the earliest record to March 2019. In addition, programme manuals of identified prevention programmes were requested for a content analysis.

Results

Twenty‐two articles containing eight unique prevention programmes involving 1,325 subjects were identified. Programmes varied in the number and types of techniques, but all provided psychoeducation. Results suggested that recruitment via clinicians was more successful than recruitment via health maintenance organization databases. In a meta‐analysis, a significant risk difference was found in favour of prevention programmes on the risk of developing a depressive/anxiety disorder in offspring at short‐term (9–18 months follow‐up; RR = 0.37, 95% CI [0.21; 0.66]) and long‐term follow‐up (24 months or longer follow‐up; RR = 0.71, 95% CI [0.57; 0.87] and on symptom levels in offspring at post‐intervention (SMD = −0.19, 95% CI [−0.36; −0.02]) and at 12‐months follow‐up (SMD = −0.31, 95% CI [−0.57; −0.06]).

Conclusions

The prevention programmes combined psychoeducational elements with skills training and/or cognitive‐behavioural therapy elements. The recruitment process and the content of these programmes are sometimes insufficiently described. Nevertheless, they appear to be effective, indicating a need to further examine how these programmes exactly work and for whom.

Practitioner points

Preventive interventions for children of parents with mood/anxiety disorders appear to be effective in preventing these disorders in offspring.

Available preventive intervention programmes focus mostly on psychoeducation, cognitive‐behavioural therapy, and family processes.

More effort should be made into describing preventive interventions so that they can be easily implemented by practitioners.

Studies should further examine why and for whom preventive interventions for children of parents with mood/anxiety disorders are effective.

Unpacking student learning from an early experience with the Pharmacists' Patient Care Process

BACKGROUND

To illuminate learning, a case study approach was used to examine early, authentic experiences within Pharmacists' Patient Care Process (PPCP)-focused practices.

EDUCATIONAL ACTIVITY

Six students were matched with five practitioners and spent five half-days in a primary care clinic in a PPCP-committed health system. Students practiced interviewing, determining the patient's medication experience, and formulating the beginnings of the assessment, as well as observing and debriefing on the completion of the process by a practitioner mentor. The Five R Model was used to prompt student learning reflection. In addition, instructors examined students' work for evidence of transformative learning and observations were captured using forms of reflective practice and collaborative debriefing.

CRITICAL ANALYSIS OF THE EDUCATIONAL ACTIVITY

Reflection performance ratings varied; however, there was strong evidence of transformative learning for all students. Specifically, most student reflections demonstrated a focus on elaborating on existing frames of reference. The most prevalent indicator of transformative learning was exploration of options for new roles, relationships, and actions. The codes from instructors' observations revealed five categories of learning evidence, with the strongest in the patient centeredness category. The process of reviewing student work products, documenting instructor observations, and collaborative debriefing resulted in insights for curricular improvement and explanations for learning difficulties. Further work is needed in understanding student experiential learning intentions and their influence on learning and reflection. Additionally, further research should explore the value of longitudinal assessment of reflection and the value of assessing student work products using criteria beyond traditional reflection criteria.

Overview of Reviews Using the Template for Intervention Description and Replication (TIDieR) as a Measure of Trial Intervention Reporting Quality

OBJECTIVE

To evaluate the quality of descriptions of interventions in health care research reports, based on a synthesis of reviews that used the Template for Intervention Description and Replication (TIDieR) to rate the completeness and quality of intervention reporting.

DESIGN

Overview of published reviews. In a systematic search of the literature, 56 review articles were retrieved that had evaluated 3454 primary studies (index articles) using all or most of the 12 TIDieR items, applied to experimental treatment only or treatment and comparator both, separately. If available, percentages "reported completely" were extracted based on the index article, the index article supplemented by related information, and these 2 supplemented by e-mailing the author. Information on the review's methodology was also extracted.

SETTING

Not applicable.

PARTICIPANTS

Not applicable.

INTERVENTIONS

Not applicable.

MAIN OUTCOME MEASURES

Percentage of primary studies receiving "adequately reported" ratings on each of the 12 TIDieR items.

RESULTS

While for treatment arms TIDieR items 1 (name of treatment) and 2 (why of treatment) are generally judged to be reported adequately, the percentage is between 25% and 75% for most other items and is as low as 10% for item 10 (modifications). Comparators are reported even more poorly. Use of additional publications on a trial increased percentages "reported adequately" marginally; e-mailing resulted in significant increases in completeness of reporting. Rehabilitation trials were reported better than nonrehabilitation trials for some TIDieR items and worse for others.

CONCLUSIONS

Reporting on the interventions and comparators of trials is substandard. More extensive use of supplemental digital content and of versions of TIDieR customized for specific domains of research may improve the situation.

Comparison of the Informed Health Choices Key Concepts Framework to other frameworks relevant to teaching and learning how to think critically about health claims and choices: a systematic review

Background: The Informed Health Choices (IHC) Key Concepts are principles for evaluating the trustworthiness of claims about treatment effects. The Key Concepts provide a framework for developing learning-resources to help people use the concepts when treatment claims are made, and when they make health choices.

Objective: To compare the framework provided by the IHC Key Concepts to other frameworks intended to promote critical thinking about treatment (intervention) claims and choices.

Methods: We identified relevant frameworks from reviews of frameworks, searching Google Scholar, citation searches, and contact with key informants. We included frameworks intended to provide a structure for teaching or learning to think critically about the basis for claims, evidence used to support claims, or informed choices. For a framework to be included, there had to be a description of its purpose; a list of concepts, competences, or dispositions; and definitions of key terms. We made independent assessments of framework eligibility and extracted data for each included framework using standardised forms.

Results: Twenty-two frameworks met our inclusion criteria. The purpose of the IHC Framework is similar to that of two frameworks for critical thinking and somewhat similar to that of a framework for evidence-based practice. Those frameworks have broader scopes than the IHC Framework. An important limitation of broad frameworks is that they do not provide an adequate basis (concepts) for deciding which claims to believe and what to do. There was at most some overlap between the concepts, competences, and dispositions in each of the 22 included frameworks and those in the IHC Framework.

Conclusions: The IHC Key Concepts Framework appears to be unique.  Our review has shown how it and other frameworks can be improved by taking account of the ways in which other related frameworks have been developed, evaluated, and made useful.

Assessing the reporting quality of physical activity programs in randomized controlled trials for the management of juvenile idiopathic arthritis using three standardized assessment tools

BACKGROUND

The reporting quality of physical activity (PA) programs in randomized controlled trials (RCTs) for the management of juvenile idiopathic arthritis (JIA) remains unknown. This study aimed to assess and compare the reporting quality of PA programs in RCTs for the management of JIA using three difference standardized assessment tools, and to describe the elements that were similar and different between these tools.

METHODS

A systematic search was conducted for moderate-to high-quality RCTs of PA programs in JIA, published up until January 2019. Two reviewers independently included 10 RCTs and scored the reporting quality of PA programs using the following tools: Consensus on Exercise Reporting Template (CERT) checklist, Consensus on Therapeutic Exercise Training (CONTENT) scale, and Template for Intervention Description and Replication (TIDieR) checklist.

RESULTS

Results showed that reporting of PA programs in 10 moderate- to high-quality RCTs for JIA management remains incomplete. The average reporting quality (± standard deviation) for all RCTs combined was moderate for the three standardized assessment tools with 70.8 (±14.3)% for the TIDieR checklist, 53.2 (±20.2)% for the CERT checklist, and 70.0 (±18.9)% for the CONTENT scale. Despite some overlap, the three standardized assessment tools (TIDieR, CERT, CONTENT) included different elements resulting in different scores. All tools assess elements linked to PA programs (provider, location, timing, personalization and adherence), but the CERT checklist includes other essential elements (e.g., additional resources, motivational strategies, adverse events).

CONCLUSIONS

The lack of complete reporting of PA programs in RCTs for the management of JIA and the variation in scores and assessed elements among standardized assessment tools show the need to improve reporting. Using the most comprehensive standardized tool (i.e., the CERT) and providing accessible supplemental information on PA programs may improve the reporting quality of PA programs in RCTs and help reproduce PA programs in research and clinical practice.

What are the links between evidence-based medicine and shared decision-making in training programs for junior doctors? A scoping review protocol

INTRODUCTION

Patient-centred care is pivotal to clinical practice and medical education. The practice of evidence-based medicine (EBM) and shared decision-making (SDM) are complementary aspects of patient-centred care, but they are frequently taught and reported as independent entities. To effectively perform all steps of EBM, clinicians need to include patients in SDM conversations, however, the uptake of this has been slow and inconsistent. A solution may be the incorporation of SDM into EBM training programmes, but such programmes do not routinely include SDM skills development. This scoping review will survey the literature on the kinds of EBM and SDM educational programmes that exist for recently qualified doctors, programmes that incorporate the teaching of both EBM and SDM skills, as well as identifying research gaps in the literature.

METHODS AND ANALYSIS

Literature searches will be conducted in the databases Medline, Embase, Scopus and Cochrane Library. Bibliographies of key articles and their citing references will also be hand-searched and assessed for inclusion. Selected grey literature will be included. Papers must be written in English, or provide English abstracts, and date from 1996 to the present day.Two independent reviewers will screen titles and abstracts, check full texts of selected papers for eligibility and extract the data. Any disagreement will be resolved, and consensus reached, if necessary, with the assistance of a third reviewer. Qualitative and quantitative studies that address educational interventions for either EBM, SDM or both will be included. Data extraction tables will present bibliographic information, populations, interventions, context and outcomes. Data will be summarised using tables and figures and a description of findings.

ETHICS AND DISSEMINATION

This review will synthesise information from publicly available publications and does not require ethics approval. The results will be disseminated via conference presentations and publications in medical journals.

Assessment of the completeness of intervention reporting of randomized clinical trials for alcohol use disorders: Effect of the TIDieR checklist and guide

BACKGROUND/PURPOSE

Properly designed randomized controlled trials (RCTs) are the gold standard in patient-centered clinical research. Incomplete intervention reporting affects the readers' ability to evaluate treatment efficacy. Previous studies show that detailed descriptions of trial interventions remains insufficient for reliable replication. Understanding reporting areas in need of improvement can improve the quality of intervention reporting.

METHODS

This cross-sectional review uses the Template for Intervention Description and Replication (TIDieR) checklist to evaluate the quality of intervention reporting in RCTs. The primary outcome was to investigate the completeness of intervention reporting of RCTs reporting outcomes for patients with alcohol use disorder (AUD) published in highly ranked addiction journals. The secondary outcomes were to: 1) evaluate whether publication of the TIDieR checklist resulted in better intervention reporting practices and 2) determine whether particular trial characteristics were associated with the completeness of intervention reporting.

RESULTS

The final analysis included 56 records. The mean number of reported TIDieR items was 5.1 (SD = 1.47) of a possible 12. TIDieR checklist publication did not increase the average completion of the TIDieR checklist items (p = 0.76). Improved TIDieR adherence was associated with trials with double blinding, non-drug interventions, and CONSORT endorsement.

DISCUSSION/CONCLUSIONS

We found the reporting of interventions to be inadequate in our sample of AUD-related RCTs. Fundamental details were often not reported, hampering both clinical and research reproducibility. Moving forward, it may be necessary to consider additional mechanisms to either improve TIDieR uptake or to find other solutions to improve intervention reporting.

Evidence-based practice educational intervention studies: a systematic review of what is taught and how it is measured

BACKGROUND

Despite the established interest in evidence-based practice (EBP) as a core competence for clinicians, evidence for how best to teach and evaluate EBP remains weak. We sought to systematically assess coverage of the five EBP steps, review the outcome domains measured, and assess the properties of the instruments used in studies evaluating EBP educational interventions.

METHODS

We conducted a systematic review of controlled studies (i.e. studies with a separate control group) which had investigated the effect of EBP educational interventions. We used citation analysis technique and tracked the forward and backward citations of the index articles (i.e. the systematic reviews and primary studies included in an overview of the effect of EBP teaching) using Web of Science until May 2017. We extracted information on intervention content (grouped into the five EBP steps), and the outcome domains assessed. We also searched the literature for published reliability and validity data of the EBP instruments used.

RESULTS

Of 1831 records identified, 302 full-text articles were screened, and 85 included. Of these, 46 (54%) studies were randomised trials, 51 (60%) included postgraduate level participants, and 63 (75%) taught medical professionals. EBP Step 3 (critical appraisal) was the most frequently taught step (63 studies; 74%). Only 10 (12%) of the studies taught content which addressed all five EBP steps. Of the 85 studies, 52 (61%) evaluated EBP skills, 39 (46%) knowledge, 35 (41%) attitudes, 19 (22%) behaviours, 15 (18%) self-efficacy, and 7 (8%) measured reactions to EBP teaching delivery. Of the 24 instruments used in the included studies, 6 were high-quality (achieved ≥3 types of established validity evidence) and these were used in 14 (29%) of the 52 studies that measured EBP skills; 14 (41%) of the 39 studies that measured EBP knowledge; and 8 (26%) of the 35 studies that measured EBP attitude.

CONCLUSIONS

Most EBP educational interventions which have been evaluated in controlled studies focus on teaching only some of the EBP steps (predominantly critically appraisal of evidence) and did not use high-quality instruments to measure outcomes. Educational packages and instruments which address all EBP steps are needed to improve EBP teaching.