How Comprehensively Is Evidence-Based Practice Represented in Australian Health Professional Accreditation Documents? A Systematic Audit

Evidence-based practice in undergraduate physiotherapy programs in Brazil: A cross-sectional document analysis study

BACKGROUND AND PURPOSE

Physiotherapists worldwide are encouraged to integrate evidence-based practice (EBP) to provide safer and effective services. However, for professionals to consolidate this practice, the contact with EBP must begin at the university. In this study, we aimed to map and analyze the distribution of EBP courses and their characteristics in undergraduate physiotherapy programs in Brazil.

METHODS

This web-based document analysis study analyzed the current curricula of undergraduate physiotherapy programs in Brazil according to their availability on university sites. The identification of curricular components and analysis of EBP course syllabi used evidence-based descriptive terms. A descriptive analysis was used to verify the frequency and the regional distribution of EBP courses.

RESULTS

Of 1033 accredited programs in Brazil, 809 curricula were analyzed. Only 9.4% (76/809) of the analyzed curricula presented EBP courses; the mean duration of courses was 44.3 (SD 13.5) hours. Southeast region had the greatest number of undergraduate programs (46.5%, 376/809), and the north region had a proportionally greater number of EBP courses (24%, 12/50). In addition, 15.6% (10/64) and 8.9% (66/739) of the curricula of public and private institutions, respectively, provided EBP content. Critical appraisal was the most mentioned step among 15 undergraduate programs with complete EBP syllabi.

DISCUSSION

Most undergraduate physiotherapy programs in Brazil did not offer an EBP course. Also, an unbalanced emphasis on the critical appraisal step was observed. The lack of EBP content and skills in the curricula of Brazilian undergraduate physiotherapy programs may negatively influence the training, decision-making, and clinical practice of physiotherapists. A re-evaluating of the current undergraduate programs and curricula for EBP-based education is needed.

Research-based education in undergraduate occupational therapy and physiotherapy education programmes: a scoping review

BACKGROUND

In a research-based learning environment, students learn how to become critical thinkers and lifelong learners, and to generate discipline-enriching knowledge. Research training is important for all healthcare professionals and the integration of research in education can be one approach to improve evidence-based practice among future professionals. The purpose of this scoping review was to identify studies reporting on research-based education in undergraduate occupational therapy and physiotherapy curricula to document the current state of knowledge and to map factors that reflect and support the implementation of research-based education in undergraduate occupational therapy and physiotherapy programmes.

METHODS

A scoping review was used to systematically select and summarize existing literature. The search was conducted using a combination of keywords and MeSH terms in the following databases: EBSCO (Academic Search Elite, CINAHL, ERIC), MEDLINE, Embase, Education Source and grey literature. A thematic analysis identified strategies used to implement and promote research-based education in occupational therapy and physiotherapy bachelor programmes.

RESULTS

The database search identified 3068 records. 75 were eligible for full-text assessment and 27 studies were included. The studies were published between 1999 and 2021 and were conducted in Norway, Canada, South Africa, Australia, the United Kingdom, the United States, New Zealand, Ireland, Taiwan, Italy, and Iran. The study designs were mainly quantitative and qualitative, and studies included primarily occupational therapy and physiotherapy students. We identified the following four strategies: 'student engagement in research', 'curriculum improvement regarding EBP', 'EBP teaching' and 'journal club', where 'EBP teaching' was most frequently identified.

CONCLUSIONS

Findings from this scoping review suggest that ensuring students' competence in research methods is necessary for students to be able to read and understand research articles, which are important as foundational skills in undergraduate research training. Journal clubs can be a foundation for student engagement with research literature, and students' basic research skills may be facilitated through their involvement in research projects and by conducting systematic reviews. Further, cooperation with clinical practice is important, and the awareness of research-based education should be increased among both faculty members and students.

Intra- and inter-rater reliability of an electronic health record audit used in a chiropractic teaching clinic system: an observational study

Background

There is a dearth of information about health education clinical file audits in the context of completeness of records and demonstrating program-wide competency achievement. We report on the reliability of an audit instrument used for electronic health record (EHR) audits in the clinics of a chiropractic college in Canada.

Methods

The instrument is a checklist built within an electronic software application designed to pull data automatically from the EHR. It consists of a combination of 61 objective (n = 20) and subjective (n = 41) elements, representing domains of standards of practice, accreditation and in-house educational standards. Trained auditors provide responses to the elements and the software yields scores indicating the quality of clinical record per file.

A convenience sample of 24 files, drawn randomly from the roster of 22 clinicians, were divided into three groups of eight to be completed by one of three auditors in the span of 1 week, at the end of which they were transferred to another auditor. There were four audit cycles; audits from cycles 1 and 4 were used to assess intra-rater (test-retest) reliability and audits from cycles 1, 2 and 3 were used to assess inter-rater reliability. Percent agreement (PA) and Kappa statistics (K) were used as outcomes. Scatter plots and intraclass correlation (ICC) coefficients were used to assess standards of practice, accreditation, and overall audit scores.

Results

Across all 3 auditors test-retest reliability for objective items was PA 89% and K 0.75, and for subjective items PA 82% and K 0.63. In contrast, inter-rater reliability was moderate at PA 82% and K 0.59, and PA 70% and K 0.44 for objective and subjective items, respectively. Element analysis indicated a wide range of PA and K values inter-rater reliability of many elements being rated as poor. ICC coefficient calculations indicated moderate reliability for the domains of standards of practice, accreditation, and overall file scores.

Conclusion

The file audit process has substantial test-retest reliability and moderate inter-rater reliability. Recommendations are made to improve reliability outcomes. These include modifying the audit checklist with a view of improving clarity of elements, and enhancing uniformity of auditor responses by increased training aided by preparation of an audit guidebook.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-021-06745-1.

Objective method to evaluate the competency of residents in cardiac surgery

OBJECTIVES

Cardiac surgery training has become more challenging as patients and their diagnoses become more complex. Our goal was to develop a multicategorical assessment model for evaluating residents in cardiac surgery. This model is intended to ensure goal-directed progress in their training as well as to recognize and support their surgical talents.

METHODS

We developed a new questionnaire in a multistage, 3-round process based on the Delphi method 'estimate-talk-estimate', using 55 competencies, including 38 general and 17 domain-specific competencies. Each competency is evaluated with 1 or more questions, to which 1 (not competent) to 6 (very competent) points can be chosen as an answer.

RESULTS

The resulting model achieved 2 main goals: first, presenting a well-defined competency list for cardiac surgical training and second, providing an objective and realistic evaluation of trainees' abilities. Residents were assessed by all trainers to achieve a high level of objectivity.

CONCLUSIONS

This evaluation model is highly objective, because residents are evaluated by multiple trainers. It allows individual support and enables better transparency in residency training. Talents and skills are evaluated, recognized and adopted as a base for individual feedback and personalized training programmes.

Changes in physiotherapists' perceptions of evidence-based practice after a year in the workforce: A mixed-methods study

BACKGROUND

Few studies have explored evidence-based practice (EBP) knowledge, attitudes and behaviours of health professional graduates transitioning into the workforce. This study evaluated changes in these EBP domains in physiotherapists after one year of working.

METHOD

A mixed methods design was used. Participants completed two psychometrically-tested EBP questionnaires at two timepoints. The Evidence-Based Practice Profile questionnaire collected self-report EBP data (Terminology, Relevance, Confidence, Practice, Sympathy) and the Knowledge of Research Evidence Competencies collected objective data (Actual Knowledge). Changes were calculated using descriptive statistics (paired t-tests, 95% CI, effect sizes). Qualitative interview data collected at one timepoint were analysed using a descriptive approach and thematic analysis, to examine the lived experience of participants in the context of their first employment. The aim of the mixed methods approach was a broader and deeper understanding of participants' first year of employment and using EBP.

RESULTS

Data were analysed from 50 participants who completed both questionnaires at the two timepoints. After one year in the workforce, there was a significant decrease in participants' perceptions of Relevance (p<0.001) and Confidence with EBP (p<0.001) and non-significant decreases in the other domains. Effect sizes showed medium decreases for Relevance (0.69) and Confidence (0.57), small decreases in Terminology (0.28) and Practice (0.23), and very small decreases in Sympathy (0.08) and Actual Knowledge (0.11). Seven themes described participants experience of using EBP in their first working year.

CONCLUSIONS

After a year in the workplace, confidence and perceptions of relevance of EBP were significantly reduced. A subtle interplay of features related to workplace culture, competing demands to develop clinical skills, internal and external motivators to use EBP and patient expectations, together with availability of resources and time, may impact early graduates' perceptions of EBP. Workplace role models who immersed themselves in evidence discussion and experience were inspiring to early graduates.

Are Councils on Chiropractic Education expectations of chiropractic graduates changing for the better: a comparison of similarities and differences of the graduate competencies of the Chiropractic Council on Education-Australasia from 2009 to 2017

BACKGROUND

The Council on Chiropractic Education Australasia (CCE-A) is tasked with assessment and accreditation of chiropractic programs (CPs) in the Australasian community. To achieve this process the CCE-A has developed educational standards and graduate competencies which include minimum expectations of graduates prior to entry into the workforce. We sought to explore if these are changing overtime, and if so are these changes for the better.

METHOD

The CCE-A 2009 and 2017 Competency Standards were located and downloaded. The competencies were placed into tables for a comparative analyses in a systematic manner to enable the identification of similarities and differences. In addition, word counts were conducted for the most commonly occurring words and this took place in December 2019.

RESULTS

The 2017 competency standards were over three times smaller than the previous standards 2009 standards. More similarities than differences between the old and the new standards were found. There were 18 additions to the 2017 graduate competencies with many that were in unison with contemporary aspects of healthcare such as patient centred-care, respect for practitioner-patient boundaries and patient sexual orientation, transitioning patients to self-management, and consideration of improving lifestyle options. Some competencies were not bought forward to the new standards and included, among others, students being competent in screening for mental health conditions, an expectation to discuss cost of care, re-evaluating and monitoring patients at each visit, and knowing when to discharge patients. The competencies continued to be silent on known issues within the chiropractic profession of a lack of a definition for chiropractic that would inform scope of practice and the presence of vitalism within CPs.

CONCLUSION

There have been positive changes which reflect contemporary mainstream health care standards between CCE-A graduate competency revisions. The absence of a clear definition of chiropractic and its attendant scope of practice as well as continued silence on vitalism reflect known issues within the chiropractic profession. Recommendations are made for future accreditation standards to inform the required competencies and aid the integration of chiropractic into the broader health care community.

A perspective on Councils on Chiropractic Education accreditation standards and processes from the inside: a narrative description of expert opinion: Part 2: Analyses of particular responses to research findings

Background

This is the second article reporting on a study that sought the views of people with extensive experience in Councils on Chiropractic Education (CCEs) on research that has raised concerns about variability in accreditation standards and processes for chiropractic programs (CPs) and chiropractic practice in general.

Methods

This qualitative study employed in-depth semi-structured interviews that consisted of open-ended questions asking experts about their thoughts and views on a range of issues surrounding accreditation, graduate competency standards and processes. The interviews were audio-recorded, and transcribed verbatim in June and July of 2018. The transcripts were reviewed to develop codes and themes. The study followed the COREQ guidelines for qualitative studies.

Results

The interviews revealed that these CCE experts were able to discern positive and negative elements of the accreditation standards and processes. They were, in general, satisfied with CCEs accreditation standards, graduating competencies, and site inspection processes. Most respondents believed that it was not possible to implement an identical set of international accreditation standards because of cultural and jurisdictional differences. This was thought more likely to be achieved if based on the notion of equivalence. Also, they expressed positive views toward an evidence-based CP curriculum and an outcomes-based assessment of student learning. However, they expressed concerns that an evidence-based approach may result in the overlooking of the clinician's experience. Diverse views were found on the presence of vitalism in CPs. These ranged from thinking vitalism should only be taught in an historical context, it was only a minority who held this view and therefore an insignificant issue. Finally, that CCEs should not regulate these personal beliefs, as this was potentially censorship. The notable absence was that the participants omitted any mention of the implications for patient safety, values and outcomes.

Conclusions

Expert opinions lead us to conclude that CCEs should embrace and pursue the widely accepted mainstream healthcare standards of an evidence-based approach and place the interests of the patient above that of the profession. Recommendations are made to this end with the intent of improving CCE standards and processes of accreditation.

Theory-based strategies for teaching evidence-based practice to undergraduate health students: a systematic review

BACKGROUND

Undergraduate students across health professions are required to be capable users of evidence in their clinical practice after graduation. Gaining the essential knowledge and clinical behaviors for evidence-based practice can be enhanced by theory-based strategies. Limited evidence exists on the effect of underpinning undergraduate EBP curricula with a theoretical framework to support EBP competence. A systematic review was conducted to determine the effectiveness of EBP teaching strategies for undergraduate students, with specific focus on efficacy of theory-based strategies.

METHODS

This review critically appraised and synthesized evidence on the effectiveness of EBP theory-based teaching strategies specifically for undergraduate health students on long or short-term change in multiple outcomes, including but not limited to, EBP knowledge and attitudes. PubMed, CINAHL, Scopus, ProQuest Health, ERIC, The Campbell Collaboration, PsycINFO were searched for published studies and The New York Academy of Medicine, ProQuest Dissertations and Mednar were searched for unpublished studies. Two independent reviewers assessed studies using the Joanna Briggs Institute Meta-Analysis of Statistics Assessment and Review Instrument.

RESULTS

Twenty-eight studies reporting EBP teaching strategies were initially selected for review with methodological quality ranging from low to high. Studies varied in course duration, timing of delivery, population and course content. Only five included papers reported alignment with, and detail of, one or more theoretical frameworks. Theories reported included Social Cognitive Theory (one study), Roger's Diffusion of Innovation Theory (two studies) and Cognitive Apprenticeship Theory (one study). Cognitive Flexibility Theory and Cognitive Load Theory were discussed in two separate papers by the same authors. All but one study measured EBP knowledge. Mixed results were reported on EBP knowledge, attitudes and skills across the five studies.

CONCLUSIONS

EBP programs for undergraduate health students require consideration of multiple domains, including clinical behaviors, attitudes and cognitive learning processes; Interventions grounded in theory were found to have a small but positive effect on EBP attitudes. The most effective theory for developing and supporting EBP capability is not able to be determined by this review therefore additional rigorous research is required.

A collaborative process for a program redesign for education in evidence-based health care

OBJECTIVE:

We outline the framework of a collaborative process to redesign an existing 5-year health education program, which may prove useful to other similar institutions. The aim was to strengthen evidence-based practice and curriculum alignment.

METHODS:

A whole-of-program approach was used to restructure the existing courses into 3 "streams": professional practice, clinical research, and clinical science. The process incorporated a series of facilitated workshops organized by the department director of learning and teaching and the faculty facilitation team, and it was inclusive of all available members of the department, a clinic supervisor, a sessional (casual teaching) staff member, and a recent graduate of the program.

RESULTS:

Unit content and assessments were restructured to progress the program learning outcomes from year to year. The undergraduate program was redesigned to create a more logical learning pathway for students. Consolidation of subject topics in the postgraduate program allowed for the development of stand-alone research-only units.

CONCLUSION:

The mechanism of curriculum mapping allowed for discussion about the flow of information from year to year and how evidenced knowledge and understanding can be developed. It is necessary that everyone participates and understands the importance of program goals as developed by the process. Because drift in curriculum can occur incrementally over the years, to be effective, the program requires ongoing monitoring and regular collaboration to continue improvements.

Evidence-based practice profiles among bachelor students in four health disciplines: a cross-sectional study

BACKGROUND

Despite the recognition of integrating evidence-based practice (EBP) in educational programs, there is limited research about bachelor students' EBP profiles (EBP knowledge, attitudes and behaviour) in the health disciplines nursing, occupational therapy, physiotherapy and radiography. The aim of this study was to assess EBP profiles among bachelor students in health disciplines, and explore differences between health disciplines, educational institutions, students' assessment of EBP teaching and expectations of EBP performance.

METHODS

A survey using the 'Evidence-Based Practice Profile - Norwegian version' (EBP²-N) was conducted among final year bachelor students in health disciplines from four educational institutions. The questionnaire consisted of five domains (Relevance, Terminology, Confidence, Practice and Sympathy) and assessed the five steps of EBP. We performed regression analyses to analyse mean differences in domain scores between health disciplines, Cohen's d to illustrate the magnitude of the largest difference in each domain, Omega squared to describe portion of variance in domain scores, and Spearman's rho (r_s) to assess the monotonic relationship between EBP²-N domains and assessment of EBP teaching and expectations of EBP performance, respectively.

RESULTS

Students reported highest overall mean score for Relevance, with an estimated standardized mean of 81.2 (CI 95% = 80.4-82.0). The other EBP²-N domains had estimated standardized means of 54 and less. Statistically significant differences (p < 0.03) between health disciplines were observed for all domains. The largest mean difference was found for Relevance with highest score for occupational therapy and lowest for radiography, with an estimated Cohen's d of 1.11. Moderate positive associations were observed between Relevance scores and students' assessment of EBP teaching (r_s = 0.31), and expectations of EBP performance from teachers (r_s = 0.36). We also observed a moderate positive correlation between Confidence and students' assessment of EBP teaching (r_s = 0.46).

CONCLUSION

Bachelor students in health disciplines found EBP relevant, but revealed low understanding of EBP terminology, low confidence with EBP skills, and low use of EBP in clinical situations. We observed differences in EBP profiles between health disciplines and between educational institutions. The differences in scores raise questions about the understanding of EBP within disciplines, and the complexity of EBP in educational settings.

Comparing the old to the new: A comparison of similarities and differences of the accreditation standards of the chiropractic council on education-international from 2010 to 2016

Background

Chiropractic programs are accredited and monitored by regional Councils on Chiropractic Education (CCE). The CCE-International has historically been a federation of regional CCEs charged with harmonising world standards to produce quality chiropractic educational programs. The standards for accreditation periodically undergo revision. We conducted a comparison of the CCE-International 2016 Accreditation Standards with the previous version, looking for similarities and differences, expecting to see some improvements.

Method

The CCE-International current (2016) and previous versions (2010) were located and downloaded. Word counts were conducted for words thought to reflect content and differences between standards. These were tabulated to identify similarities and differences. Interpretation was made independently followed by discussion between two researchers.

Results

The 2016 standards were nearly 3 times larger than the previous standards. The 2016 standards were created by mapping and selection of common themes from member CCEs' accreditation standards and not through an evidence-based approach to the development and trialling of accreditation standards before implementation. In 2010 chiropractors were expected to provide attention to the relationship between the structural and neurological aspects of the body in health and disease. In 2016 they should manage mechanical disorders of the musculoskeletal system. Many similarities between the old and the new standards were found. Additions in 2016 included a hybrid model of accreditation founded on outcomes-based assessment of education and quality improvement. Both include comprehensive competencies for a broader role in public health. Omissions included minimal faculty qualifications and the requirement that students should be able to critically appraise scientific and clinical knowledge. Another omission was the requirement for chiropractic programs to be part of a not-for-profit educational entity. There was no mention of evidence-based practice in either standards but the word 'evidence-informed' appeared once in the 2016 standards.

Conclusions

Some positive changes have taken place, such as having bravely moved towards the musculoskeletal model, but on the negative side, the requirement to produce graduates skilled at dealing with scientific texts has been removed. A more robust development approach including better transparency is needed before implementation of CCE standards and evidence-based concepts should be integrated in the programs. The CCE-International should consider the creation of a recognition of excellence in educational programs and not merely propose minimal standards.

How comprehensively is evidence-based practice represented in councils on chiropractic education (CCE) educational standards: a systematic audit

Background

The incorporation of evidence-based practice (EBP) is widely recognised as a necessary process for entry-level health professional training. Accreditation documents reflect the practice standards of health professions. No previous study has assessed the extent to which EBP has been taken up by chiropractic regulatory/licencing authorities, known as Councils on Chiropractic Education (CCEs), around the world. The purposes of this study were to examine CCEs’ educational standards for signs of a positive and negative approach to EBP as indicated by the prevalence and use of the words evidence, research, subluxation and vitalism, and to make recommendations if significant deficiencies were found.

Method

We undertook a systematic audit of the educational standard documents of the various CCEs. CCEs were selected on the basis of the World Health Organisation. Two investigators identified the occurrences of terms explicitly related to EBP: evidence, evidence-based, research, subluxation and vitalism. This information was tabulated for comparative purposes. The date of the study was March 2016.

Results

Occurrences of the term evidence, as it related to EBP, was highest in the CCE-Europe (n = 6), followed by CCE-Australia (n = 2), and CCE-USA (n = 1). None were found in the CCE-International or CCE-Canada documents. The term research appeared most frequently in the CCE-Europe documents (n = 43), followed by CCE-USA (n-32), CCE-Australia (n = 29), CCE-Canada (n = 9) and CCE-International (n = 8). The term subluxation was found only once (CCE-USA) and vitalism did not appear in any educational standard documents.

Conclusions

Accreditation bodies are powerfully positioned to act as a driver for education providers to give greater priority to embedding EBP into entry-level programs and shaping future directions within the profession. Terminology relating explicitly to EBP appears to be lacking in the educational standard documentation of CCEs. Therefore, future revisions of accreditation standards should address lack of terminology.