1
|
Zirges CC, Sherman ER, Davidson J, Holmes K, Taylor H, Brum R, Kluttz L, Holley S. A Framework for Defining and Documenting Infection Preventionist Competency. Am J Infect Control 2024:S0196-6553(24)00823-X. [PMID: 39491679 DOI: 10.1016/j.ajic.2024.10.034] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2024] [Revised: 10/30/2024] [Accepted: 10/31/2024] [Indexed: 11/05/2024]
Affiliation(s)
| | | | | | | | | | | | - Letty Kluttz
- Association for Professionals in Infection Control and Epidemiology
| | - Stephanie Holley
- Association for Professionals in Infection Control and Epidemiology.
| |
Collapse
|
2
|
Jarva E, Oikarinen A, Andersson J, Pramila-Savukoski S, Hammarén M, Mikkonen K. Healthcare professionals' digital health competence profiles and associated factors: A cross-sectional study. J Adv Nurs 2024; 80:3236-3252. [PMID: 38323687 DOI: 10.1111/jan.16096] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2023] [Revised: 12/22/2023] [Accepted: 01/21/2024] [Indexed: 02/08/2024]
Abstract
AIMS To identify healthcare professionals' digital health competence profiles and explore associated factors to digital health competence in healthcare settings. DESIGN A cross-sectional study. METHODS Data were collected from 817 healthcare professionals from nine organizations with an electronic questionnaire by using Digital Health Competence instrument (42 items) and Aspects Associated with Digital Health instrument (15 items) between 1st March and 31st July 2022. K-means clustering was used to describe digital health competence profiles. Binary logistic regression analysis was used to explore associated factors. RESULTS Analysis revealed three digital health competence profiles: A - high competence (n = 336), B - intermediate competence (n = 352) and C - low competence (n = 129). Between the profiles, digital health competence showed significant differences (p < .001). Recent graduation year, working in outpatient environments and leader or specialist position were associated with higher digital health competence. Organizational practices and the influence from colleagues improved competence in human-centred remote counselling, digital solutions as part of work, competence in utilizing and evaluating digital solutions and ethical competence. Support from management improved digital solutions as part of work and ethical competence. CONCLUSION Nursing and allied health professionals working in other than outpatient environments should be specifically acknowledged when digital health competence development initiatives are designed and targeted. The positive influence from colleagues could be harnessed by enhancing their involvement in digital health competence development methods such as orientation, mentoring or coaching. Additionally, managers should take a stronger role in supporting different areas of digital health competence. IMPACT This was the first study that explored healthcare professionals' digital health competence profiles and associated factors. The detection of healthcare professionals' digital health competence profiles guides the development of digital health education according to different needs in healthcare environments. REPORTING METHOD The study has adhered to STROBE guidelines. PATIENT OR PUBLIC CONTRIBUTION No patient or public contribution.
Collapse
Affiliation(s)
- Erika Jarva
- Research Unit of Health Sciences and Technology, University of Oulu, Oulu, Finland
| | - Anne Oikarinen
- Research Unit of Health Sciences and Technology, University of Oulu, Oulu, Finland
- Medical Research Center Oulu, Oulu University Hospital and University of Oulu, Oulu, Finland
| | - Janicke Andersson
- Center for Research on Welfare, Health and Sports, Academy of Health and Welfare, Halmstad University, Halmstad, Sweden
| | | | - Mira Hammarén
- Research Unit of Health Sciences and Technology, University of Oulu, Oulu, Finland
| | - Kristina Mikkonen
- Research Unit of Health Sciences and Technology, University of Oulu, Oulu, Finland
- Medical Research Center Oulu, Oulu University Hospital and University of Oulu, Oulu, Finland
| |
Collapse
|
3
|
Lastrucci A, Wandael Y, Orlandi G, Barra A, Chiti S, Gigli V, Marletta M, Pelliccia D, Tonietti B, Ricci R, Giansanti D. Precision Workforce Management for Radiographers: Monitoring and Managing Competences with an Automatic Tool. J Pers Med 2024; 14:669. [PMID: 39063923 PMCID: PMC11278459 DOI: 10.3390/jpm14070669] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2024] [Revised: 06/13/2024] [Accepted: 06/14/2024] [Indexed: 07/28/2024] Open
Abstract
Optimizing work shifts in healthcare is crucial for maintaining high standards of service delivery and fostering professional development. This study delves into the emerging field of skill-oriented work shift optimization, focusing specifically on radiographers within the healthcare sector. Through the development of Skills Retention Monitoring (SRH), this research aims to enhance skill monitoring, workload management, and organizational performance. In this study, several key highlights emerged: (a) Introduction of the SRH tool: The SRH tool represents a resource-efficient solution that harnesses existing software infrastructure. A preliminary version, focusing on the radiographers' professional profile, was released, and after several months of use, it demonstrated effectiveness in optimizing work based on competency monitoring. (b) The SRH tool has thus demonstrated the capacity to generate actionable insights in the organizational context of radiographers. By generating weekly reports, the SRH tool streamlines activity management and optimizes resource allocation within healthcare settings. (c) Application of a Computer-Assisted Web Interviewing (CAWI) tool for pre-release feedback during a training event. (d) Strategic importance of a maintenance and monitoring plan: This plan, rooted in a continuous quality improvement approach and key performance indicators, ensures the sustained effectiveness of the SRH tool. (e) Strategic importance of a transfer plan: Involving professional associations and employing targeted questionnaires, this plan ensures the customization of the tool from the perspective of each profession involved. This is a crucial point, as it will enable the release of tool versions tailored to various professions operating within the hospital sector. As a side result, the tool could allow for a more tailored and personalized medicine both by connecting the insights gathered through the SRH tool with the right competencies for healthcare professionals and with individual patient data. This integration could lead to better-informed decision making, optimizing treatment strategies based on both patient needs and the specific expertise of the healthcare provider. Future directions include deploying the SRH tool within the Pisa hospital network and exploring integration with AI algorithms for further optimization. Overall, this research contributes to advancing work shift optimization strategies and promoting excellence in healthcare service delivery.
Collapse
Affiliation(s)
- Andrea Lastrucci
- Department of Allied Health Professions, Azienda Ospedaliero-Universitaria Careggi, 50134 Florence, Italy; (A.L.); (Y.W.); (G.O.); (A.B.); (S.C.); (R.R.)
| | - Yannick Wandael
- Department of Allied Health Professions, Azienda Ospedaliero-Universitaria Careggi, 50134 Florence, Italy; (A.L.); (Y.W.); (G.O.); (A.B.); (S.C.); (R.R.)
| | - Giovanni Orlandi
- Department of Allied Health Professions, Azienda Ospedaliero-Universitaria Careggi, 50134 Florence, Italy; (A.L.); (Y.W.); (G.O.); (A.B.); (S.C.); (R.R.)
| | - Angelo Barra
- Department of Allied Health Professions, Azienda Ospedaliero-Universitaria Careggi, 50134 Florence, Italy; (A.L.); (Y.W.); (G.O.); (A.B.); (S.C.); (R.R.)
| | - Stefano Chiti
- Department of Allied Health Professions, Azienda Ospedaliero-Universitaria Careggi, 50134 Florence, Italy; (A.L.); (Y.W.); (G.O.); (A.B.); (S.C.); (R.R.)
| | - Valentina Gigli
- Staff della Direzione Aziendale, Azienda Ospedaliero-Universitaria Careggi, 50134 Florence, Italy; (V.G.); (B.T.)
| | - Massimo Marletta
- Department of Allied Health Professions, Azienda Ospedaliero-Universitaria Pisana, 56124 Pisa, Italy; (M.M.); (D.P.)
| | - Davide Pelliccia
- Department of Allied Health Professions, Azienda Ospedaliero-Universitaria Pisana, 56124 Pisa, Italy; (M.M.); (D.P.)
| | - Barbara Tonietti
- Staff della Direzione Aziendale, Azienda Ospedaliero-Universitaria Careggi, 50134 Florence, Italy; (V.G.); (B.T.)
| | - Renzo Ricci
- Department of Allied Health Professions, Azienda Ospedaliero-Universitaria Careggi, 50134 Florence, Italy; (A.L.); (Y.W.); (G.O.); (A.B.); (S.C.); (R.R.)
| | | |
Collapse
|
4
|
Rastegarimehr B, Raoofi S, Zahedi A, Ahmadi Teymourlouy A, Mahboubi M, Sadeghifar J. Identifying factors affecting the selection of heads of city health centers in Iran: A phenomenological study. PLoS One 2024; 19:e0304759. [PMID: 38843273 PMCID: PMC11156354 DOI: 10.1371/journal.pone.0304759] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2024] [Accepted: 05/18/2024] [Indexed: 06/09/2024] Open
Abstract
INTRODUCTION Managers in the health care sector have the responsibility of accomplishing objectives and guaranteeing the excellence of services. To be chosen as a manager in a health organization, individuals must possess specific qualities and skills. Examining the process of selecting and appointing managers at the highest level of service provision might offer policymakers valuable insights into the importance of considering competences when choosing and appointing leaders of health centers. Hence, this study was conducted to identify the characteristics that influence the selection process of heads of city health centers in Iran. METHODS The present study employed a qualitative and phenomenological approach, utilizing interviews performed in the year 2023. The study sample consisted of health deputy from medical sciences universities, local health network managers, and heads of city health center. The participants were selected using a purposive selection method. A total of 16 male participants were interviewed, and the interviews were then analyzed using MAXQDA-10 software using the usual content analysis method. RESULTS In this study, the factors affecting the selection of the heads of health care centers were classified into two general topics: individual factors and environmental factors, and eight sub-topics, including health literacy, experience, individual characteristics, communication skills, mental characteristics, legal issues, political factors, and cultural factors. CONCLUSION The development of health literacy, specialized knowledge, and communication skills to coordinate and resolve organizational problems helps train competent managers. Top health system managers, who select health center managers, must understand political and cultural variables and regulate and steer their influence to select effective managers.
Collapse
Affiliation(s)
- Babak Rastegarimehr
- Department of Health Services Management, School of Health Management and Information Sciences, Iran University of Medical Sciences, Tehran, Iran
| | - Samira Raoofi
- Department of Healthcare Management, Research Center for Evidence-Based Health Management, Maragheh University of Medical Sciences, Maragheh, Iran
| | - Atefeh Zahedi
- Department of Public Health, Asadabad School of Medical Sciences, Asadabad, Iran
| | - Ahmad Ahmadi Teymourlouy
- Department of Health Services Management, School of Health Management and Information Sciences, Iran University of Medical Sciences, Tehran, Iran
| | - Mohammad Mahboubi
- Department of Public Health, Abadan University of Medical Sciences, Abadan, Iran
- Research Center for Evidence-Based Health Management, Maragheh University of Medical Sciences, Maragheh, Iran
| | - Jamil Sadeghifar
- Department of Health Management and Economics, Faculty of Health, Ilam University of Medical Sciences, Ilam, Iran
| |
Collapse
|
5
|
Lutaka M, Speelman A, Naidoo S, Hamunyela R. Quality audits of nuclear medicine practices in a middle-income African setting. J Med Radiat Sci 2024; 71:186-193. [PMID: 38009579 PMCID: PMC11177013 DOI: 10.1002/jmrs.743] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2023] [Accepted: 11/10/2023] [Indexed: 11/29/2023] Open
Abstract
INTRODUCTION The International Atomic Energy Agency (IAEA) introduced a Quality Management Audits in Nuclear Medicine (QUANUM) programme, to improve nuclear medicine practice standards aligned with international standards through self-assessments. The absence of quality management audits in nuclear medicine departments could potentially result in a compromise in the safety and quality of patient care. To date, there is no evidence that quality audits have been conducted in nuclear medicine departments of this middle-income country. This quality audit, therefore, assessed conformance to the IAEA QUANUM programme in four nuclear medicine departments. METHODS The study adopted a quantitative methodological exploratory approach. The IAEA QUANUM programme was used to audit nuclear medicine services' overall activity such as clinical practice, management, radiopharmacy, general and radiation safety, quality assurance, operations and services. The data was collected via document analysis in four nuclear medicine department identified as Sites A-D. RESULTS Overall results showed that Site A conformed with 247 out of 370 (67%) counts and non-conformed with 123 out of 370 (33%) counts whilst Site B conformed with 205 out of 342 (60%) counts and non-conformed with 137 out of 342 counts (40%). Site C conformed with 259 out of 345 (75%) counts and non-conformed with 86 out of 345 (25%) counts. Site D conformed with 166 out of 349 (48%) counts and non-conformed with 183 out of 349 (52%) counts. The study yielded 125 overall recommendations. CONCLUSIONS All the sites demonstrated good compliance to international standards in radionuclide therapy. Site A complied poorly in strategies and policies, whilst Site B complied poorly in quality control of equipment. Site C showed poor compliance to human resource development and Site D showed aspects pertaining to administration and management as well as evaluation of quality systems.
Collapse
Affiliation(s)
- Magdalena Lutaka
- Master of Science Radiography Degree Programme, Department of Medical Imaging and Therapeutic Sciences, Faculty of Health and Wellness SciencesCape Peninsula University of Technology (CPUT)BellvilleSouth Africa
| | - Aladdin Speelman
- Department of Medical Imaging and Therapeutic Sciences, Faculty of Health and Wellness SciencesCape Peninsula University of TechnologyBellvilleSouth Africa
| | - Subhadranalene Naidoo
- Department of Radiography, Faculty of Health SciencesDurban University of TechnologyDurbanSouth Africa
| | - Roswita Hamunyela
- Department of Radiography, School of Radiography, School of Allied Health Sciences, Faculty of Health Sciences and Veterinary MedicineUniversity of NamibiaWindhoekNamibia
| |
Collapse
|
6
|
Wang J, Chen L, Wang Z, Fang X, Zhen Y. Perceptions, Attitudes, Beliefs, and Practices Toward Traditional Chinese Medicine Therapies for Herpes Zoster: A Cross-Sectional Study of Healthcare Professionals. Risk Manag Healthc Policy 2024; 17:1239-1251. [PMID: 38765781 PMCID: PMC11102122 DOI: 10.2147/rmhp.s461149] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2024] [Accepted: 05/05/2024] [Indexed: 05/22/2024] Open
Abstract
Introduction Traditional Chinese medicine (TCM) holds great potential in promoting healing and relieving pain for herpes zoster (HZ) treatments. Evidence showed that both healthcare professionals' (HCPs) belief and knowledge influence their attitudes, which result in their expression and direct behavior. However, little is known in this area regarding TCM treatments for HZ. This study aimed to understand the HCPs' perceptions, attitudes, beliefs, and practices toward TCM and its services for HZ. Methods During July 2021 and October 2022, a cross-sectional study of HCPs querying demographics, perceptions, attitudes, beliefs, and practices toward TCM and TCM services for HZ was conducted. The frequency and percentage or mean and standard deviation were used to present categorical data and continuous data, respectively. A Chi-square analysis compared nurses' and doctors' views on TCM treatments for HZ. Results Out of 306 eligible respondents, 66.0% used TCM content in clinical practice less than 40% of the time. Respondents reported that there were three main advantages of TCM for HZ, including better crusting and healing, fewer side effects, and mitigating complications. A total of 41.3% (81/196) of the respondents who had cared for/treated HZ patients applied TCM treatments. The three factors most associated with referrals/providing TCM to patients were postherpetic neuralgia, early erythema or papules, and acute pain. Compared to nurses, doctors showed more endorsement of the efficacy and cost-effectiveness of TCM treatments for HZ patients. Conclusion The study found that most healthcare professionals in HZ had a favorable view of TCM, but lacked practical experience administering it to patients. Programs should be developed to provide evidence-based TCM treatments and encourage combining TCM with Western medicine for better patient care.
Collapse
Affiliation(s)
- Jiani Wang
- School of Nursing, Sun Yat-Sen University, Guangzhou City, Guangdong Province, People’s Republic of China
| | - Liudan Chen
- Department of Traditional Chinese Medicine, Sun Yat-Sen Memorial Hospital, Guangzhou City, Guangdong Province, People’s Republic of China
| | - Zhuangfei Wang
- Department of Dermatology, Sun Yat-Sen Memorial Hospital, Guangzhou City, Guangdong Province, People’s Republic of China
| | - Xiaohong Fang
- Department of Dermatology, Sun Yat-Sen Memorial Hospital, Guangzhou City, Guangdong Province, People’s Republic of China
| | - Yan Zhen
- Department of Traditional Chinese Medicine, Sun Yat-Sen Memorial Hospital, Guangzhou City, Guangdong Province, People’s Republic of China
| |
Collapse
|
7
|
MacKay M, Ford C, Grant LE, Papadopoulos A, McWhirter JE. Developing competencies in public health: a scoping review of the literature on developing competency frameworks and student and workforce development. Front Public Health 2024; 12:1332412. [PMID: 38500736 PMCID: PMC10944919 DOI: 10.3389/fpubh.2024.1332412] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2023] [Accepted: 02/19/2024] [Indexed: 03/20/2024] Open
Abstract
Effective and precise public health practice relies on a skilled and interdisciplinary workforce equipped with integrated knowledge, values, skills, and behaviors as defined by competency frameworks. Competency frameworks inform academic and professional development training, support performance evaluation, and identify professional development needs. The aim of this research was to systematically identify and examine trends in the extent, nature, and range of the literature related to developing competencies in public health. This includes developing public health competency frameworks, and how competencies are developed and maintained in students and practitioners. We used a scoping review methodology to systematically identify and report on trends in the literature. Two independent reviewers conducted title and abstract and full-text screening to assess the literature for relevance. Articles were included if they were original primary research or gray literature and published in English. No date or geographic restrictions were applied. Articles were included if they focused on developing competency statements or frameworks for public health and/or training public health students or practitioners to develop competencies. The review encompassed a range of methods and target populations, with an emphasis on building competencies through student and professional development. Foundational competency development was a primary focus, and we found a gap in discipline-specific competency research, especially within developing discipline-specific competency statements and frameworks. Several evidence-based practices for competency development were highlighted, including the importance of governance and resources to oversee competency framework development and implementation, and workforce planning. Experiential learning and competency-based training were commonly identified as best practices for building competencies. A comprehensive understanding of public health competency development-through developing and incorporating foundational and discipline-specific competencies, mapping student and practitioner training to competency frameworks, and incorporating best practices-will enable public health to create skills and an adaptable workforce capable of addressing complex public health issues.
Collapse
Affiliation(s)
| | | | | | | | - Jennifer E. McWhirter
- Department of Population Medicine, Ontario Veterinary College, University of Guelph, Guelph, ON, Canada
| |
Collapse
|
8
|
Pramila-Savukoski S, Jarva E, Kuivila HM, Juntunen J, Koskenranta M, Kääriäinen M, Mikkonen K. Generic competence among health sciences students in higher education - A cross-sectional study. NURSE EDUCATION TODAY 2024; 133:106036. [PMID: 37992578 DOI: 10.1016/j.nedt.2023.106036] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/29/2023] [Revised: 10/31/2023] [Accepted: 11/08/2023] [Indexed: 11/24/2023]
Abstract
BACKGROUND Highly competent health care experts are needed for the development of the social and health care sectors. More knowledge is needed on the levels of generic competencies that health sciences experts possess, particularly in the context of complex decision-making. OBJECTIVES To describe self-evaluated generic competence of health sciences students and its associated factors. DESIGN A cross-sectional observational study design. PARTICIPANTS A total of 291 health science students in five universities in Finland participated in this study during the spring of 2022. METHODS The data was collected by using the HealthGenericCom instrument with 88 items and 8 sum dimensions using a five-point Likert scale (1-poor to 5-excellent): 1) competence in leadership, administration, and finance; 2) people-centred guiding competence; 3) competence of health promotion; 4) competence of evidence-based practice; 5) digital competence; 6) competence in work well-being and self-management; 7) competence in collaboration and problem-solving, and 8) competence in societal interaction. The K-means cluster algorithm was used to classify generic competence profiles to identify the profiles of health sciences students. RESULTS Four generic health sciences competence profiles (A = 18 %, B = 23 %, C = 33 %, D = 26 %) were identified. Profile A demonstrated the lowest level of most generic competencies in health sciences. Digital competence was shown to be at the lowest level among the participants, whereas competence in collaboration, problem-solving, and health promotion was evaluated as the highest competence level. The students evaluated their competence as being higher when they were older, were currently engaged in master's degree programmes, had completed work-based practical training in social and health care, and had varied work experiences or held leading positions. CONCLUSIONS Students need to improve their generic competencies in health sciences, with a particular focus on developing their digital competence. More focus should be given to work-based practical training.
Collapse
Affiliation(s)
| | - Erika Jarva
- Research Unit of Health Sciences and Technology, University of Oulu, Oulu, Finland.
| | - Heli-Maria Kuivila
- Research Unit of Health Sciences and Technology, University of Oulu, Oulu, Finland.
| | - Jonna Juntunen
- Research Unit of Health Sciences and Technology, University of Oulu, Oulu, Finland.
| | - Miro Koskenranta
- Research Unit of Health Sciences and Technology, University of Oulu, Oulu, Finland.
| | - Maria Kääriäinen
- Medical Research Center Oulu, Oulu University Hospital, Oulu, Finland.
| | - Kristina Mikkonen
- Medical Research Center Oulu, Oulu University Hospital, Oulu, Finland.
| |
Collapse
|
9
|
Holderried F, Stegemann-Philipps C, Herschbach L, Moldt JA, Nevins A, Griewatz J, Holderried M, Herrmann-Werner A, Festl-Wietek T, Mahling M. A Generative Pretrained Transformer (GPT)-Powered Chatbot as a Simulated Patient to Practice History Taking: Prospective, Mixed Methods Study. JMIR MEDICAL EDUCATION 2024; 10:e53961. [PMID: 38227363 PMCID: PMC10828948 DOI: 10.2196/53961] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/25/2023] [Revised: 12/09/2023] [Accepted: 12/14/2023] [Indexed: 01/17/2024]
Abstract
BACKGROUND Communication is a core competency of medical professionals and of utmost importance for patient safety. Although medical curricula emphasize communication training, traditional formats, such as real or simulated patient interactions, can present psychological stress and are limited in repetition. The recent emergence of large language models (LLMs), such as generative pretrained transformer (GPT), offers an opportunity to overcome these restrictions. OBJECTIVE The aim of this study was to explore the feasibility of a GPT-driven chatbot to practice history taking, one of the core competencies of communication. METHODS We developed an interactive chatbot interface using GPT-3.5 and a specific prompt including a chatbot-optimized illness script and a behavioral component. Following a mixed methods approach, we invited medical students to voluntarily practice history taking. To determine whether GPT provides suitable answers as a simulated patient, the conversations were recorded and analyzed using quantitative and qualitative approaches. We analyzed the extent to which the questions and answers aligned with the provided script, as well as the medical plausibility of the answers. Finally, the students filled out the Chatbot Usability Questionnaire (CUQ). RESULTS A total of 28 students practiced with our chatbot (mean age 23.4, SD 2.9 years). We recorded a total of 826 question-answer pairs (QAPs), with a median of 27.5 QAPs per conversation and 94.7% (n=782) pertaining to history taking. When questions were explicitly covered by the script (n=502, 60.3%), the GPT-provided answers were mostly based on explicit script information (n=471, 94.4%). For questions not covered by the script (n=195, 23.4%), the GPT answers used 56.4% (n=110) fictitious information. Regarding plausibility, 842 (97.9%) of 860 QAPs were rated as plausible. Of the 14 (2.1%) implausible answers, GPT provided answers rated as socially desirable, leaving role identity, ignoring script information, illogical reasoning, and calculation error. Despite these results, the CUQ revealed an overall positive user experience (77/100 points). CONCLUSIONS Our data showed that LLMs, such as GPT, can provide a simulated patient experience and yield a good user experience and a majority of plausible answers. Our analysis revealed that GPT-provided answers use either explicit script information or are based on available information, which can be understood as abductive reasoning. Although rare, the GPT-based chatbot provides implausible information in some instances, with the major tendency being socially desirable instead of medically plausible information.
Collapse
Affiliation(s)
- Friederike Holderried
- Tübingen Institute for Medical Education, Eberhard Karls University, Tübingen, Germany
| | | | - Lea Herschbach
- Tübingen Institute for Medical Education, Eberhard Karls University, Tübingen, Germany
| | - Julia-Astrid Moldt
- Tübingen Institute for Medical Education, Eberhard Karls University, Tübingen, Germany
| | - Andrew Nevins
- Division of Infectious Diseases, Stanford University School of Medicine, Stanford, CA, United States
| | - Jan Griewatz
- Tübingen Institute for Medical Education, Eberhard Karls University, Tübingen, Germany
| | - Martin Holderried
- Department of Medical Development, Process and Quality Management, University Hospital Tübingen, Tübingen, Germany
| | - Anne Herrmann-Werner
- Tübingen Institute for Medical Education, Eberhard Karls University, Tübingen, Germany
| | - Teresa Festl-Wietek
- Tübingen Institute for Medical Education, Eberhard Karls University, Tübingen, Germany
| | - Moritz Mahling
- Tübingen Institute for Medical Education, Eberhard Karls University, Tübingen, Germany
- Department of Diabetology, Endocrinology, Nephrology, Section of Nephrology and Hypertension, University Hospital Tübingen, Tübingen, Germany
| |
Collapse
|
10
|
Talus E, Seppänen H, Mikkonen K, Palomaa AK, Pölkki T. The competence of neonatal intensive care nurses: A systematic review. NURSE EDUCATION TODAY 2023; 128:105892. [PMID: 37393653 DOI: 10.1016/j.nedt.2023.105892] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/23/2023] [Revised: 06/04/2023] [Accepted: 06/22/2023] [Indexed: 07/04/2023]
Abstract
OBJECTIVE The objective was to conduct a systematic review describing the competencies required from nurses working in neonatal intensive care settings. DESIGN Systematic review. DATA SOURCES A total of eight databases, including PubMed, Scopus, CINAHL, MEDLINE, Mednar, Web of Science, ProQuest and Medic, were screened for relevant literature during February and September 2022. REVIEW METHODS The systematic review process followed Joanna Briggs Institute guidelines. The inclusion criteria were: 1) (P = population) registered nurses; 2) (C = concept) the competence; 3) (C = context) nursing in neonatal intensive care units; and 4) cross-sectional study as study method. A critical appraisal tool for cross-sectional studies from Joanna Briggs Institute was used by two independent reviewers. After data extraction, thematic analysis was performed. RESULTS The database searches yielded a total of 8887 studies and after two independent evaluations, a total of 50 eligible studies were identified comprising of 7536 registered nurses working in neonatal intensive care units across 19 countries. The studies described four main competence themes: 1) neonatal care interventions; 2) caring for a dying infant; 3) family-centered care; and 4) neonatal intensive care interventions. CONCLUSION Previous research has focused on evaluating specific competencies that are necessary in the neonatal intensive care setting. There is a need for research concerning the overall competence of nurses working in neonatal intensive care units. There was a lot of variety within the quality of the eligible studies and within the used instruments. PROTOCOL REGISTRATION This systematic review was registered in Prospero (PROSPERO 2022 CRD42022308028).
Collapse
Affiliation(s)
- Eeva Talus
- Research Unit of Health Sciences and Technology, University of Oulu, Finland Medical Research Center Oulu, Oulu University Hospital and University of Oulu, Oulu, Finland; The Finnish Centre for Evidence-Based Health Care: A Joanna Briggs Institute, The Finnish Centre of Excellence, Helsinki, Finland.
| | - Hanna Seppänen
- Research Unit of Health Sciences and Technology, University of Oulu, Finland Medical Research Center Oulu, Oulu University Hospital and University of Oulu, Oulu, Finland; The Finnish Centre for Evidence-Based Health Care: A Joanna Briggs Institute, The Finnish Centre of Excellence, Helsinki, Finland
| | - Kristina Mikkonen
- Research Unit of Health Sciences and Technology, University of Oulu, Finland Medical Research Center Oulu, Oulu University Hospital and University of Oulu, Oulu, Finland; The Finnish Centre for Evidence-Based Health Care: A Joanna Briggs Institute, The Finnish Centre of Excellence, Helsinki, Finland
| | - Anna-Kaija Palomaa
- Research Unit of Health Sciences and Technology, University of Oulu, Finland Medical Research Center Oulu, Oulu University Hospital and University of Oulu, Oulu, Finland; The Finnish Centre for Evidence-Based Health Care: A Joanna Briggs Institute, The Finnish Centre of Excellence, Helsinki, Finland
| | - Tarja Pölkki
- Research Unit of Health Sciences and Technology, University of Oulu, Finland Medical Research Center Oulu, Oulu University Hospital and University of Oulu, Oulu, Finland; The Finnish Centre for Evidence-Based Health Care: A Joanna Briggs Institute, The Finnish Centre of Excellence, Helsinki, Finland
| |
Collapse
|
11
|
Chen S, Wang R, Xu N, Zhang J, Liu Y, Cong S, Sun X, Zhu Z, Zhou H, Gu P, Zhang A. Identification of factors influencing core competence promotion among professional nurses and midwives: A qualitative study using the COM-B model. Nurse Educ Pract 2023; 69:103619. [DOI: 10.1016/j.nepr.2023.103619] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2022] [Revised: 02/27/2023] [Accepted: 03/11/2023] [Indexed: 04/08/2023]
|
12
|
Jarva E, Oikarinen A, Andersson J, Tomietto M, Kääriäinen M, Mikkonen K. Healthcare professionals' digital health competence and its core factors; development and psychometric testing of two instruments. Int J Med Inform 2023; 171:104995. [PMID: 36689840 DOI: 10.1016/j.ijmedinf.2023.104995] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2022] [Revised: 01/10/2023] [Accepted: 01/11/2023] [Indexed: 01/19/2023]
Abstract
BACKGROUND Healthcare professionals' digital health competence is an important phenomenon to study as healthcare practices are changing globally. Recent research aimed to define this complex phenomenon and identify the current state of healthcare professionals' competence in digitalisation but did not include an overarching outlook when measuring digital health competence of healthcare professionals. OBJECTIVES The purpose of this study was to develop and psychometrically validate two self-assessed instruments measuring digital health competence and factors associating with it. METHODS The study followed three phases of instrument development and validation: 1) conceptualisation and item pool generation; 2) content validity testing and pilot study; and 3) construct validity and reliability testing. The conceptual background of the instruments was based on individual interviews conducted with healthcare professionals (n = 20) and previous systematic reviews. A total of 17 experts assessed the instrument's content validity. Face validity was evaluated by a group of healthcare professionals (n = 20). Data collection from 817 professionals took place in spring-summer 2022 in nine organisations. Construct validity was confirmed with exploratory factor analysis. Cronbach's alpha was used to assess the internal consistency of the instruments. RESULTS The instrument development and validation process resulted in two instruments: DigiHealthCom and DigiComInf. DigiHealthCom included 42 items in 5 factors related to digital health competence, and DigiComInf included 15 items in 3 factors related to educational and organisational factors associated with digital health competence. The DigiHealthCom instrument explained 68.9 % of the total variance and the factors' Cronbach alpha values varied between 0.91 and 0.97. The DigiComInf instrument explained 59.6 % of the total variance and the factors' Cronbach alpha values varied between 0.76 and 0.88. CONCLUSIONS The two instruments gave valid and reliable results in psychometric testing. The instruments could be used to evaluate healthcare professionals' digital health competence and associated factors.
Collapse
Affiliation(s)
- E Jarva
- Research Unit of Health Sciences and Technology, University of Oulu, Oulu, Finland.
| | - A Oikarinen
- Research Unit of Health Sciences and Technology, University of Oulu, Oulu, Finland; Medical Research Center Oulu, Wellbeing Services County of North Ostrobothnia, Oulu, Finland.
| | - J Andersson
- Academy of Health and Welfare, Halmstad University, Halmstad, Sweden
| | - M Tomietto
- Research Unit of Health Sciences and Technology, University of Oulu, Oulu, Finland; Department of Nursing, Midwifery and Health, Faculty of Health and Life Sciences, Northumbria University, Newcastle upon Tyne, UK.
| | - M Kääriäinen
- Research Unit of Health Sciences and Technology, University of Oulu, Oulu, Finland; Medical Research Center Oulu, Wellbeing Services County of North Ostrobothnia, Oulu, Finland
| | - K Mikkonen
- Research Unit of Health Sciences and Technology, University of Oulu, Oulu, Finland; Medical Research Center Oulu, Wellbeing Services County of North Ostrobothnia, Oulu, Finland.
| |
Collapse
|
13
|
Westein MPD, Koster AS, Daelmans HEM, Bouvy ML, Kusurkar RA. How progress evaluations are used in postgraduate education with longitudinal supervisor-trainee relationships: a mixed method study. ADVANCES IN HEALTH SCIENCES EDUCATION : THEORY AND PRACTICE 2023; 28:205-222. [PMID: 36094680 PMCID: PMC9992254 DOI: 10.1007/s10459-022-10153-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/30/2021] [Accepted: 08/07/2022] [Indexed: 06/15/2023]
Abstract
The combination of measuring performance and giving feedback creates tension between formative and summative purposes of progress evaluations and can be challenging for supervisors. There are conflicting perspectives and evidence on the effects supervisor-trainee relationships have on assessing performance. The aim of this study was to learn how progress evaluations are used in postgraduate education with longitudinal supervisor-trainee relationships. Progress evaluations in a two-year community-pharmacy specialization program were studied with a mixed-method approach. An adapted version of the Canadian Medical Education Directives for Specialists (CanMEDS) framework was used. Validity of the performance evaluation scores of 342 trainees was analyzed using repeated measures ANOVA. Semi-structured interviews were held with fifteen supervisors to investigate their response processes, the utility of the progress evaluations, and the influence of supervisor-trainee relationships. Time and CanMEDS roles affected the three-monthly progress evaluation scores. Interviews revealed that supervisors varied in their response processes. They were more committed to stimulating development than to scoring actual performance. Progress evaluations were utilized to discuss and give feedback on trainee development and to add structure to the learning process. A positive supervisor-trainee relationship was seen as the foundation for feedback and supervisors preferred the roles of educator, mentor, and coach over the role of assessor. We found that progress evaluations are a good method for directing feedback in longitudinal supervisor-trainee relationships. The reliability of scoring performance was low. We recommend progress evaluations to be independent of formal assessments in order to minimize roles-conflicts of supervisors.
Collapse
Affiliation(s)
- Marnix P D Westein
- Department of Pharmaceutical Sciences, Utrecht University, Universiteitsweg 99, 3584, CG, Utrecht, The Netherlands.
- Research in Education, Faculty of Medicine Vrije Universiteit, Amsterdam, The Netherlands.
- The Royal Dutch Pharmacists Association (KNMP), The Hague, The Netherlands.
| | - A S Koster
- Department of Pharmaceutical Sciences, Utrecht University, Universiteitsweg 99, 3584, CG, Utrecht, The Netherlands
| | - H E M Daelmans
- Programme Director Master of Medicine, Faculty of Medicine Vrije Universiteit, Amsterdam, The Netherlands
| | - M L Bouvy
- Department of Pharmaceutical Sciences, Utrecht University, Universiteitsweg 99, 3584, CG, Utrecht, The Netherlands
| | - R A Kusurkar
- Research in Education, Faculty of Medicine Vrije Universiteit, Amsterdam, The Netherlands
| |
Collapse
|
14
|
Eskolin SE, Inkeroinen S, Leino-Kilpi H, Virtanen H. Instruments for measuring empowering patient education competence of nurses: Systematic review. J Adv Nurs 2023. [PMID: 36808623 DOI: 10.1111/jan.15597] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/18/2022] [Revised: 01/04/2023] [Accepted: 02/05/2023] [Indexed: 02/23/2023]
Abstract
AIM This review aimed to identify validated self-reported instruments used to measure nurses' competence or attribute(s) of competence in empowering patient education, to describe their development and main content and critically appraise and summarize the quality of the instruments. DESIGN Systematic review. DATA SOURCES Electronic databases of PubMed, CINAHL and ERIC were searched from January 2000 to May 2022. REVIEW METHODS Data was extracted following predetermined inclusion criteria. With the support of the research group, two researchers performed data selection and appraised the methodological quality using the COnsensus-based Standards for the selection of health status Measurement INstruments checklist (COSMIN). RESULTS A total of 19 studies reporting 11 instruments were included. The instruments measured varied attributes of competence and the contents were heterogenous reflecting the complex nature of both empowerment and competence as concepts. Overall, the reported psychometric properties of the instruments and methodological quality of the studies were at least adequate. However, there was variation in the testing of the instruments' psychometric properties and lack of evidence limited the evaluation of both the methodological quality of the studies and quality of instruments. CONCLUSION The psychometric properties of the existing instruments assessing nurses' competence in empowering patient education need to be tested further, and future instrument development should be built on a clearer definition of empowerment as well as on more rigorous testing and reporting. In addition, continued efforts to clarify and define both empowerment and competence on the conceptual level are needed. IMPACT Evidence on nurses' competence in empowering patient education and its valid and reliable assessment instruments is scarce. Existing instruments are heterogenous and are often missing proper testing of validity and reliability. These findings contribute to further research on developing and testing the instruments of competence in empowering patient education and strengthening nurses' empowering patient education competence in the clinical practice.
Collapse
Affiliation(s)
| | - Saija Inkeroinen
- Department of Nursing Sciences, University of Turku, Turku, Finland
| | - Helena Leino-Kilpi
- Department of Nursing Sciences, University of Turku, Turku, Finland.,Turku University Hospital, Turku, Finland
| | - Heli Virtanen
- Department of Nursing Sciences, University of Turku, Turku, Finland
| |
Collapse
|
15
|
Ma H, Niu A, Sun L, Luo Y. Development and evaluation of competency-based curriculum for continuing professional development among military nurses: a mixed methods study. BMC MEDICAL EDUCATION 2022; 22:793. [PMID: 36384711 PMCID: PMC9667581 DOI: 10.1186/s12909-022-03846-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/12/2022] [Accepted: 10/31/2022] [Indexed: 06/16/2023]
Abstract
BACKGROUND Continuing professional development (CPD) is essential for career progression and maintaining military nursing competency. A well-designed CPD programme can improve the effectiveness of transforming knowledge and skills in healthcare organisations. This study aimed to develop a competency-based CPD curriculum for military nurses in China and evaluate its effectiveness from a developmental pilot study. METHODS In phase one, a two-round Delphi was conducted to design a competency-based curriculum of CPD based on a clinical ladder model among military nurses. In phase two, the curriculum of one CPD programme was redesigned, and a pilot quasi-experiment was conducted to evaluate the effectiveness of this programme. RESULTS A competency-based curriculum was developed for primary, intermediate, and senior titles, respectively. The trainees' overall satisfaction with the redesigned CPD programme was 100%. The four themes in the qualitative data were: 1) learning motivation and learning barriers; 2) professional growth; 3) role model promoted career planning; 4) learning environment mattered. CONCLUSION This study developed a competency-based curriculum for continuing professional development among military nurses that can be used in designing CPD programmes. Competency-based curriculum can be utilised in the CPD activities to facilitate the improvement of nursing competency.
Collapse
Affiliation(s)
- Huijuan Ma
- School of Nursing, Third Military Medical University/Army Medical University, No. 30 Gaotanyan Street, Shapingba District, Chongqing, P.R. China
| | - Aifang Niu
- School of Nursing, Third Military Medical University/Army Medical University, No. 30 Gaotanyan Street, Shapingba District, Chongqing, P.R. China
| | - Li Sun
- Health Management Center, First Affiliated Hospital, Army Medical University, No. 30 Gaotanyan Street, Shapingba District, Chongqing, P.R. China
| | - Yu Luo
- School of Nursing, Third Military Medical University/Army Medical University, No. 30 Gaotanyan Street, Shapingba District, Chongqing, P.R. China
| |
Collapse
|
16
|
Westein MPD, Koster AS, Daelmans HEM, Collares CF, Bouvy ML, Kusurkar RA. Validity evidence for summative performance evaluations in postgraduate community pharmacy education. CURRENTS IN PHARMACY TEACHING & LEARNING 2022; 14:701-711. [PMID: 35809899 DOI: 10.1016/j.cptl.2022.06.014] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/15/2021] [Revised: 05/30/2022] [Accepted: 06/09/2022] [Indexed: 06/15/2023]
Abstract
INTRODUCTION Workplace-based assessment of competencies is complex. In this study, the validity of summative performance evaluations (SPEs) made by supervisors in a two-year longitudinal supervisor-trainee relationship was investigated in a postgraduate community pharmacy specialization program in the Netherlands. The construct of competence was based on an adapted version of the 2005 Canadian Medical Education Directive for Specialists (CanMEDS) framework. METHODS The study had a case study design. Both quantitative and qualitative data were collected. The year 1 and year 2 SPE scores of 342 trainees were analyzed using confirmatory factor analysis and generalizability theory. Semi-structured interviews were held with 15 supervisors and the program director to analyze the inferences they made and the impact of SPE scores on the decision-making process. RESULTS A good model fit was found for the adapted CanMEDS based seven-factor construct. The reliability/precision of the SPE measurements could not be completely isolated, as every trainee was trained in one pharmacy and evaluated by one supervisor. Qualitative analysis revealed that supervisors varied in their standards for scoring competencies. Some supervisors were reluctant to fail trainees. The competency scores had little impact on the high-stakes decision made by the program director. CONCLUSIONS The adapted CanMEDS competency framework provided a valid structure to measure competence. The reliability/precision of SPE measurements could not be established and the SPE measurements provided limited input for the decision-making process. Indications of a shadow assessment system in the pharmacies need further investigation.
Collapse
Affiliation(s)
- Marnix P D Westein
- Department of Pharmaceutical Sciences, Utrecht University, Royal Dutch Pharmacists Association (KNMP), Research in Education, Faculty of Medicine Vrije Universiteit, Amsterdam, the Netherlands.
| | - Andries S Koster
- Department of Pharmaceutical Sciences, Utrecht University, Utrecht, the Netherlands.
| | - Hester E M Daelmans
- Master's programme of Medicine, Faculty of Medicine Vrije Universiteit, Amsterdam, the Netherlands.
| | - Carlos F Collares
- Maastricht University Faculty of Health Medicine and Life Sciences, Maastricht, the Netherlands.
| | - Marcel L Bouvy
- Department of Pharmaceutical Sciences, Utrecht University, Utrecht, the Netherlands.
| | - Rashmi A Kusurkar
- Research in Education, Faculty of Medicine Vrije Universiteit, Amsterdam, the Netherlands.
| |
Collapse
|
17
|
Edwards C, Thoirs K, Osborne B, Slade D, McDonald S, Lombardo P, Chandler A, Quinton A, Stoodley P, Taylor L, Childs J. Australian sonographer competency—A new framework. SONOGRAPHY 2022. [DOI: 10.1002/sono.12309] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Affiliation(s)
- Christopher Edwards
- School of Clinical Sciences, Faculty of Health Queensland University of Technology Brisbane Queensland Australia
| | - Kerry Thoirs
- Allied Health and Human Performance University of South Australia Adelaide South Australia Australia
| | - Brooke Osborne
- Allied Health and Human Performance University of South Australia Adelaide South Australia Australia
| | - Debbie Slade
- Australasian Society for Ultrasound in Medicine Chatswood New South Wales Australia
| | - Sandra McDonald
- Allied Health and Human Performance University of South Australia Adelaide South Australia Australia
- Australasian Society for Ultrasound in Medicine Chatswood New South Wales Australia
| | - Paul Lombardo
- Department of Medical Imaging and Radiation Sciences Monash University Clayton Victoria Australia
| | - Amanda Chandler
- Faculty of Science and Health Charles Sturt University Port Macquarie New South Wales Australia
| | - Ann Quinton
- School of Health, Medical and Applied Sciences Central Queensland University Sydney New South Wales Australia
- Sydney Medical School Nepean The University of Sydney Penrith New South Wales Australia
| | - Paul Stoodley
- Blacktown Clinical School and Research Centre, School of Medicine Western Sydney University Blacktown New South Wales Australia
| | - Lucy Taylor
- The Australian Institute of Healthcare Education St Leonards New South Wales Australia
| | - Jessie Childs
- Allied Health and Human Performance University of South Australia Adelaide South Australia Australia
| |
Collapse
|
18
|
Jung A, Balzer J, Braun T, Luedtke K. Identification of tools used to assess the external validity of randomized controlled trials in reviews: a systematic review of measurement properties. BMC Med Res Methodol 2022; 22:100. [PMID: 35387582 PMCID: PMC8985274 DOI: 10.1186/s12874-022-01561-5] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2021] [Accepted: 02/28/2022] [Indexed: 02/08/2023] Open
Abstract
Background Internal and external validity are the most relevant components when critically appraising randomized controlled trials (RCTs) for systematic reviews. However, there is no gold standard to assess external validity. This might be related to the heterogeneity of the terminology as well as to unclear evidence of the measurement properties of available tools. The aim of this review was to identify tools to assess the external validity of RCTs. It was further, to evaluate the quality of identified tools and to recommend the use of individual tools to assess the external validity of RCTs in future systematic reviews. Methods A two-phase systematic literature search was performed in four databases: PubMed, Scopus, PsycINFO via OVID, and CINAHL via EBSCO. First, tools to assess the external validity of RCTs were identified. Second, studies investigating the measurement properties of these tools were selected. The measurement properties of each included tool were appraised using an adapted version of the COnsensus based Standards for the selection of health Measurement INstruments (COSMIN) guidelines. Results 38 publications reporting on the development or validation of 28 included tools were included. For 61% (17/28) of the included tools, there was no evidence for measurement properties. For the remaining tools, reliability was the most frequently assessed property. Reliability was judged as “sufficient” for three tools (very low certainty of evidence). Content validity was rated as “sufficient” for one tool (moderate certainty of evidence). Conclusions Based on these results, no available tool can be fully recommended to assess the external validity of RCTs in systematic reviews. Several steps are required to overcome the identified difficulties to either adapt and validate available tools or to develop a better suitable tool. Trial registration Prospective registration at Open Science Framework (OSF): 10.17605/OSF.IO/PTG4D. Supplementary Information The online version contains supplementary material available at 10.1186/s12874-022-01561-5.
Collapse
Affiliation(s)
- Andres Jung
- Institute of Health Sciences, Department of Physiotherapy, Pain and Exercise Research Luebeck (P.E.R.L), Universität zu Lübeck, Ratzeburger Allee 160, 23562, Lübeck, Germany.
| | - Julia Balzer
- Faculty of Applied Public Health, European University of Applied Sciences, Werftstr. 5, 18057, Rostock, Germany
| | - Tobias Braun
- Division of Physiotherapy, Department of Applied Health Sciences, Hochschule für Gesundheit (University of Applied Sciences), Gesundheitscampus 6‑8, 44801, Bochum, Germany.,Department of Health, HSD Hochschule Döpfer (University of Applied Sciences), Waidmarkt 9, 50676, Cologne, Germany
| | - Kerstin Luedtke
- Institute of Health Sciences, Department of Physiotherapy, Pain and Exercise Research Luebeck (P.E.R.L), Universität zu Lübeck, Ratzeburger Allee 160, 23562, Lübeck, Germany
| |
Collapse
|
19
|
Caine AM, Herd C, Copley J, Turpin M, Fleming J. Development of the Student Practice Evaluation Form - Revised (Second Edition) (SPEF-R2): The second action research cycle. Aust Occup Ther J 2022; 69:391-402. [PMID: 35289425 PMCID: PMC9545048 DOI: 10.1111/1440-1630.12797] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2021] [Revised: 12/21/2021] [Accepted: 03/03/2022] [Indexed: 11/27/2022]
Abstract
INTRODUCTION The Student Practice Evaluation Form - Revised Edition (SPEF-R) was used across Australian universities from 2008 to 2020 to assess occupational therapy student performance on practice placement. Evolution of practice contexts, placement models and professional competency standards prompted updating of the tool. This paper describes the second and final action research cycle in the development of the SPEF-R2. METHODS Cycle 2 included three phases: (a) piloting of the SPEF-R2 and post-pilot survey to determine utility and applicability; (b) post-pilot focus groups/interviews; and (c) final amendments for publication and launch. Quantitative data were summarised descriptively, and qualitative data were analysed using qualitative content analysis and reported using illustrative quotes. RESULTS In Phase 1, 23 participants piloted the SPEF-R2 and completed a post-pilot survey. Results indicated participants found the SPEF-R2 relevant to a range of traditional and contemporary settings, easy to understand and an improvement over the previous version of the tool. Most participants found it more concise and less repetitive than the SPEF-R. Participants particularly valued additions regarding culturally responsive practice, student health and well-being and reflective practice. In Phase 2, five post-pilot focus groups/interviews were held, gathering a deeper understanding of its utility. Discussion highlighted desire for an additional core item within the self-management domain (Domain Two). Increased confidence in rating and provision of feedback on student performance were also evident. Reflection on findings led to final amendments and publication of the SPEF-R2. CONCLUSION Extensive consultation with the occupational therapy community informed the development of the SPEF-R2, reflecting contemporary practice and meeting the expectations of Australian occupational therapists. Action research was an effective approach to the development of the SPEF-R2. Use of the manual and training website and support from universities are paramount if practice educators are to use the tool effectively.
Collapse
Affiliation(s)
- Anne-Maree Caine
- School of Health & Rehabilitation Sciences, The University of Queensland, Brisbane, Australia.,School of Health Sciences & Social Work, Griffith University, Brisbane, Australia
| | - Chris Herd
- School of Health & Rehabilitation Sciences, The University of Queensland, Brisbane, Australia
| | - Jodie Copley
- School of Health & Rehabilitation Sciences, The University of Queensland, Brisbane, Australia
| | - Merrill Turpin
- School of Health & Rehabilitation Sciences, The University of Queensland, Brisbane, Australia
| | - Jennifer Fleming
- School of Health & Rehabilitation Sciences, The University of Queensland, Brisbane, Australia
| |
Collapse
|
20
|
Al-Jabri F, Kvist T, Sund R, Turunen H. Quality of care and patient safety at healthcare institutions in Oman: quantitative study of the perspectives of patients and healthcare professionals. BMC Health Serv Res 2021; 21:1109. [PMID: 34656110 PMCID: PMC8520619 DOI: 10.1186/s12913-021-07152-2] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2021] [Accepted: 10/06/2021] [Indexed: 11/23/2022] Open
Abstract
Background Oman’s healthcare system has rapidly transformed in recent years. A recent Report of Quality and Patient Safety has nevertheless highlighted decreasing levels of patient safety and quality culture among healthcare professionals. This indicates the need to assess the quality of care and patient safety from the perspectives of both patients and healthcare professionals. Objectives This study aimed to examine (1) patients’ and healthcare professionals’ perspectives on overall quality of care and patient safety standards at two tertiary hospitals in Oman and (2) which demographic characteristics are related to the overall quality of care and patient safety. Methods A cross-sectional study design was employed. Data were collected by two items: overall quality of care and patient safety, incorporated in the Revised Humane Caring Scale, and Healthcare Professional Core Competency Instrument. Questionnaires were distributed to (1) patients (n = 600) and (2) healthcare professionals (nurses and physicians) (n = 246) in three departments (medical, surgical and obstetrics and gynaecology) at two tertiary hospitals in Oman towards the end of 2018 and the beginning of 2019. Descriptive statistics and binary logistic regression were used for data analysis. Results A total of 367 patients and 140 healthcare professionals completed the questionnaires, representing response rates of 61.2% and 56.9%, respectively. Overall, quality of care and patient safety were perceived as high, with the healthcare professionals rating quality of care (M = 4.36; SD = 0.720) and patient safety (M = 4.39; SD = 0.675) slightly higher than the patients did (M = 4.23; SD = 0.706), (M = 4.22; SD = 0.709). The findings indicated an association between hospital variables and overall quality of care (OR = 0.095; 95% CI = 0.016–0.551; p = 0.009) and patient safety (OR = 0.153; 95% CI = 0.027–0.854; p = 0.032) among healthcare professionals. Additionally, an association between the admission/work area and participants’ perspectives on the quality of care (patients, OR = 0.257; 95% CI = 0.072–0.916; p = 0.036; professionals, OR = 0.093; 95% CI = 0.009–0.959; p = 0.046) was found. Conclusions The perspectives of both patients and healthcare professionals showed that they viewed both quality of care and patient safety as excellent, with slight differences, indicating a high level of patient satisfaction and competent healthcare delivery professionals. Such perspectives can provide meaningful and complementary insights on improving the overall standards of healthcare delivery systems. Supplementary Information The online version contains supplementary material available at 10.1186/s12913-021-07152-2.
Collapse
Affiliation(s)
- Fatma Al-Jabri
- Department of Nursing Science, University of Eastern Finland, P.O. Box 1627, 70211, Kuopio, Finland.
| | - Tarja Kvist
- Department of Nursing Science, University of Eastern Finland, P.O. Box 1627, 70211, Kuopio, Finland
| | - Reijo Sund
- Institute of Clinical Medicine, School of Medicine, Faculty of Health Sciences, University of Eastern Finland, P.O. Box 1627, 70211, Kuopio, Finland
| | - Hannele Turunen
- Department of Nursing Science, University of Eastern Finland, P.O. Box 1627, 70211, Kuopio, Finland
| |
Collapse
|
21
|
Prosen M, Kvas A, Bošković S, Ličen S. Cross-cultural adaptation and psychometric evaluation of the Slovenian version of the nurse professional competence scale. BMC Nurs 2021; 20:142. [PMID: 34380487 PMCID: PMC8356409 DOI: 10.1186/s12912-021-00664-6] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2021] [Accepted: 07/27/2021] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND The competency-based approach to the assessment of nursing practice has been adopted as a key policy in the developed world. The continual self-assessment of competence gives nurses the opportunity to reflect on their competencies and has a significant impact on the quality of nursing practice and patient safety. The study was designed to describe the process of cross-cultural adaptation and to assess the psychometric properties of the Slovenian version of a short form of the Nurse Professional Competence scale (NPC-SF) and to evaluate the efficacy of this instrument in a sample of registered nurses. METHODS A cross-sectional and validation study was conducted in 425 registered nurses to test the psychometric properties of the Slovenian version of a short form of the scale and to evaluate nurses' professional competence. A multilevel approach was used: Translation, back-translation, language validity, face and content validity, construct validity, and reliability of the Slovenian version of the scale were analysed respectively. Participants completed an online survey, with the data being collected between April and July 2020. RESULTS Factor analysis showed that the Slovenian version of the scale could be used in four dimensions explained with 65 % of the variance. Cronbach's α was 0.972. The four-factor model fit the data (RMSEA = 0.083, CFI = 0.731). Self-reported competence was high and rated higher by nurses employed at the tertiary level of healthcare, followed by nurses employed at the secondary and primary, and from social care institutions. Nurses with more years of experience assessed their competence higher. CONCLUSIONS The NPC-SF helps understand and identify nurses' self-reported core competencies in clinical settings, thereby providing an important predictor of the professional development of nursing. The Slovenian version of the scale demonstrated acceptable psychometric properties and may be used in research and clinical practice to evaluate nurses' professional competence.
Collapse
Affiliation(s)
- Mirko Prosen
- Department of Nursing, Faculty of Health Sciences, University of Primorska, Polje 42, 6310, Izola, Slovenia
| | - Andreja Kvas
- Department of Nursing, Faculty of Health Sciences, University of Ljubljana, Zdravstvena pot 5, 1000, Ljubljana, Slovenia
| | - Sandra Bošković
- Department of Nursing, Faculty of Health Studies, University of Rijeka, Viktora Cara Emina 5, 51000, Rijeka, Croatia
| | - Sabina Ličen
- Department of Nursing, Faculty of Health Sciences, University of Primorska, Polje 42, 6310, Izola, Slovenia.
| |
Collapse
|
22
|
Suhonen R, Lahtinen K, Stolt M, Pasanen M, Lemetti T. Validation of the Patient-Centred Care Competency Scale Instrument for Finnish Nurses. J Pers Med 2021; 11:jpm11060583. [PMID: 34205569 PMCID: PMC8235000 DOI: 10.3390/jpm11060583] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2021] [Revised: 06/04/2021] [Accepted: 06/17/2021] [Indexed: 12/30/2022] Open
Abstract
Patient-centredness in care is a core healthcare value and an effective healthcare delivery design requiring specific nurse competences. The aim of this study was to assess (1) the reliability, validity, and sensitivity of the Finnish version of the Patient-centred Care Competency (PCC) scale and (2) Finnish nurses' self-assessed level of patient-centred care competency. The PCC was translated to Finnish (PCC-Fin) before data collection and analyses: descriptive statistics; Cronbach's alpha coefficients; item analysis; exploratory and confirmatory factor analyses; inter-scale correlational analysis; and sensitivity. Cronbach's alpha coefficients were acceptable, high for the total scale, and satisfactory for the four sub-scales. Item analysis supported the internal homogeneity of the items-to-total and inter-items within the sub-scales. Explorative factor analysis suggested a three-factor solution, but the confirmatory factor analysis confirmed the four-factor structure (Tucker-Lewis index (TLI) 0.92, goodness-of-fit index (GFI) 0.99, root mean square error of approximation (RMSEA) 0.065, standardized root mean square residual (SRMR) 0.045) with 61.2% explained variance. Analysis of the secondary data detected no differences in nurses' self-evaluations of contextual competence, so the inter-scale correlations were high. The PCC-Fin was found to be a reliable and valid instrument for the measurement of nurses' patient-centred care competence. Rasch model analysis would provide some further information about the item level functioning within the instrument.
Collapse
Affiliation(s)
- Riitta Suhonen
- Department of Nursing Science, University of Turku, 20014 Turku, Finland; (K.L.); (M.S.); (M.P.); (T.L.)
- Turku University Hospital, 20014 Turku, Finland
- City of Turku, Welfare Division, 20014 Turku, Finland
- Correspondence: ; Tel.: +358-50-435-0662
| | - Katja Lahtinen
- Department of Nursing Science, University of Turku, 20014 Turku, Finland; (K.L.); (M.S.); (M.P.); (T.L.)
- City of Helsinki, Department of Social and Health Care, 00099 Helsinki, Finland
| | - Minna Stolt
- Department of Nursing Science, University of Turku, 20014 Turku, Finland; (K.L.); (M.S.); (M.P.); (T.L.)
| | - Miko Pasanen
- Department of Nursing Science, University of Turku, 20014 Turku, Finland; (K.L.); (M.S.); (M.P.); (T.L.)
| | - Terhi Lemetti
- Department of Nursing Science, University of Turku, 20014 Turku, Finland; (K.L.); (M.S.); (M.P.); (T.L.)
- University Hospital, 00029 Helsinki, Finland
| |
Collapse
|