Construction of evaluation indexes of nursing students' quality and safety competencies: A Delphi study in China

Construction of a nursing assessment framework for patients in anaesthesia recovery period: A modified Delphi study

AIM

To construct a nursing assessment framework for patients in anaesthesia recovery period.

DESIGN

A three-round modified Delphi method was employed to capture the consensus of 22 panellists.

METHODS

The initial items in the nursing assessment framework for patients in anaesthesia recovery period were developed based on the mini-clinical evaluation exercise (mini-CEX). A panel of 22 experts participated in this study. The panellists have more than 10 years of experience in either clinical anaesthesia, or post-anesthesia nursing, or operating room nursing, or surgical intensive nursing. Between March and April 2023, the panellists evaluated and recommended revisions to the initial framework.

RESULTS

This study resulted in the development of a nursing assessment framework for patients in anaesthesia recovery period. The initial version of the framework consisted of six dimensions with 27 items. Six items were modified after the first round of consultation. After the second round, five modifications and four deletions were made based on expert opinion. The third round resulted in a convergence of expert opinion. The framework, which consists of 24 items across five dimensions, was refined. The five dimensions are as follows: History-taking, Physical assessment, Clinical judgement, Organizational efficiency and Humanistic concern.

CONCLUSION

The nursing assessment framework for patients in anaesthesia recovery period was reached consensus between the 22 experts' opinions.

IMPLICATIONS FOR THE PROFESSION AND PATIENT CARE

The assessment framework constructed in this study could be used for the process evaluation of post-anesthesia nursing. The framework may guide perianesthesia nurses in the timely and effective assessment of patients during this critical phase of care. It may be used for perianesthesia nursing education or to evaluate nurses' assessment skills.

REPORTING METHOD

The study is reported in accordance with the Guidance on Conducting and Reporting DElphi Studies (CREDES) recommendations.

PATIENT OR PUBLIC CONTRIBUTION

No patient or public contribution.

Competency scale of quality and safety for greenhand nurses: instrument development and psychometric test

BACKGROUND

Guaranteeing nursing service safety and quality is a prioritized issue in the healthcare setting worldwide. However, there still lacks a valid scale to measure the quality and safety competencies of newly graduated nurses globally.

METHODS

This scale was developed in two phases. In Phase One, a literature review and three-round e-Delphi were conducted to generate the initial item pool; while in Phase Two, five experts tested the content validity of the scale. The construct validity was evaluated using confirmatory factor analysis (CFA), and the data were collected among 1,221 newly graduated nursing students between May, 2017 and August, 2017. Finally, the internal consistency reliability and test-retest reliability were tested.

RESULTS

The final version's Competency Scale of Quality and Safety (CSQS) was confirmed by the CFA involving 64 items in six dimensions, including patient-center care, safety, evidence-based practice, collaboration and teamwork, continuous quality improvement, and informatics. The results of data showed that the data supported the modified model of CSQS (Standardized Root Mean Square Residual = 0.03, p = 0.053, Adjusted Goodness of Normed Fit Index = 1.00, Root Mean Square Error of Approximation = 0.007, Fit Index = 0.95, Goodness of Fit Index = 0.97, χ2/df = 1.06), and the standardized factor loadings of items were from 0.59 to 0.74 (p < 0.05). The internal consistency reliability of the total scale was 0.98, and the test-retest reliability was 0.89.

CONCLUSIONS

CSQS was a valid and reliable instrument to measure the safety and quality abilities of greenhand nurses, and could be fully utilized by nursing students, greenhand nurses, nursing educators, as well as hospital nursing managers.

Developing geriatric nursing micro-credentials for undergraduate nursing students based on training objectives: A modified Delphi study

BACKGROUND

China's population has begun to age rapidly in the past several years and this trend is predicted to continue. In the face of this growing older population, the existing number of aged care personnel, especially medical care professionals, can hardly meet the demand for aged care services.

AIM

To develop geriatric nursing micro-credentials (MCs) for undergraduate nursing students based on standardized training objectives and to specify the learning goals and course modules that correspond to each specific MC.

DESIGN

Modified Delphi study.

METHODS

An initial set of geriatric nursing MCs were developed based on the training objectives. Expert group discussion (n=13) reviewed the clarity and intelligibility of the statements' wording and supplemented the framework. A three-round Delphi survey (n=15) was then employed to obtain a consensus on the learning goals and course modules via an online questionnaire. Descriptive statistics were used to analyze the data.

RESULTS

The final geriatric nursing MCs consisted of six courses, namely fundamentals of geriatric nursing (8 modules), geriatric sociology (6 modules), geriatric clinical nursing (3 modules), geriatric psychological nursing (8 modules), geriatric rehabilitation nursing (8 modules) and geriatric hospice care (10 modules).

CONCLUSION

Nursing faculty can use the geriatric nursing MCs developed in this study to train current undergraduate nursing students to become backups for current, fully credentialed geriatric caregivers.

Assessing evidence-based practice competencies of undergraduate nursing students using a developed multi-criteria decision-analysis model

AIM

The developed multi-criteria decision analysis model was used to identify the inter-influence relationships and key factors affecting the EBP competencies of UNSs, to assess the EBP competencies of UNSs and based on these results, to formulate an improvement strategy to enhance the EBP competencies of UNSs.

BACKGROUND

EBP is considered a core competency in international nursing practice. However, few studies have developed EBP evaluation models and applied them to assessing and improving the EBP competencies of UNSs.

DESIGN

This is a quantitative study with multi-criteria decision-analysis model.

METHODS

Firstly, the questionnaire was designed based on the characteristics of the DEMATEL and VIKOR-AS methods, which was completed by 17 nursing experts from a case hospital in Zhejiang Province, China. Subsequently, the DEMATEL method was used to analyze the inter-influence relationships among various criteria to determine their respective weights. Finally, the VIKOR method is utilized to integrate multiple criteria and their relative weights to assign comprehensive scores to each UNSs.

RESULTS

The use of the DEMATEL method reveals that "Knowledge (C1)", "Mastering the basic scientific research methods during the study of the undergraduate courses (C11)", "Being able to consult clinical experts appropriately when encountering problems in clinical practice (C23)" and "Understanding the importance of reading journals related to the nursing profession regularly (C34)" were critical influencing factors. "Skill (C2)," "Being able to explain the essential roles of the best research evidence in determining clinical practice (C15)," "Being able to apply the collected research evidence to the individual case in nursing care (C25)" and "Paying attention to using the evidence-based nursing practice concept to determine the best clinical practice (C35)" were the most influential factors. According to the VIKOR method, the performance of the UNSs in the case hospitals in terms of EBP competencies from highest to lowest was Student C, Student B and Student A. However, all of these students suffered from deficiencies at the knowledge level.

CONCLUSIONS

The application of the DEMATEL and VIKOR methods provides a systematic and comprehensive approach to the assessment of EBP competencies of UNSs. The lack of EBP competencies of UNSs in case hospitals is mainly reflected in knowledge level. To improve UNSs' EBP competencies, medical schools and hospital educators should propose short- and long-term strategies to improve knowledge.

Developing a psychological care competences framework for nurses in China: a mixed methods study

BACKGROUND

With social transformation, rapid economic development and deepening awareness of psychological health in China, people's demand for psychological health services is becoming increasingly urgent. A key challenge for Chinese medical organizations is to train enough qualified psychological care nurses. A greater understanding of psychological care competences (PCC) can help in clinical nurse selection, training, and assessment.

OBJECTIVE

To develop a PCC framework for Chinese nurses and obtain a consensus on the framework among experts.

METHODS

A descriptive mixed methods study was designed consisting of a literature review and semi-structured interviews followed by three Delphi rounds. The experts (n = 16) involved were nurses, nursing managers and educators from nine Chinese provinces with a specific interest in psychological care. Descriptive statistics assisted in data analysis.

RESULTS

Using the Iceberg Model as a theoretical foundation, five main dimensions and associated subdomains were integrated from 39 chosen articles. The semi-structured interviews with 24 nursing managers and nurses confirmed all of the themes from the literature review while generating new themes, both of which were incorporated into the initial PCC framework. After three Delphi rounds, the experts reached consensus on the PCC framework, including five domains (knowledge, skills, professional ethics, personal traits, internal motivations) and 22 subdomains with connotations. The response rate (RR) values for the three rounds of consultation were 80.00%, 87.50% and 92.86%, the composite reliability (Cr) values were 0.89-0.90, and the Kendall coordination coefficients were 0.155-0.200 (P < 0.05).

CONCLUSIONS

On the basis of the Iceberg Model, literature review and qualitative research methods along with Delphi technique were used to develop a scientific and systematic PCC framework. The research methods were feasible and the results were reliable, thereby providing a basis for adopting this framework into nursing education. A formal assessment tool should be developed to test the PCC of nurses in clinical practice.

Enhancing the moral courage of nurses: A modified Delphi study

BACKGROUND

The urgency of ensuring adequate moral courage in clinical nursing practice is evident. However, currently, there are few formal intervention plans targeted at enhancing the moral courage of nurses.

AIM

To develop a training program for improving the moral courage of nurses using the modified Delphi method.

RESEARCH DESIGN

A modified Delphi study.

PARTICIPANTS AND RESEARCH CONTEXT

From November to December 2022, a literature review and expert group discussion were conducted to develop a preliminary training plan framework. From January to March 2023, a two-round Delphi survey was performed, and a consensus was reached regarding the plan through online questionnaires. Descriptive statistics were used to analyze the data.

ETHICAL CONSIDERATIONS

This study was approved by the institutional ethics committee (No. 138, 30 August 2021). All participants provided written informed consent.

RESULTS

Consensus was reached on eight themes and 33 items to strengthen the moral courage training program for nurses.

CONCLUSIONS

Guided by a unified goal of moral education, a multi-level and acceptable intervention plan was designed to enhance the moral courage of nurses.

Competencies expected of undergraduate nursing students: A scoping review

AIM

Nursing competencies are crucial indicators for providing quality and safe care. The lack of international agreement in this field has caused problems in the generalization and application of findings. The purpose of this review is to identify the core competencies necessary for undergraduate nursing students to enter nursing work.

DATA SOURCES

We conducted a structured search using Scopus, MEDLINE (PubMed), Science Direct, CINAHL, Web of Science, and Google Scholar.

REVIEW METHODS

We conducted a scoping review using the methodology recommended by the Joanna Briggs Institute, supported by the PAGER framework, and guided by the PRISMA-ScR Checklist. Inclusion criteria included full-text articles in English, quantitative and qualitative research related to competencies for undergraduate students or newly graduated nurses, competency assessment, and tool development from 1970 to 2022. We excluded articles related to specific nursing roles, specific contexts, Master's and Ph.D. curricula, hospital work environment competencies, and editorial.

RESULTS

Out of 15,875 articles, we selected 43 studies, and data analysis with summative content analysis identified five themes named individualized care, professional nursing process, nursing administration, readiness, and professional development.

CONCLUSION

Considering the dynamics of competencies and their change with time, experience, and setting, it is necessary to update, localize, and levelling of the proposed competencies based on the culture of each country.

IMPACT

These competencies provide a guide for undergraduate nursing curriculum development and offer a framework for both clinical instruction and the evaluation of nursing students.

The development and validation of a standardised eight-station OSCE for registration of undergraduate nursing students: A Delphi study

AIM

To develop and validate a set of OSCEs for use as a nationally applicable final exam of undergraduate nursing students' clinical and professional competencies.

BACKGROUND

Tertiary recommendations for nursing registration require student achievement of a prerequisite level of both nursing knowledge and skill. Assessment of nursing skills prior to provision of nursing registration is an increasingly important focus of university nursing education. Objective Structured Clinical Examinations (OSCEs) are an appropriate tool for assessing the competencies of nursing students, but the mode and content of OSCEs varies widely. Thus, for nationally-based registration, development of a standardized set of OSCEs to determine the clinical competence of nursing students is important.

DESIGN

A modified Delphi study, informed by a systematic scoping review of relevant literature.

METHODS

A two-phase study was conducted. Initially, a scoping review was conducted to establish internationally agreed competences for graduating nursing students. These were included in an online questionnaire send to national experts to develop a validated and accepted nursing competency framework and associated implementation strategies. This was round 1 of a three-round modified Delphi study. A Content Validity Index (CVI) was calculated and thematic analysis was used to analyze the experts' opinions.

RESULTS

Details of a set of OSCEs for final exam of undergraduate nursing students were developed and validated. These OSCEs included nine competencies addressed in eight 10-minute stations.

CONCLUSION

A 'best-practice' OSCE evaluation system, designed from both international literature and the opinions of nation-wide experts was achieved. This well-designed OSCE was shown to be a reliable and valid method for assessing the clinical competence of nursing students. It reflected global procedures as well as the local conditions and Iranian expectations. The results of this study can be used by nursing schools across the country. They can also be used to model equivalent development of locally relevant OSCEs in countries around the world.

Development and feasibility of a theory-guided and evidence-based physical activity intervention in pregnant women with high risk for gestational diabetes mellitus: a pilot clinical trial

BACKGROUND

Physical activity has been utilized as an effective strategy to prevent gestational diabetes mellitus (GDM). However, most pregnant women with high risk for GDM did not achieve the recommended physical activity level. Furthermore, relevant physical activity protocols have varied without theory-guided and evidence-based tailored to pregnant women with high risk for GDM. This study aimed to develop and pilot test a theory-guided and evidence-based physical activity intervention protocol for pregnant women with high risk for GDM.

METHODS

The study design was guided by the Medical Research Council Framework for Developing and Evaluating Complex Intervention (the MRC framework). The preliminary protocol for physical activity intervention was developed based on self-efficacy theory, research evidence identified from systematic reviews and clinic trials, stakeholder engagement, context, and economic considerations. The preliminary intervention protocol was validated through a content validity study by an expert panel of 10 experts. A single-blinded randomized controlled trial (RCT) was designed to test the feasibility and acceptability of the intervention.

RESULTS

The validity of the preliminary intervention protocol was excellent as consensus was achieved. The final 13 sessions of self-efficacy enhancing physical activity intervention protocol were developed, including knowledge education, exercise clinic visits and video, and group discussions with face-to-face and online blended sessions. In the feasibility study, 34 pregnant women with high risk for GDM were randomized for the intervention (n = 17) or the control group (n = 17). The recruitment and retention rates were 82.9% and 58.9%, respectively. Women in the intervention group had a lower incidence of GDM (26.7% vs. 36.5%) than the control group (P >0.05). All participants were satisfied with the intervention and agreed that the intervention was helpful.

CONCLUSIONS

The developed self-efficacy-enhancing physical activity intervention is a feasible and acceptable intervention for enhancing physical activity among pregnant women with high risk for GDM and is ready to be tested in a more extensive RCT study.

TRIAL REGISTRATION

The study was registered on 4 February 2022 (ChiCTR2200056355) by the Chinese Clini Trial Registry (CHiCTR).

Construction of learning objectives and content for newly graduated nurses in tertiary teaching hospitals: A Delphi study

BACKGROUND

Transition education is a robust strategy to improve the core competency of newly graduated nurses and the quality of clinical nursing and ensure people's safety. Limited information about the learning objectives and educational content for newly graduated nurses in China was available.

OBJECTIVE

Construct the learning objectives and educational content for newly graduated nurses based on defined core competencies.

DESIGN

We used a literature review and the e-Delphi method to conduct this study.

SETTINGS

Ten tertiary teaching hospitals and six nursing schools in Zhejiang Province, China, were selected.

PARTICIPANTS

Experts (n = 21) were invited to the e-Delphi study.

METHODS

Based on seven competencies from the literature review and the research group discussions, we formed an initial set of objectives and specific educational content for newly graduated nurses. Subsequently, experts provided supportive and modification advice on the competencies, objectives, and specific content in the two Delphi rounds. The consensus percentage and the weight of each first-level, second-level, and third-level item were calculated.

RESULTS

Consensus was achieved on seven core competencies, 44 learning objectives, and 60 components of educational content. The positive coefficient of the two Delphi rounds was 100 %, the authority coefficient was 0.83 and 0.87, the proportion of experts who made suggestions was 71.40 %, the coefficient of variation (CV) was <0.25 (P < 0.05) except for two items and the Kendall coefficient (W) was 0.15-0.48 (P < 0.01).

CONCLUSION

The developed objectives and content framework provide a reference for implementing systematic and standardized education for newly graduated nurses.

Developing a professional competence framework for the master of nursing specialist degree program in China: A modified Delphi study

BACKGROUND

The urgency of ensuring adequate professional competence in clinical nursing practice is evident. However, there is little formal professional competence framework for the education of master's degree students in nursing specialist programs in China.

OBJECTIVE

To develop a professional competence framework for the Master of Nursing Specialist (MNS) degree program in China.

DESIGN

A modified Delphi study.

PARTICIPANTS

An expert panel discussion was held with 12 experts, and Delphi rounds were conducted with 24 experts.

METHODS

A literature review and an expert panel discussion were conducted to develop an initial competence framework. A two-round Delphi survey was employed to obtain a consensus on the framework through either an online or paper questionnaire. Descriptive statistics were used to analyze the data. The consensus threshold was set according to the mean (≥ 4.0), coefficient of variation (< 0.25), and consensus level of agreement (≥70 %).

RESULTS

A consensus on seven domains and 54 items of the professional framework for the MNS degree program was achieved. The framework domains included clinical practice (12 items), professional attitude (8 items), collaboration and communication (5 items), professional development (8 items), research (7 items), education (7 items), and administration (7 items).

CONCLUSION

The professional competence framework offers guidelines for MNS degree programs in China. Future research should focus on imbedding these competences in MNS degree programs to prepare qualified advanced practice nurses.

Construction of a competency evaluation index system for front-line nurses during the outbreak of major infectious diseases: A Delphi study

Introduction

As the frequency of infectious diseases rises, it’s more important than ever to pay attention to the competency level of front-line nurses as the primary force in front-line rescue, which has an impact on the quality of anti-epidemic response. This paper aims to construct the competency evaluation index system for front-line nurses during the outbreak of major infectious diseases.

Materials and methods

This study combined literature review, critical incident technique interviews, and semi-structured in-depth interviews, as well as two rounds of Delphi expert correspondence, to construct a competence evaluation index system for front-line nurses during the outbreak of major infectious diseases. The study used purposive sampling to select 26 experts from 11 provinces and cities across China to conduct two rounds of Delphi expert consultation, and the indicators were selected based on the mean importance score > 3.5 and the coefficient of variation < 0.25, and the weights of the indicators were calculated by the Analytic Hierarchy Process. The effective recovery rates of the two rounds of correspondence questionnaires were 93.1% and 96%.

Results

The effective recovery rates of the two rounds of correspondence questionnaires were 93.1% and 96%, the authority coefficients of experts were 0.96 and 0.98, the Kendall’s coordination coefficients of the first, second, and third level indexes were 0.281, 0.132, and 0.285 (P < 0.001), 0.259, 0.158, and 0.415 (P < 0.001). The final index system includes 4 primary indicators (Knowledge System of Infectious Diseases, Nursing Skills for Infectious Diseases, Related Professional Abilities for Infectious Diseases, and Comprehensive Quality), 10 secondary indicators, and 64 tertiary indicators.

Conclusion

The competency evaluation index system of front-line nurses during the outbreak of major infectious diseases is scientific, reasonable, and practical, which can provide a scientific basis for nursing managers to accurately understand, describe, analyze, and evaluate the competence level of nursing staff and scientifically implement the allocation of human resources in the future, as well as serve as a content framework for subsequent training programs.

A modified Delphi consensus on generic indicators for a low- and middle-income country's quality nursing care measurement

Aim

This study aimed to develop generic quality nursing care indicators for a low‐ and middle‐income country’s quality nursing care measurement through a modified Delphi consensus.

Design

A three‐round modified Delphi process guided the items' development and acceptance consensus.

Methods

Twenty‐four academic and clinical nursing experts from different parts of Nigeria participated in the Delphi rounds. In the first round, 96 items (structure – 31, process – 38, and outcome – 27) were distributed to the panellists through e‐mail. The same method guided round 2. In round 3, the panellists reached a consensus on the number and structure of the items.

Results

In round 1, the initial items were reduced to 75 that met the Delphi consensus. In round 2, the items were modified further and reduced to 74. In round 3, the experts reached a consensus on 70 items (structure – 28, process – 32, and outcome – 10).

Developing core competencies for clinical nurse educators: An e-Delphi-study

BACKGROUND

Clinical nurse educator plays an indispensable role in promoting the development of nursing staff and nursing students in clinical settings. Too few core competencies for clinical nurse educators applicable to a given clinical setting are developed and validated by the research process. A better understanding of the core competencies for clinical nurse educators can inform the selection, training, and evaluation of clinical nurse educator.

OBJECTIVE

To establish the core competencies for clinical nurse educators in China.

DESIGN

Focus group interviews and the e-Delphi method were used.

SETTINGS

This study was conducted in five teaching hospitals in China.

PARTICIPANTS

Participants (n = 61), including nurse managers, clinical nurse educators, staff nurses, and nursing students were recruited for focus group interviews and 25 experts were selected for the e-Delphi study.

METHODS

Based on a literature review and the focus group interviews, a preliminary set of clinical nurse educator's core competencies was formed. Subsequently, experts provided supportive and modification advice on core competencies in the two rounds e-Delphi study. The consensus percentage and the weight of each first-level, second-level index and its connotations were calculated.

RESULTS

Two rounds of online Delphi expert consultation were completed by 25 experts, and the consensus was achieved on four first-level indices, 16 second-level specific competencies, and its 57 connotations. The first-level index included clinical teaching competency, clinical nursing skills, management and leadership competency, and innovation and research competency. Moreover, the consensus level of all indices was >75%, the coefficient of variation (CV) was less than 0.25 (p < 0.05) and the Kendall coefficient (W) was 0.169-0.503 (P < 0.01).

CONCLUSIONS

The explicit statements of expected competencies for clinical nurse educators can be applied to diverse clinical scenarios and provide a reference for selection, training, and evaluation of the clinical nurse educators.