Construction on teaching quality evaluation indicator system of multi-disciplinary team (MDT) clinical nursing practice in China: A Delphi study

Constructing an evaluation index system for clinical nursing practice teaching quality using a Delphi method and analytic hierarchy process-based approach

BACKGROUND

The key step in evaluating the quality of clinical nursing practice education lies in establishing a scientific, objective, and feasible index system. Current assessments of clinical teaching typically measure hospital learning environments, classroom teaching, teaching competency, or the internship quality of nursing students. As a result, clinical evaluations are often insufficient to provide focused feedback, guide faculty development, or identify specific areas for clinical teachers to implement change and improvement. Therefore, the purpose of our study was to to construct a scientific, systematic, and clinically applicable evaluation index system of clinical nursing practice teaching quality and determine each indicator's weight to provide references for the scientific and objective evaluation of clinical nursing practice teaching quality.

METHODS

Based on the "Structure-Process-Outcome" theoretical model, a literature review and Delphi surveys were conducted to establish the evaluation index system of clinical nursing practice teaching quality. Analytic Hierarchy Process (AHP) was employed to determine the weight of each indicator.

RESULTS

The effective response rate for the two rounds of expert surveys was 100%. The expert authority coefficients were 0.961 and 0.975, respectively. The coefficient of variation for the indicators at each level ranged from 0 to 0.25 and 0 to 0.21, and the Kendall harmony coefficients were 0.209 and 0.135, respectively, with statistically significant differences (P < 0.001). The final established index system included 3 first-level, 10 second-level, and 29 third-level indicators. According to the weights computed by the AHP, first-level indicators were ranked as "Process quality" (39.81%), "Structure quality" (36.67%), and "Outcome quality" (23.52%). Among the secondary indicators, experts paid the most attention to "Teaching staff" (23.68%), "Implementation of teaching rules and regulations (14.14%), and "Teaching plans" (13.20%). The top three third-level indicators were "Level of teaching staff" (12.62%), "Structure of teaching staff" (11.06%), and "Implementation of the management system for teaching objects" (7.54%).

CONCLUSION

The constructed evaluation index system of clinical nursing practice teaching quality is scientific and reliable, with reasonable weight. The managers' focus has shifted from outcome-oriented to process-oriented approaches, and more focus on teaching team construction, teaching regulations implementation, and teaching design is needed to improve clinical teaching quality.

Constructing and implementing a performance evaluation indicator set for artificial intelligence decision support systems in pediatric outpatient clinics: an observational study

Artificial intelligence (AI) decision support systems in pediatric healthcare have a complex application background. As an AI decision support system (AI-DSS) can be costly, once applied, it is crucial to focus on its performance, interpret its success, and then monitor and update it to ensure ongoing success consistently. Therefore, a set of evaluation indicators was explicitly developed for AI-DSS in pediatric healthcare, enabling continuous and systematic performance monitoring. The study unfolded in two stages. The first stage encompassed establishing the evaluation indicator set through a literature review, a focus group interview, and expert consultation using the Delphi method. In the second stage, weight analysis was conducted. Subjective weights were calculated based on expert opinions through analytic hierarchy process, while objective weights were determined using the entropy weight method. Subsequently, subject and object weights were synthesized to form the combined weight. In the two rounds of expert consultation, the authority coefficients were 0.834 and 0.846, Kendall's coordination coefficient was 0.135 in Round 1 and 0.312 in Round 2. The final evaluation indicator set has three first-class indicators, fifteen second-class indicators, and forty-seven third-class indicators. Indicator I-1(Organizational performance) carries the highest weight, followed by Indicator I-2(Societal performance) and Indicator I-3(User experience performance) in the objective and combined weights. Conversely, 'Societal performance' holds the most weight among the subjective weights, followed by 'Organizational performance' and 'User experience performance'. In this study, a comprehensive and specialized set of evaluation indicators for the AI-DSS in the pediatric outpatient clinic was established, and then implemented. Continuous evaluation still requires long-term data collection to optimize the weight proportions of the established indicators.

Development and reliability testing of a risk factor and risk outcome assessment scale for nurses in "internet + nursing services" for the elderly

BACKGROUND

China is experiencing an aging population, leading to a significant demand for "Internet + nursing services" tailored for elderly individuals. However, there are many risk problems in the process of nurse service, which hinder the development of the service, and a scale is needed to assess the risk problems faced by nurses in "Internet + nursing services" for the elderly.

OBJECTIVE

The purpose of this study is to develop an assessment scale for risk factors and outcomes related to nurses' involvement in the "Internet + Nursing Service" for the elderly and to assess its reliability and validity.

METHODS

Based on literature analysis, focus group, the Delphi method, and a presurvey, we designed an initial scale. The initial scale comprised two sections: risk factors and risk outcomes for nurses. In January and February of 2023, nurses engaged in "Internet + nursing services" for the elderly in Shanxi Province were chosen through a convenience sampling technique for a questionnaire survey. Subsequently, item analysis and exploratory factor analysis were employed to refine and develop a test version of the scale further. A follow-up questionnaire survey was carried out in March and April 2023 using a similar approach. The reliability and validity of the scale were assessed through confirmatory factor analysis, culminating in the formation of the final scale.

RESULTS

The initial survey yielded 244 valid responses. The cumulative variance contributions of the two segments from the exploratory factor analysis were 84.584% and 90.089%, respectively. A subsequent survey garnered 220 valid responses. The confirmatory factor analysis results indicated: χ2/df = 2.086, comparative fit index (CFI) = 0.918, normative fit index (NLI) = 0.855, root mean square of residuals (RMR) = 0.045, and root mean square of error of approximation (RMSEA) = 0.070. These results demonstrate good structural, convergent, and discriminant validity. The content validity index at the item level (I-CVI) ranged between 0.875 and 1.000, while the content validity index at the scale level (S-CVI/Ave) was 0.941. Cronbach's alpha coefficient for the entire scale stood at 0.970. Moreover, the scale exhibited a split-half reliability of 0.876 and a retest reliability of 0.980 (p < 0.01).

CONCLUSION

The risk factors and risk outcomes associated with nurses involved in "Internet + nursing services" for elderly individuals, as developed in this study, demonstrate strong reliability and validity. They are well suited to the Chinese national context.

Effect of multidisciplinary health education based on lifestyle medicine on menopausal syndrome and lifestyle behaviors of menopausal women: A clinical controlled study

Background

Menopausal women may experience menopausal syndrome and long-term effects caused by low estrogen levels, such as senile dementia and osteoporosis in the elderly. Most menopausal women may have misconceptions about menopause and low use of pharmacological interventions. These misconceptions may damage the quality of life and miss the critical period for preventing senile diseases. Thus, enhancing the awareness of menopausal women regarding psychosocial and physical changes through health education programs was a way to improve positive attitudes toward menopause and make further treatment options.

Objectives

This study aimed to evaluate the effect of multidisciplinary health education based on lifestyle medicine on menopausal syndrome and lifestyle behaviors of menopausal women.

Methods

The study was conducted in several hospitals in Chongqing, China. The two groups were from different hospitals with similar medical levels in order to reduce information contamination. It was designed as a clinical controlled trial in which the intervention group (n = 100) and control group (n = 87) were matched for age, age at menarche, menopausal symptoms and drug use status at enrollment. Women in the intervention group received multidisciplinary health education based on lifestyle medicine for 2 months while those in the control group received routine outpatient health guidance. Menopausal syndrome, physical activity and dietary status of participants were assessed before and after the intervention. Paired t-tests and Independent-sample t-tests were adopted for comparison within and between groups, respectively, in the normal variables. Wilcoxon signed-rank tests and Mann-Whitney U tests were adopted for comparison within and between group, respectively, in the abnormal variables. Categorical variables were tested using Pearson's χ2. P-value &lt; 0.05 was statistically significant in statistical tests.

Results

Post intervention testing indicated that menopausal syndrome of participants was significantly improved in the intervention group compared to the control group (P &lt; 0.001). Between-group comparison showed a significant improvement of weekly energy expenditure of total physical activity (P = 0.001) and participation in exercise (P &lt; 0.001) in the intervention group compared to the control group after the intervention. The dietary status of participants was significantly improved in the intervention group compared to the control group (P &lt; 0.001). In the intervention group, the menopausal syndrome of participants improved more in the hormone drug group than in the non-hormone group (P = 0.007), as did the control group (P = 0.02). In the hormone drug group, the physical activity (P = 0.003) and dietary status (P = 0.001) mproved more in the intervention group than in the control group.

Conclusions

The multidisciplinary health education based on lifestyle medicine was effective in improving the menopausal syndrome and healthy lifestyle behaviors of menopausal women. Studies with extended observation period and larger sample size are in need to evaluate the long-term scale-up effects of the multidisciplinary health education.

How to help aortic dissection survivors with recovery?: A health promotion program based on the comprehensive theory of health behavior change and literature review

For aortic dissection survivors, health promotion can help them recover from the disease, which requires systematic program support. The aim of this study was to construct a health promotion program for aortic dissection survivors. Literature search, group discussion, and expert consultation were used. The Integrated Theory of Health Behavior Change was the theoretical basis of the program. Multiple medical-related databases were searched. Based on a literature search and group discussion, 3 primary items, 8 secondary items, and 34 tertiary items were formed. After 2 rounds of expert consultation (number of experts = 25), 3 primary items, 16 secondary items, and 54 tertiary items were retained. The authority coefficients of the 2 rounds of experts were 0.890 and 0.905, respectively. The Kendall W coefficient of the 2 rounds were 0.210 to 0.370 (P < .05) and 0.221 to 0.378 (P < .05), respectively. The mean importance value and coefficient of variation of each item were >3.5 and <0.25, respectively. The health promotion program constructed in this study was reasonable and scientific, which could provide a reference for clinical work.