A quality assessment index framework for public health services: a Delphi study

Developing a psychological care competences framework for nurses in China: a mixed methods study

BACKGROUND

With social transformation, rapid economic development and deepening awareness of psychological health in China, people's demand for psychological health services is becoming increasingly urgent. A key challenge for Chinese medical organizations is to train enough qualified psychological care nurses. A greater understanding of psychological care competences (PCC) can help in clinical nurse selection, training, and assessment.

OBJECTIVE

To develop a PCC framework for Chinese nurses and obtain a consensus on the framework among experts.

METHODS

A descriptive mixed methods study was designed consisting of a literature review and semi-structured interviews followed by three Delphi rounds. The experts (n = 16) involved were nurses, nursing managers and educators from nine Chinese provinces with a specific interest in psychological care. Descriptive statistics assisted in data analysis.

RESULTS

Using the Iceberg Model as a theoretical foundation, five main dimensions and associated subdomains were integrated from 39 chosen articles. The semi-structured interviews with 24 nursing managers and nurses confirmed all of the themes from the literature review while generating new themes, both of which were incorporated into the initial PCC framework. After three Delphi rounds, the experts reached consensus on the PCC framework, including five domains (knowledge, skills, professional ethics, personal traits, internal motivations) and 22 subdomains with connotations. The response rate (RR) values for the three rounds of consultation were 80.00%, 87.50% and 92.86%, the composite reliability (Cr) values were 0.89-0.90, and the Kendall coordination coefficients were 0.155-0.200 (P < 0.05).

CONCLUSIONS

On the basis of the Iceberg Model, literature review and qualitative research methods along with Delphi technique were used to develop a scientific and systematic PCC framework. The research methods were feasible and the results were reliable, thereby providing a basis for adopting this framework into nursing education. A formal assessment tool should be developed to test the PCC of nurses in clinical practice.

Construction of an index system of core competence assessment for otolaryngology nurse specialists in China: A Delphi study

BACKGROUND

Clinical nurse specialists play a vital role in the work quality, patient safety and team development of nurses. However, there is currently no prior study constructing the index of core competence assessment for otolaryngology Nurse Specialists.

OBJECTIVES

To establish an index system for the evaluation of Chinese otolaryngology Nurse Specialists' core competence.

DESIGN

A Delphi study.

SETTINGS

The study was mainly conducted in a university-affiliated hospital in China.

PARTICIPANTS

Twenty-two experts with otolaryngology knowledge and practical experience from different regions and organizations in China.

METHODS

We used literature reviews and expert meetings to establish a draft index system . Subsequently, a two-round Delphi survey was utilized to consult opinions from 22 experts about the index for the evaluation of otolaryngology nurse specialists' core competence and provide qualitative comments on their ratings. Consensus was predefined as a mean important score of 4.0 or above and a coefficient of variation is not above 0.25 among the participants.

RESULTS

The final evaluation indexes of the core competencies for otolaryngology Nurse Specialists included 5 first-level indexes (clinical competence, critical thinking competence, leadership, professional development competence, professionalism), 19 second-level indexes, and 85 third-level indexes. The effective response rates of the two expert consultation rounds were 100 %. The expert authority coefficients were 0.864 and 0.859 in the first and second rounds of consultation, respectively. In the second round of consultation, the first, second and third indexes of Kendall's coefficient of concordance were 0.357, 0.330, and 0.232, respectively (P < 0.001).

CONCLUSIONS

The constructed evaluation indexes of the core competencies of otolaryngology Nurse Specialists are scientific, reasonable, comprehensive, and specific and may provide references for the training and evaluation of otolaryngology Nurse Specialists.

Construction of an evaluation index system for undergraduate nursing teachers' curriculum humanistic competence: a Delphi study in China

BACKGROUND

The curriculum humanistic competence of nursing teachers is important to cultivate the humanistic qualities of undergraduate nursing students. However, there are no evaluation tools for the curriculum humanistic competence of undergraduate nursing teachers in China.

OBJECTIVE

To develop an index system to evaluate the curriculum humanistic competence of undergraduate nursing teachers.

DESIGN

This research conducted a Delphi study.

PARTICIPANTS

Semi-structured interviews were held with 19 experts, and Delphi rounds were conducted with 18 experts.

SETTINGS

This study was conducted in 12 universities and 4 Grade A tertiary hospitals in China.

METHODS

A literature review and semi-structured interviews were conducted to develop an initial framework. A two-round Delphi survey was employed to build the index system for undergraduate nursing teachers' curriculum humanistic competence.

RESULTS

After two rounds of consultation, the index system included 5 first-level indicators, 11 second-level indicators and 41 third-level indicators. The Cr for two rounds of consultation were 0.929 and 0.923, and Kendall's W was 0.152(P<0.001).

CONCLUSIONS

The index system for the evaluation of undergraduate nursing teachers' curriculum humanistic competence offers guidelines for undergraduate nursing teachers in China. It can be used in practice to develop high humanistic qualities in undergraduate nursing teachers.

Development of a core dataset for child injury surveillance: a modified Delphi study in China

Background

Understanding the occurrence and severity of child injuries is the cornerstone of preventing child injuries. Currently, there is no standardized child injury surveillance dataset in China.

Methods

Multistage consultation by a panel of Chinese experts in child injury to determine items to include in the core dataset (CDS) was performed. The experts participated in two rounds of the modified Delphi method comprising a consultation questionnaire investigation (Round 1) and a face-to-face panel discussion (Round 2). Final consensus was established based on the opinions of the experts regarding the modified CDS information collection items. Enthusiasm and authority exhibited by the experts were evaluated by the response rate and using the expert authority coefficient, respectively.

Results

The expert panel included 16 experts in Round 1 and 15 experts in Round 2. The experts during both rounds had a high degree of authority, with an average authority coefficient of 0.86. The enthusiasm of the experts was 94.12%, and the proportion of suggestions reached 81.25% in Round 1 of the modified Delphi method. The draft CDS evaluated in Round 1 included 24 items, and expert panelists could submit recommendations to add items. Based on findings in Round 1, four additional items, including nationality, residence, type of family residence, and primary caregiver were added to the draft of the CDS for Round 2. After Round 2, consensus was reached on 32 items arranged into four domains-general demographic information, injury characteristics, clinical diagnosis and treatment, and injury outcome-to include in the final CDS.

Conclusion

The development of a child injury surveillance CDS could contribute to standardized data collection, collation, and analysis. The CDS developed here could be used to identify actionable characteristics of child injury to assist health policymakers in designing evidence-based injury prevention interventions.

Developing a professional competence framework for the master of nursing specialist degree program in China: A modified Delphi study

BACKGROUND

The urgency of ensuring adequate professional competence in clinical nursing practice is evident. However, there is little formal professional competence framework for the education of master's degree students in nursing specialist programs in China.

OBJECTIVE

To develop a professional competence framework for the Master of Nursing Specialist (MNS) degree program in China.

DESIGN

A modified Delphi study.

PARTICIPANTS

An expert panel discussion was held with 12 experts, and Delphi rounds were conducted with 24 experts.

METHODS

A literature review and an expert panel discussion were conducted to develop an initial competence framework. A two-round Delphi survey was employed to obtain a consensus on the framework through either an online or paper questionnaire. Descriptive statistics were used to analyze the data. The consensus threshold was set according to the mean (≥ 4.0), coefficient of variation (< 0.25), and consensus level of agreement (≥70 %).

RESULTS

A consensus on seven domains and 54 items of the professional framework for the MNS degree program was achieved. The framework domains included clinical practice (12 items), professional attitude (8 items), collaboration and communication (5 items), professional development (8 items), research (7 items), education (7 items), and administration (7 items).

CONCLUSION

The professional competence framework offers guidelines for MNS degree programs in China. Future research should focus on imbedding these competences in MNS degree programs to prepare qualified advanced practice nurses.

Public Health Services, Health Human Capital, and Relative Poverty of Rural Families

With the successful completion of the battle against poverty, after 2020, the focus and difficulty of China's poverty governance will change from solving absolute poverty to alleviating relative poverty. Analyzing and studying the alleviation of relative poverty from the perspective of public health services is in line with the current needs of consolidating and expanding poverty alleviation in China, and it is also of great significance to building a long-term solution mechanism for relative poverty. In this study, basic panel data were constructed by using the data of five CFPS surveys in 2010, 2012, 2014, 2016, and 2018 and matched with the macro data. The correlation between public health services and rural households' relative poverty was also analyzed by using logit regression analysis and the KHB mediation effect decomposition method. The results show that (1) public health services play a significant role in promoting the accumulation of health human capital, improving individual feasible ability, and alleviating the relative poverty of rural families; (2) the improvement of public health services is conducive to the alleviation of the relative poverty of rural families; (3) we should continue to increase investment in public health care in underdeveloped areas and strive to promote the balanced development of public health services, so as to further consolidate and expand the achievements of poverty eradication.

Establishing a Multidisciplinary Framework for an Emergency Food Supply System Using a Modified Delphi Approach

A scientific food emergency supply system is helpful for assuring food supplies continuity, improving response efficiency, and reducing disaster losses. However, the framework for a food emergency supply system is currently an understudied area in emergency management post-disaster. In this study, a comprehensive literature review of major databases was performed to identify potential indicators for the emergency food supply system, followed by a two-round modified Delphi with a multidisciplinary expert panel (n = 17) to verify the proposed framework. The effective response rate of questionnaires ranged from 94.4% (17/18) to 100% (17/17) and the authority coefficient of experts was 0.88, indicating high positivity and reliability of the experts. Furthermore, the p-values of Kendall’s W were < 0.01 and the Cronbach’s α were > 0.7 for all domains and indicators, indicating a high reliability and validity for the proposed framework. Finally, a consensus was reached on all eight domains and 81 indicators. In conclusion, this study introduced and verified a multidisciplinary framework for the food emergency supply system, which could provide a theoretical basis for emergency responders to make corresponding commands and decisions post-disaster.

The impact of human error on medical procedures

BACKGROUND

Human error has been studied for large decades with special application to critical infrastructures and processes where the impact of such errors can induce severe or catastrophic consequences. In this sense it is of utmost importance to extend this type of analysis to other fields as medicine.

OBJECTIVE

This study proposes a semi-quantitative human error risk assessment methodology, including the analysis of the so-called Performance Shaping Factors (PSFs), in order to contribute to health services improvement.

METHODS

A questionnaire including the considered PSFs is answered in order to determine the impact of each PSF and its influence on human error. It allows performing a Human Error Risk Assessment (HERA) for both the patient (HERAp) and the quality of the service (HERAq).

RESULTS

The results show the PSFs with the highest impact factor. After applying corrective measures, it is possible to observe the impact on the reduction of the risk for patient and for the quality of the service.

CONCLUSIONS

The application of the methodology with the inclusion of the impact of PSFs allows minimizing or mitigating failure modes with greater risk as well as increasing patient safety and promoting a better quality of medical procedures.

Construction of evidence-based practice competencies for nurses in China: A modified Delphi study

BACKGROUND

Evidence-based practice is considered as the core competency requirement for nursing practice internationally. However, there is limited information regarding the evidence-based practice competency indicators for clinical nurses in China.

OBJECTIVE

To establish a set of evidence-based practice competencies specific to nurses in China.

DESIGN

A modified Delphi study.

SETTING

The study was mainly conducted in a university-affiliated hospital in China.

PARTICIPANTS

Twenty experts with evidence-based practice knowledge or practical experience from different regions and organizations in China.

METHODS

A literature review was conducted to develop the initial list of competencies which consisted of 35 items in seven domains. A two-round Delphi survey used email to invite experts to rate the importance of each item and provide qualitative comments on their ratings. Consensus was predefined as a mean score is of 4.0 or above and at least 75% agreement among the participants.

RESULTS

In round 1, 2 items were excluded, 5 items were added, and 12 items were required to be modified. In round 2, the consensus was achieved on 34 items in seven domains.

CONCLUSION

The study established a comprehensive set of evidence-based practice competencies for nurses in China, which provides benchmark standards for the assessment and training of nurses on evidence-based practice.

Development and validation of a scale for measuring hospital service quality: a dyadic approach

Purpose

This study integrates the providers' perspective as well as the patient's perspective in developing and validating a scale to measure hospital service quality in multispecialty hospitals.

Design/methodology/approach

An exploratory sequential mixed-method approach was used in this study. The strategies used included a thematic literature review, semi-structured interviews, modified Delphi and confirmatory factor analysis.

Findings

The reliability coefficient of 41 item scale was 0.963 with each attribute, that is, pivotal, core and peripheral, having a Cronbach's alpha of 0.907, 0.91 and 0.891, with scale content validity (S-CVI Ave) of 0.9151. The composite reliability scores of all constructs were greater than 0.7, with an Average Variance Explained (AVE) of all items greater than 0.5.

Originality/value

The instrument can be used to measure the difference between what service providers believe customers expect and customers’ actual needs and expectations. The scale can be used to measure the difference between what is delivered (as perceived by the provider) and what customers perceive they have received (because they are unable to accurately evaluate service quality). The dyadic approach of administering this questionnaire in measuring hospital service quality will lead to the identification of a knowledge gap and a perception gap in delivering hospital service quality.

Establishment and Empirical Evaluation of a Quality Indicator System for Postoperative Pain Management

OBJECTIVES

This study aimed to establish a quality indicator system for postoperative pain management and test its reliability, validity, and discrimination in China.

METHODS

We established a quality indicator system using the Delphi method. Further, we designed and administered a survey questionnaire in the orthopedic departments of nine hospitals, located in the Zhejiang and Jiangsu Provinces, through purposive and convenience sampling methods to examine the reliability, validity, and discrimination of the quality indicator system.

RESULTS

We established a quality indicator system to assess structure, process, and outcome measures of postoperative pain management using three first-level, eight subordinate second-level, and 32 subordinate third-level quality indicators. The scale-level content validity indexes of the three sections of the questionnaire, assessing structure, process, and outcomes measures, were 0.99, 0.98, and 0.98, respectively. We identified two common factors from the third section that demonstrated a cumulative variance contribution rate of 80.38% and a Cronbach's α coefficient of 0.95. The total scores and scores of the structure, process, and outcome quality indicators demonstrated statistically significant differences (P < 0.05) between the wards (N = 4) that participated in the "Painless Orthopedics Ward" quality improvement program and those (N = 5) that did not.

CONCLUSIONS

This quality indicator system highlights the need for multidisciplinary cooperation and process characteristics of postoperative pain management, along with interdepartmental quality comparisons. And it demonstrates acceptable reliability, validity, and discrimination; thus it may be completely or partially employed in Chinese hospitals.

Identifying current and emerging resources and tools utilized for detection, prediction, and visualization of viral zoonotic disease clusters: a Delphi study

Zoonotic disease surveillance presents a substantial problem in the management of public health. Globally, zoonoses have the potential to spread and negatively impact population health economic growth, and security. This research was conducted to investigate the current data sources, analytical methods, and limitations for cluster detection and prediction with particular interest in emerging bioinformatics tools and resources to inform the development of zoonotic surveillance spatial decision support systems. We recruited 10 local health personnel to participate in a Delphi study. Participants agreed cluster detection is a priority, though mathematical modeling methods and bioinformatics resources are not commonly used toward this endeavor. However, participants indicated a desire to utilize preventative measures. We identified many limitations for identifying clusters including software availability, appropriateness, training, and usage of emerging genetic data. Future decision support system development should focus on state health personnel priorities and tasks to better utilize emerging developments and available data.

An assessment for health education and health promotion in chronic disease demonstration districts: a comparative study from Hunan Province, China

Background

Cost-effective strategies of chronic disease control, integrated health education and health promotion play important roles in the programs of chronic disease demonstration districts in China. The performance of these districts can be directly assessed by their health education and promotion work. However, there have been only a few performance assessments done on these programs, most of which made without the inclusion of proper quality indicators. This study was designed to establish a framework of indicators for outcome evaluation of health education and promotion efforts in Chinese districts, and explore the factors involved in promoting these efforts.

Methods

A modified two-round Delphi survey was first used to construct quality indicators on a nine-point Likert scale. With those indicators, the rank sum ratio (RSR) method was then conducted through rank conversion and parametric statistics, to assess and classify the performance of ten districts or counties randomly chosen both from demonstration and non-demonstration districts in the Hunan province.

Results

The Delphi process produced seven themes and 25 sub-themes as quality indicators. The seven themes included organizational management, financial support, professional personnel, health education and promotion, residents' health awareness and behaviors, residents' satisfaction, and residents' health literacy. The districts were classified into four levels by RSR as follows: One demonstration district at the first-ranked level, five other demonstration districts at the second-ranked level, all non-demonstration districts at the third-ranked level. None were at the fourth-qualified level.

Discussion

Chronic disease demonstration districts performed better on the work of health education and health promotion than the non-demonstration districts. The work should be focused on the following measures of chronic diseases: organizational management, financial support, media-related broadcasting, technical support, community-based promotion and supportive environment, and people's enhanced awareness and health literacy.

Identification of risk factors for enteral feeding intolerance screening in critically ill patients

Objectives:

To identify risk factors for enteral feeding intolerance screening in critically ill patients, thereby, provide some reference for healthcare staff to assess the risk of feeding intolerance, and lay the foundation for future scale development.

Methods:

This study used a mixed methodology, including a literature review, semi-structured interviews, the Delphi technique, and the analytic hierarchy process. We used the literature review and semi-structured interviews (n=22) to draft a preliminarily item pool for feeding intolerance, Delphi technique (n=30) to screen and determine the items, and the analytic hierarchy process to calculate the weight of each item. The study was conducted between June 2014 and September 2015 in Daping Hospital, Third Military Medical University, Chongqing, China.

Results:

Twenty-three risk factors were selected for the scale, including 5 dimensions. We assigned a weight to each item according to their impact on the feeding intolerance, with a higher score indicating a greater impact. The weight of each dimension was decreasing as follows: patient conditions, weight score equals 42; general conditions, weight score equals 23; gastrointestinal functions, weight score equals 15; biochemical indexes, weight score equals 14; and treatment measures, weight score equals 6.

Conclusion:

Developed list of risk factors based on literature review, survey among health care professionals and expert consensus should provide a basis for future studies assessing the risk of feeding intolerance in critically ill patients.

Evaluation of the Quality of Health Service Providers: The Iranian People Perspective 2014

INTRODUCTION

Quality is the center of attention in all service providing organizations that are effective in promoting satisfaction of patients who are referred to medical centers. The aim of this study was to investigate the quality of health service providers in a case study of Qazvin, Iran, in 2014.

METHODS

This descriptive study was conducted on 1,002 people who were residents of Qazvin Province (Iran) in 2014. The people were selected randomly from the population of the study area. The main variables studied were education, perceptions, expectations, and gaps in service quality. The data collection tool was the standard Servequal questionnaire. To determine the reliability of the research tool, we used Cronbach's Alpha coefficient and the test-retest method. Statistical analyses were conducted using SPSS and the ANOVA test.

RESULTS

The mean age of people included in the study was 32 ± 9.9 years, and the average waiting time to receive services was 73 ± 47 minutes. Hospitals and doctors' offices had the highest quality gap of -1.420 ± 0.82 and -1.01 ± 0.75, respectively. The service quality gaps in medical centers, health providers of rural area, and health providers of urban area were -0.883 ± 0.67, -0.882 ± 0.83, and -0.804 ± 0.62, respectively. There was a significant relationship between peoples' perceptions and expectations concerning the quality of health services and their educational levels.

CONCLUSION

The higher gaps in quality in hospitals and in doctors' offices require more attention. Managers and policy makers should consider developing and implementing plans to reduce these gaps in quality and to promote better health services in these two sectors.

Clinical management and associated costs for moderate and severe Alzheimer's disease in urban China: a Delphi panel study

Background

Healthcare resource utilisation for Alzheimer’s disease (AD) in China is not well understood. This Delphi panel study aimed to describe the clinical management pathways for moderate and severe AD patients in urban China and to define the amount and cost of healthcare resources used.

Methods

A panel of 11 experts was recruited from urban China to participate in two rounds of preparatory interviews. In the first round, 9 physicians specialised in dementia gave a qualitative description of the clinical management of AD patients. In the second round, 2 hospital administrators were asked about the cost of AD management and care. Results from the interviews were discussed by the experts in a Delphi panel meeting, where consensus was reached on quantitative aspects of AD management, including the rate of healthcare resource utilisation, the respective unit costs and caregiving time.

Results

Interviewees reported that mild AD is under-recognised in China; most patients are diagnosed with moderate to severe AD. Loss of independence and agitation/aggression are the main drivers for healthcare resource utilisation and contribute to a heavier caregiver burden. It was estimated that 70 % moderate AD patients are independent/non-aggressive at the time of diagnosis, 15 % are independent/aggressive, 10 % are dependent/non-aggressive, and 5 % are dependent/aggressive. Dependent/aggressive AD patients are more likely to be hospitalised (70–90 %) than accepted in a nursing home (0–20 %), while the opposite is true for dependent/non-aggressive patients (5–35 % for hospitalisation vs. 80 % for nursing home). Independent AD patients require 1–3 hours/day of caregiver time, while dependent patients can require up to 12–15 hours/day. Experts agreed that AD complicates the management of age-related comorbidities, found in 70–80 % of all AD patients, increasing the frequency and cost of hospitalisation.

Conclusions

The Delphi panel approach was an efficient method of gathering data about the amount of healthcare resources used and associated costs for moderate and severe AD patients in urban China. The results of this study provide a useful source of information for decision makers to improve future healthcare policies and resource planning, as well as to perform economic evaluations of AD therapies.