Rating Hospital Performance in China: Review of Publicly Available Measures and Development of a Ranking System

Development of an assessment tool for designated medical institutions in China--Based on the application of an online assessment system

Background

Due to the expanding coverage of medical insurance and the growth of medical expenses, the ability to assess the performance of designated medical institutions (DMIs) in supporting the delivery of high-quality patient care and the standardized use of funds represents a priority in China. Despite such interest, there has yet to be an operable standard and labor-saving method for assessing DMIs in China.

Objective

The main objectives include two aspects: (1) establishing an evaluation index system for DMIs based on contracts; (2) designing and developing an online evaluation platform.

Methods

A group of 20 experts with theoretical and practical expertise in medical insurance regulation and performance evaluation were invited to select available indicators. A combination weighting method based on analytic hierarchy process and entropy method was used to determine the weight coefficient. Shanghai was taken as the sample area, and 760 DMIs were included in the empirical research. The test-retest reliability method and criterion-related validity method was used to test the reliability and the validity of the evaluation result.

Results

An assessment index system that included 6 domains and 56 indicators was established in this study. Furthermore, we developed an online platform to assist in the implementation of the assessment. The results showed that the average score of assessment was 94.39, the median was 96.92. The test-retest reliability value was 0.96 (P ≤ 0.01), which indicated high stability of the assessment. In addition, there was a significant negative relationship between assessment score and the penalty amount of DMIs (R = -0.133, P < 0.001). After adjusting for the basic characteristics of medical institutions, the number of visits and revenue, the negative relationship was still significant (B = -0.080, P < 0.05). These results are consistent with expectations, indicating that the assessment had good criterion-related validity.

Conclusions

This study established an operable assessment measure and developed an online platform to assess the performance of DMIs. The results showed good feasibility and reliability in empirical research. Our research findings provided an operable Chinese solution for DMI assessment that saves manpower and time, which would have good enlightening significance in other regions of China and in low-income and middle-income countries internationally.

The impact of DRG on resource consumption of inpatient with ischemic stroke

Background

Diagnosis-related group (DRG) payments were gradually introduced and used in 12 public hospitals in L city. Given the high incidence and burden of ischemic stroke, the study aimed to assess the impact of DRG payment reform on inpatient medical resource utilization.

Methods

Data were obtained from the DRG local database of the new Chinese cooperative medical program in L city. The study used interrupted time series analysis to examine changes in length of stay and medical costs before and after the reform, and also assessed changes in different subgroups.

Results

There were 763 and 4,731 ischemic stroke patients in tertiary hospitals and 1953 and 10,439 patients in secondary hospitals before and after the DRG payment reform, respectively. After the reform, LOS was reduced 0.047 and 0.47 days in tertiary and secondary hospitals, respectively. Medical expenses decreased by 30.189 yuan in tertiary hospitals, but those increased by 44.918 yuan in secondary hospitals monthly. For gender, the average LOS reduced by 0.462 and 0.471 days for male and female in secondary hospitals. The change in medical expenses for male patients in tertiary hospitals and female in secondary hospitals were more significant, with a decrease of 65.396 yuan and increase of 56.257 yuan. The most pronounced change in resource consumption was seen for patients aged 85 years and older, with an increase in average LOS and medical expenses by 0.394 days and 382.422 yuan in tertiary hospitals. They showed a reduction in the average LOS by 1.480 days, and increase in the average medical expenses by 133.485 yuan in secondary hospitals monthly. Regarding disease severity, the most significant changes were seen in MCC patients. The average LOS decreased by 0.197 and 0.928 days and the average medical expenses decreased by 131.526 and 21.631 yuan in tertiary and secondary hospitals, respectively.

Conclusion

The implementation of DRG payment system has led to a reduction in the LOS in various levels of hospitals, which would save in bed resources. However, DRG payment reform can help to control medical expenses for ultra-high cases, but it may not be useful to control the overall increase in medical expenses.

Associations Among Organizational Capabilities, Organizational Performance and the Medical Alliance Implementation Effect in Community Health Centers in China: A Moderated Mediation Model

Purpose

Community health centers (CHCs) are an important part of the healthcare system worldwide. Based on the dual process model of organizational capabilities, this study explores the relationship between organizational capabilities and the organizational performance of CHCs, as well as the role played by the medical alliance implementation effect.

Methods

In this study, whole-group sampling was used to extract CHCs. All 135 CHCs in 8 of 16 districts of Beijing were selected as subjects. The organizational capabilities of the CHCs and the medical alliance implementation effect were evaluated using a questionnaire survey of 1957 managers and 3622 medical staff, respectively. A pathway analysis of the mediating role of the organizational capabilities of CHCs and the moderating role of the medical alliance implementation effect was conducted using Mplus 8.0.

Results

The development capabilities had a positive impact on basic capabilities (β = 0.878, P < 0.001), and core capabilities (β = 0.952, P < 0.001), but had no direct impact on organizational performance. Basic capabilities positively affected organizational performance (β = 1.163, P < 0.001), and core capabilities negatively affected organizational performance (β =- 0.886, P = 0.004). Both basic capabilities (β =1.022, P < 0.001) and core capabilities (β =- 0.843, P = 0.005) played a mediating role in the relationship between development capabilities and organizational performance. The moderating role of the medical alliance implementation effect was not significant.

Conclusion

This study found that strengthening the organizational capabilities of CHCs can effectively improve their performance, with the development of basic capabilities being a primary concern. The medical alliance implementation effect has not had a significant impact on organizational performance, and the cooperation between CHCs and high-level hospitals should be further promoted to give full play to the medical alliance's role and improve the organizational performance of CHCs.

Job security among healthcare workers in Guangdong, China

Objective

The objective of this study was to explore the sense of job security and its influencing factors among healthcare workers in Guangdong, China.

Methods

This cross-sectional study used stratified random sampling to enroll healthcare workers employed by hospitals across Guangdong province between September 2020 and October 2020.

Results

A total of 4,173 questionnaires were distributed, and 4,076 were returned for an effective recovery rate of 97.68%. The overall score for the sense of security was 64.85 ± 20.09, and the item means score was 2.95 ± 0.91. Multiple-linear regression analysis showed that work experience (years), education level, job position, specialty unit, employment type, marital status, job satisfaction, WPV frequency, daily sleep duration, weekly overtime hours, average monthly earnings (RMB), hospital level, and region were significantly associated with senses of poor security among healthcare workers (all P < 0.05).

Conclusions

Hospital workers in Guangdong reported relatively low levels of job security. Levels of job security were significantly associated with multiple factors which could be addressed by hospital practices to improve the sense of job security among healthcare workers.

Scientific research competitiveness in hospitals: A narrative review of major hospital ranking systems in China

Background and Aims

Several hospital ranking systems have been created in China recently, but there is still a lack of comprehensive analysis of the weight and significance of scientific research in hospital ranking. The present study aimed to identify and analyze the role of scientific research competitiveness in various hospital ranking systems in China.

Methods

Over 200 materials published between 2010 and 2020 and related to three mainstream hospital ranking systems in China were reviewed. The methodologies applied in the three ranking systems were analyzed and compared. In addition, the comparative learning and analysis of Top 10 and Top 46–55 hospitals according to the ranking system of China's Best Hospital Rankings was performed for a longitudinal study.

Results

The three major hospital rankings had different scientific research capability ranking methodologies and emphases of scientific research evaluation systems. The most commonly used indicators were science citation index (SCI) publications, National Scientific Foundation of China funding, a number of national key laboratories, and a number of academicians. The relative standing of several top hospitals showed slightly different in the three major Chinese hospital ranking systems. For the longitudinal study, we found that the fluctuation of the ranking of the Top 46–55 hospitals was significantly higher than that of the Top 10 hospitals, in which scientific research played a vital role.

Conclusion

The proportion of scientific research plays an important role in the hospital ranking systems. The quality and quantity of SCI publications, the key indicators of national projects, and top academic talents are the most important factors used to evaluate the level of hospital scientific research, and thus affect the ranking of hospitals.

The Influencing Factors of Nutrition and Diet Health Knowledge Dissemination Using the WeChat Official Account in Health Promotion

Background: The promotion of a healthy diet via health education is a component of the “Healthy China 2030” plan. However, few studies have reported whether health knowledge about nutrition and diet has gained public attention, and whether it is needed by the public.

Methods: The numbers of views, shares, and reads of articles published by the official WeChat account of a hospital in China were accessed. The influence index was obtained via the entropy analysis of these three indices. A questionnaire survey was developed based on the purpose of the study and the conclusion of the content analysis, which conducted to analyze users' requirements for health knowledge and their influencing factors. Moreover, risk factors were explored by logistic regression models.

Results: Of the 103 articles considered in this study, four articles in the Top 10 were related to nutrition and diet. The influence index of nutrition and diet knowledge was found to be the highest in the content analysis (p < 0.05). The higher degrees of humor (β = 0.224, p = 0.027), nutrition and diet articles (β = 0.776, p = 0.034), and cover articles (β = 0.312, p = 0.021) have significant influences on the influence index. In total, 581 questionnaires were obtained, and 78.1% of the respondents reported believing that the health knowledge of greatest concern was that related to nutrition and diet. Multivariate logistic regression analyses were conducted to explore the associations between the features of the articles and users reading nutrition and diet knowledge; it was found that gender (female, OR: 4.651, 95%Cl: 2.598, 8.325, and p < 0.001), age (young adult, OR: 0.358, 95%Cl: 0.266, 0.481, and p < 0.001), cancer precaution knowledge (OR: 4.333, 95%Cl: 2.262, 8.299, and p < 0.001), traditional Chinese medicine (OR: 2.121, 95%Cl: 1.064, 4.230, and p = 0.033), the knowledge acquisition approach [circle of friends (OR: 2.586, 95%Cl: 1.373, 4.868, and p = 0.003), social media (OR: 2.183, 95%Cl: 1.204, 3.960, and p = 0.010)), hospitals (OR: 3.194, 95%Cl: 1.793, 5.692, and p < 0.001), television media (OR: 4.348, 95%Cl: 2.341, 8.077, and p < 0.001)], and social media strategies [professionalism and authority (OR: 2.354, 95%Cl: 1.231, 4.505, and p = 0.006)] have statistically significant relationships with users reading nutrition and diet knowledge.

Conclusion: Nutrition and diet knowledge could contribute to WeChat user engagement of health information dissemination. Nutrition professionals should improve the scientific popularization ability and effectively use social media for health promotion.

Measuring Quality of Public Hospitals in Croatia Using a Multi-Criteria Approach

Quality of public hospital services presents one of the most important aspects of public health in general. A significant number of health services are delivered due to public hospitals. Under the World Bank program "Improving Quality and Efficiency of Health Services: Program for Results", the competent bodies in Croatia aimed to identify the top 40% best-performing public acute hospitals in Croatia, based on a clinical audit in the preceding 12 months. This paper presents how this goal was achieved, using a multi-criteria decision-making (MCDM) approach. A MCDM approach was selected due to the multidimensionality and complexity of healthcare performance and service quality. We aimed to develop a methodology for ranking top-performing hospitals at the national level. We chose the composite indicator methodology, combined with the analytic hierarchy process (AHP) as a tool for determining weights for aggregation of individual indicators. The study looked at three clinical entities: acute myocardial infarction, cerebrovascular insult, and antimicrobial prophylaxis in colorectal surgery. Indicators for each entity were evidence-based, following the national guidelines, but limited by availability of data. The clinical audit and databases of competent administrative bodies were used as sources of data. The problem investigated in this paper has a significant impact at the strategic (national) level. Even though the AHP has already been applied in the public health domain, to the best of our knowledge, this is the first application of the AHP in combination with composite indicators for hospital ranking at a national level. The AHP enabled participation of experts from the audited hospitals in the assessment of indicator weights. Results show that composite indicators can be successfully implemented for acute hospital evaluation using the AHP methodology: (1) the AHP supported a flexible structuring of the problem; (2) the resulting complexity of pairwise comparisons was appropriate for the experts (consistency ratios were under 0.1); (3) using the AHP approach enabled a successful aggregation of different opinions into group priorities; (4) the developed methodology was robust and enabled identifying the top 40% ranking best-performing public acute hospitals in Croatia combining 20 criteria within three entities, based on input from 36 clinical experts. The proposed methodology can be useful to other researchers for assessment of healthcare quality at the strategic level.