Perioperative diabetes care: development and validation of quality indicators throughout the entire hospital care pathway

"Track style" children's fundamental movement skills test: construction and verification of an efficient evaluation system

Objectives

This study aimed to develop an efficient tool for assessing children's fundamental motor skills, the "Track style" Children's Fundamental Movement Skills Test (TCFMST), based on theories of motor development integrated with Chinese cultural context and physical education teaching situations.

Methods

Starting from a literature analysis, the study selected items from existing fundamental movement skill (FMS) assessments, textbooks, physical education and health standards, and children's movement guidelines to construct a pool of test items. Subsequently, the items were screened and optimized using the Delphi method. Finally, the feasibility, discrimination, difficulty, reliability, and validity of the constructed test were examined using testing methods.

Results

The TCFMST includes three dimensions: locomotive skills, body control skills, and manipulative skills, with a total of 10 items. The difficulty and discrimination of each item are appropriate; the correlation coefficients for retest reliability range from 0.789 to 0.943 (p < 0.01). The results of exploratory factor analysis indicate that the common factors align with the hypothesized three dimensions, indicating good structural validity of the test. The concurrent validity results show a correlation coefficient of -0.510 (p < 0.01) between the TCFMST and the total score of TGMD-3, indicating a moderate correlation between the two tests.

Conclusion

The TCFMST developed in this study has good difficulty, discrimination, reliability, and validity. It also features strong operability, a short duration, and high interest. It can serve as an important tool for monitoring children's fundamental motor skill levels.

Compiling a Set of Actionable Quality Indicators for Medical Practitioners in Dutch Nursing Homes: A Delphi Study

Most quality indicators (QIs) currently used in nursing homes reflect the care delivered by the entire multidisciplinary team and are not specific for medical practitioners. International experts have proposed a set of QIs that specifically reflect the quality of medical care in nursing homes. The objective of the Delphi study described here was to compile a set of actionable QIs tailored for medical practitioners working within Dutch nursing homes. This was achieved through the evaluation of 15 existing national QIs and 35 international QIs by a panel of medical practitioners, comprising medical specialists, nurse practitioners, and physician assistants, who are working in Dutch nursing homes. Panelists rated each QI on (1) level of direct control by medical practitioners and (2) its relevance to the quality of medical care. QIs progressing to subsequent rounds required panel agreement on both direct control (≥70% ≥3 points on a 4-point scale) and relevance (≥70% ≥8 on a 10-point scale). In the last round, each panelist selected the 5 most relevant QIs and arranged them in order of importance. These top 5 rankings were converted into points for an overall final ranking. There was consensus on 42 QIs being under the control of medical practitioners, and 21 of these QIs were considered relevant for quality of care. Most of the 21 QIs originated from the international QI set. This finding supports the transferability of the internationally developed QIs to the Dutch nursing home context and provides opportunities to compare the quality of medical care in nursing homes across countries. In the final ranking, the QI related to new medication prescriptions received the highest rating, followed by 3 QIs related to advance care planning. Future research should focus on evaluating the feasibility of measuring the selected QIs and assessing their measurement properties before implementing them in professional learning and quality improvement initiatives for medical practitioners in nursing homes.

Generation of Indicators to Assess Quality of Health Care in Hospital at Home Through e-Delphi

BACKGROUND AND OBJECTIVES

The quality of health care in hospital at home (HaH) has been measured in different countries using simple indicators and clinical results that only contribute to some dimensions of the quality of health care. We sought to generate indicators to comprehensively evaluate the quality of health care provided to HaH users through the e-Delphi technique.

METHODS

The e-Delphi technique was performed with the participation of 17 HaH experts. The methodological strategy applied in this study was divided into the following 3 phases: a preparatory phase; consultation phase; and consensus phase. Three rounds of consultations were conducted with experts. In round 1, they were asked to identify which aspects of HaH they believed should be evaluated using an indicator for each of the following 6 dimensions of health care quality: effectiveness; efficiency; timeliness; patient-centered care; equity; and safety. In round 2, they were asked to rate each indicator using a 5-point Likert-type scale with the following values: (1) Totally disagree; (2) Disagree; (3) Moderately agree; (4) Agree; and (5) Totally agree. The criteria for evaluating each indicator were as follows: (1) The indicator is a useful measure for assessing the quality of health care provided to HaH users. (2) The indicator is clearly and specifically written and does not require modification. (3) The indicator is essential and incorporates information that can be extracted from HaH program records. An indicator was considered approved if it received at least 65% approval from the expert panel for each evaluation criterion. In round 3, experts were asked to reassess their ratings, taking into account the opinions of the other experts. The reliability of this technique was ensured through credibility, reliability, and confirmability. We obtained ethical approval of the corresponding institutions and informed consent from the participating experts.

RESULTS

Nine unpublished and reliable indicators were generated. In addition, 13 indicators were incorporated that evaluate aspects previously analyzed by other authors and/or national and international institutions, which were adapted to be used in HaH. The total indicators generated (n = 22) represented all dimensions of the quality of health care: safety; opportunity; effectiveness; efficiency; equity; and patient-centered care.

CONCLUSIONS

The 22 indicators generated through the e-Delphi technique permit a comprehensive evaluation of the quality of health care provided to HaH users.

Nationwide consensus on quality indicators to assess glaucoma care: A modified Delphi approach

PURPOSE

Performance assessments are essential to tracking and improving quality in health care systems. Key aspects of the care process that act as indicators must be measured in order to gain an in-depth understanding of a care unit's operation. Without standardized quality indicators (QIs), it is difficult to characterize and compare the abilities of institutions to achieve excellence. The aim of this study is to reach a consensus among glaucoma specialists concerning the development of a set of QIs to assess the performance of glaucoma care units.

METHODS

A two-round Delphi technique was performed among glaucoma specialists in Portugal, using a 7-point Likert scale. Fifty-three initial statements (comprising process, structure, and outcome indicators) were evaluated and participants had to agree on which ones would be part of the final set of QIs.

RESULTS

By the end of both rounds, 28 glaucoma specialists reached consensus on 30/53 (57%) statements, including 19 (63%) process indicators (mainly relating to the proper implementation of complementary exams and the setting of follow-up intervals), 6 (20%) structure indicators, and 5 (17%) outcome indicators. Of the indicators that were part of the final list, functional and structural aspects of glaucoma progression and the availability of surgical/laser procedures were the most prevalent.

CONCLUSIONS

A set of 30 QIs for measuring the performance of glaucoma units was developed using a consensus methodology involving experts in the field. Their use as measurement standards would provide important information about unit operations and allow further implementation of quality improvements.

Development of a set of quality indicators in paediatric and perinatal care in Japan with a modified Delphi method

BACKGROUNDS

Few paediatric and perinatal quality indicators (QIs) have been developed in the Japanese setting, and the quality of care is not assured or validated. The aim of this study was to develop QIs in paediatric and perinatal care in Japan using an administrative database and confirm the feasibility and applicability of the indicators using a single-site practice test.

METHODS

We used a RAND-modified Delphi method that integrates evidence review with expert consensus development. QI candidates were generated from clinical practice guidelines (CPGs) available in English or Japanese and existing QIs in nine selected paediatric or perinatal conditions. Consensus building was based on independent panel ratings. The performance of QIs was retrospectively assessed using data from an administrative database at the National Children's Hospital. Data between April 2018 and March 2019 were used, while data between April 2019 and March 2021 were also used for selected condition, considering the small number of patients. Each QI was calculated as follows: number of times the indicator was met/number of participants×100.

RESULTS

From the literature review conducted between 2010 and 2020, 124 CPGs and 193 existing indicators were identified to generate QI candidates. Through the consensus-building process, 133 QI candidates were assessed and 79 QIs were accepted. The practice test revealed wide variations in the process-level performance of QIs in four categories: patient safety: median 43.9% (IQR 16.7%-85.6%), general paediatrics: median 98.8% (IQR 84.2%-100%), advanced paediatrics: median 94.4% (IQR 46.0%-100%) and advanced obstetrics: median 80.3% (IQR 59.6%-100%).

CONCLUSIONS

We established 79 QIs for paediatric and perinatal care in Japan using an administrative database that can be applied to hospitals nationwide. The practice test confirmed the measurability of the developed QIs. Benchmarking these QIs will be an attractive approach to improving the quality of care.

Validation of quality indicators for evaluating geriatric pharmacotherapy services in primary care: a mixed methods study

OBJECTIVE

To assess measurement properties of 121 face and content validated quality indicators (QIs) for medication safety in geriatric pharmacotherapy in primary care.

DESIGN

A mixed methods study: a 6-month observational study in primary care (July-December 2020) and in-depth semistructured online interviews with participants (February-March 2021).

SETTING

Sixty community pharmacies in Japan.

PARTICIPANTS

Patients aged 75 years and older who were regularly taking six or more prescription medicines for ˃4 weeks were eligible. The observational study included 457 patients. The interviews were undertaken with 26 community pharmacists, including pharmacy managers and owners.

PRIMARY AND SECONDARY OUTCOME MEASURES

Five measurement properties of QIs (applicability, improvement potential, acceptability, implementation issues and sensitivity to change) were evaluated. A web application was developed for data reporting and data visualisation.

RESULTS

This study showed that 53 QIs met the measurement properties of applicability, improvement potential, acceptability and implementation issues. Of 53 QIs, 17 also had a high sensitivity to change. Interviews identified eight themes (indicator characteristics, web application, policy, patient, time, competence, pharmacy administration and collaboration) in relation to the consequence of implementation of QIs.

CONCLUSIONS

A set of 121 QIs for geriatric pharmacotherapy was field tested for their five measurement properties. This QI set can be used to identify patients who may benefit from clinician reviews of their medicines. These QIs may be applied at different levels within the healthcare system: patient, pharmacy, regional and national levels. Further mechanisms to automatically collect and report data should be established to facilitate sustainable quality improvement initiatives.

Community Environment Co-Production and Environmental Satisfaction of Older Urban Residents in Shanghai, China

OBJECTIVE

Many factors may affect the environmental satisfaction of elderly people, including their sense of involvement. This study examined the associations between community environment co-production and environmental satisfaction in older urban residents in China.

METHODS

A cross-sectional survey was conducted in four age-friendly communities in Shanghai, China. Co-production and environmental satisfaction were assessed through a self-developed questionnaire. General health status was measured through the EuroQol-Visual Analogue Scale (EQ-VAS). Data on affective commitment for the community demographic and health-related factors were also collected. Multilevel linear regression was used to detect the associations.

RESULTS

In total, 480 older urban residents completed the survey. On average, the environment satisfaction score was 76.82/90, 8/10 for co-production, and 87.5/100 for EQ-VAS. Univariate analysis demonstrated environmental satisfaction was associated with educational background, party membership, physical activity, community location, age, sleep hours, co-production, affective commitment, and EQ-VAS. After controlling for confounding factors, the co-production score was significantly associated with higher environmental satisfaction (β = 4.68, p < 0.001). Multiple linear regression revealed that effective commitment for the community (β = 6.17, p < 0.001) and EQ-VAS (β = 0.06, p = 0.002) were also significantly associated with environment satisfaction.

CONCLUSION

Community environment co-production was positively associated with environmental satisfaction among older urban residents in Shanghai. Environmental co-production should be encouraged when developing age-friendly communities for the elderly.

Developing guideline-based key performance indicators for recurrent miscarriage care: lessons from a multi-stage consensus process with a diverse stakeholder group

BACKGROUND

Standardised care pathways tailored to women/couples who experience recurrent miscarriage are needed; however, clinical practice is inconsistent and poorly organised. In this paper, we outline our processes and experiences of developing guideline-based key performance indicators (KPIs) for recurrent miscarriage care with a diverse stakeholder group which will be used to evaluate national services. To date, such exercises have generally only involved clinicians, with the need for greater stakeholder involvement highlighted.

METHODS

Our study involved six stages: (i) identification and synthesis of recommendations for recurrent miscarriage care through a systematic review of clinical practice guidelines; (ii) a two-round modified e-Delphi survey with stakeholders to develop consensus on recommendations and outcomes; (iii) four virtual meetings to develop this consensus further; (iv) development of a list of candidate KPIs; (v) survey to achieve consensus on the final suite of KPIs and a (vi) virtual meeting to agree on the final set of KPIs. Through participatory methods, participants provided feedback on the process of KPI development.

RESULTS

From an initial list of 373 recommendations and 14 outcomes, 110 indicators were prioritised for inclusion in the final suite of KPIs: (i) structure of care (n = 20); (ii) counselling and supportive care (n = 7); (iii) investigations (n = 30); treatment (n = 34); outcomes (n = 19). Participants' feedback on the process comprised three main themes: accessibility, richness in diversity, streamlining the development process.

CONCLUSIONS

It is important and feasible to develop guideline-based KPIs with a diverse stakeholder group. One hundred and ten KPIs were prioritised for inclusion in a suite of guideline-based KPIs for recurrent miscarriage care. Insights into our experiences may help others undertaking similar projects, particularly those undertaken in the absence of a clinical guideline and/or involving a range of stakeholders.

Development and consensus testing of quality indicators for geriatric pharmacotherapy in primary care using a modified Delphi study

Background Polypharmacy is associated with an increased risk of adverse drug events in older people. Although national guidance on geriatric pharmacotherapy exists in Japan, tools to routinely monitor the quality of care provided by community pharmacists are lacking. Aim To develop a set of quality indicators (QIs) to measure the quality of care provided by community pharmacists in improving geriatric pharmacotherapy in primary care in Japan, using a modified Delphi study. Method The development of QIs for the Japanese community pharmacy context followed a two-step process: national guidance review and consensus testing using a modified Delphi study. The latter involved two rounds of rating with a face-to-face meeting between the rounds. Ten experts in geriatric pharmacotherapy in primary care were recruited for the panel discussion. QIs were mapped to three key taxonomies and frameworks: the Anatomical Therapeutic Chemical (ATC) classification system, problems and causes of drug-related problems (DRPs) taxonomy and Donabedian's framework. Results A total of 134 QIs for geriatric pharmacotherapy were developed. This QI set included 111 medicine specific indicators, covering medicines in 243 third-level ATC classifications. QIs were classified into the problem of treatment safety (80%) and causes of drug selection (38%) based on validated classification for DRPs. In Donabedian's framework, most QIs (82%) were process indicators. There were no structure indicators. Conclusion A set of 134 QIs for geriatric pharmacotherapy was rigorously developed. Measurement properties of these QIs will be evaluated for feasibility, applicability, room for improvement, sensitivity to change, predictive validity, acceptability and implementation issues in a subsequent study.

What makes a good quality indicator set? A systematic review of criteria

BACKGROUND

While single indicators measure a specific aspect of quality (e.g. timely support during labour), users of these indicators, such as patients, providers and policy-makers, are typically interested in some broader construct (e.g. quality of maternity care) whose measurement requires a set of indicators. However, guidance on desirable properties of indicator sets is lacking.

OBJECTIVE

Based on the premise that a set of valid indicators does not guarantee a valid set of indicators, the aim of this review is 2-fold: First, we introduce content validity as a desirable property of indicator sets and review the extent to which studies in the peer-reviewed health care quality literature address this criterion. Second, to obtain a complete inventory of criteria, we examine what additional criteria of quality indicator sets were used so far.

METHODS

We searched the databases Web of Science, Medline, Cinahl and PsycInfo from inception to May 2021 and the reference lists of included studies. English- or German-language, peer-reviewed studies concerned with desirable characteristics of quality indicator sets were included. Applying qualitative content analysis, two authors independently coded the articles using a structured coding scheme and discussed conflicting codes until consensus was reached.

RESULTS

Of 366 studies screened, 62 were included in the review. Eighty-five per cent (53/62) of studies addressed at least one of the component criteria of content validity (content coverage, proportional representation and contamination) and 15% (9/62) addressed all component criteria. Studies used various content domains to structure the targeted construct (e.g. quality dimensions, elements of the care pathway and policy priorities), providing a framework to assess content validity. The review revealed four additional substantive criteria for indicator sets: cost of measurement (21% [13/62] of the included studies), prioritization of 'essential' indicators (21% [13/62]), avoidance of redundancy (13% [8/62]) and size of the set (15% [9/62]). Additionally, four procedural criteria were identified: stakeholder involvement (69% [43/62]), using a conceptual framework (44% [27/62]), defining the purpose of measurement (26% [16/62]) and transparency of the development process (8% [5/62]).

CONCLUSION

The concept of content validity and its component criteria help assessing whether conclusions based on a set of indicators are valid conclusions about the targeted construct. To develop a valid indicator set, careful definition of the targeted construct including its (sub-)domains is paramount. Developers of quality indicators should specify the purpose of measurement and consider trade-offs with other criteria for indicator sets whose application may reduce content validity (e.g. costs of measurement) in light thereof.

Suggested Canadian Standards for Perioperative/Periprocedure Glycemic Management in Patients With Type 1 and Type 2 Diabetes

OBJECTIVES

The goal of this quality initiative was to develop consensus standards for glycemic management of patients with diabetes who undergo surgical procedures in Canada.

METHODS

A modified Delphi method was used to gather broad stakeholder input and arrive at a consensus for perioperative/periprocedure diabetes management.

RESULTS

Glycemic management standards were developed for the following categories: Organization of Care; Preoperative Assessment; Immediate Preoperative and Intraoperative; Postanesthesia Care Unit or Recovery Room; Postoperative Period; and Transition to Outpatient Care.

CONCLUSIONS

It is anticipated these standards will serve as a basis to develop clinical tools to support the recommendations.

Perioperative diabetes management of adult patients with diabetes: a best practice implementation project

ABSTRACT

The project's purpose was to implement and assess the effectiveness of evidence-based best practice recommendations for perioperative diabetes management of adult patients with diabetes who underwent a surgical procedure.

Developing and testing a set of quality indicators for pharmacist home visit services: A mixed methods study in Japan

OBJECTIVE

Quality indicators (QIs) are an important mechanism by which health services can be evaluated. We aimed to develop a set of QIs for pharmacist home visit services and assess their measurement properties.

METHODS

A three-step procedure was applied: (1) Selection of existing content-validated QIs from the international literature and the development of QIs based on national guidelines and home healthcare professionals' opinions; (2) Expert panel consensus of a preliminary set of QIs using the RAND/UCLA Appropriateness Method; (3) Field testing to evaluate their measurement properties (feasibility, applicability, improvement potential, discriminatory capacity, sensitivity to change, acceptability and implementation issues) followed by exploratory semistructured interviews in Japan.

RESULTS

Fifty-two preliminary QIs were prepared and 45 were judged as "appropriate"by the expert panel. Sixty-one community pharmacies were recruited to this study with 41 contributing QI data monthly over the 6-month period. Field testing showed that 20 QIs met six measurement properties (ie, feasibility, applicability, improvement potential, discriminatory capacity, acceptability and implementation issues). Nine of these QIs also had high sensitivity to change. Additionally, interviews identified that the main positive impact on practice of using QIs was the early detection of causes of drug-related problems but a negative impact was decrease of pharmacists' motivation. Auto extraction of QIs was seen as a major facilitator, given the time taken to manually extract QI data.

CONCLUSIONS

A set of QIs for pharmacist home visit services was rigorously developed and tested. This QI set may be useful in evaluating the quality of such services.

Approaches of integrating the development of guidelines and quality indicators: a systematic review

Background

Guidelines and quality indicators (for example as part of a quality assurance scheme) aim to improve health care delivery and health outcomes. Ideally, the development of quality indicators should be grounded in evidence-based, trustworthy guideline recommendations. However, anecdotally, guidelines and quality assurance schemes are developed independently, by different groups of experts who employ different methodologies. We conducted an extension and update of a previous systematic review to identify, describe and evaluate approaches to the integrated development of guidelines and related quality indicators.

Methods

On May 24th, 2019 we searched in Medline, Embase and CINAHL and included studies if they reported a methodological approach to guideline-based quality indicator development and were published in English, French, or German.

Results: Out of 16,034 identified records, we included 17 articles that described a method to integrate guideline recommendations development and quality indicator development. Added to the 13 method articles from original systematic review we included a total 30 method articles. We did not find any evaluation studies. In most approaches, guidelines were a source of evidence to inform the quality indicator development. The criteria to select recommendations (e.g. level of evidence or strength of the recommendation) and to generate, select and assess quality indicators varied widely. We found methodological approaches that linked guidelines and quality indicator development explicitly, however none of the articles reported a conceptual framework that fully integrated quality indicator development into the guideline process or where quality indicator development was part of the question formulation for developing the guideline recommendations.

Conclusions

In our systematic review we found approaches which explicitly linked guidelines with quality indicator development, nevertheless none of the articles reported a comprehensive and well-defined conceptual framework which integrated quality indicator development fully into the guideline development process.

Development of quality indicators for the management of Staphylococcus aureus bacteraemia

Background

Staphylococcus aureus bacteraemia (SAB) is a serious and often fatal infectious disease. The quality of management of SAB is modifiable and can thus affect the outcome. Quality indicators (QIs) can be used to measure the quality of care of the various aspects of SAB management in hospitals, enabling professionals to identify targets for improvement and stimulating them to take action.

Objectives

To develop QIs for the management of hospitalized patients with SAB.

Methods

A RAND-modified Delphi procedure was used to develop a set of QIs for the management of SAB in hospitalized patients. First, available QIs for the management of SAB were extracted from the literature published since 1 January 2000 (MEDLINE and Embase databases). Thereafter, an international multidisciplinary expert panel appraised these QIs during two questionnaire rounds with an intervening face-to-face meeting.

Results

The literature search resulted in a list of 39 potential QIs. After appraisal by 30 medical specialists, 25 QIs describing recommended care at patient level were selected. These QIs defined appropriate follow-up blood cultures (n=2), echocardiography (n=6), source control (n=4), antibiotic therapy (n=7), antibiotic dose adjustment (n=2), intravenous-to-oral switch (n=2), infectious disease consultation (n=1) and medical discharge report (n=1).

Conclusions

A set of 25 QIs for the management of SAB for hospitalized patients was developed by using a RAND-modified Delphi procedure among international experts. These QIs can measure the quality of various aspects of SAB management. This information can be fed back to the relevant stakeholders in order to identify improvement targets and optimize care.

Applicability of care quality indicators for women with low-risk pregnancies planning hospital birth: a retrospective study of medical records

Practices for planned birth among women with low-risk pregnancies vary by birth setting, medical professional, and organizational system. Appropriate monitoring is essential for quality improvement. Although sets of quality indicators have been developed, their applicability has not been tested. To improve the quality of childbirth care for low-risk mothers and infants in Japanese hospitals, we developed 35 quality indicators using existing clinical guidelines and quality indicators. We retrospectively analysed data for 347 women in Japan diagnosed with low-risk pregnancy in the second trimester, admitted between April 2015 and March 2016. We obtained scores for 35 quality indicators and evaluated their applicability, i.e., feasibility, improvement potential, and reliability (intra- and inter-rater reliability: kappa score, positive and negative agreement). The range of adherence to each indicator was 0-95.7%. We identified feasibility concerns for six indicators with over 25% missing data. Two indicators with over 90% adherence showed limited potential for improvement. Three indicators had poor kappa scores for intra-rater reliability, with positive/negative agreement scores 0.94/0.33, 0.33/0.95, and 0.00/0.97, respectively. Two indicators had poor kappa scores for inter-rater reliability, with positive/negative agreement scores 0.25/0.92 and 0.68/0.61, respectively. The findings indicated that these 35 care quality indicators for low-risk pregnant women may be applicable to real-world practice, with some caveats.

Developing medical record-based, healthcare quality indicators for psychiatric hospitals in China: a modified Delphi-Analytic Hierarchy Process study

OBJECTIVES

To develop a medical record-based, comprehensive system of healthcare quality indicators for psychiatric hospitals in China.

DESIGN

A modified Delphi process with analytic hierarchy process (AHP) was used.

PARTICIPANTS

Twenty nationally-recognized experts were invited to participate in two rounds of Delphi expert consultation and AHP.

METHODS

Fifty potential indicators were included based on literature review, and 20 experts were asked to rate the importance of each indicator using two rounds of email surveys. The AHP was used to determine the relative importance of the finalized quality indicators.

RESULTS

The average authoritative coefficient was 0.92 ± 0.07. After two rounds of Delphi consultation, 47 healthcare quality indicators were identified for Chinese psychiatric hospitals. The mean importance ratings ranged from 7.06 to 8.84 on a nine-point scale, with variation coefficients ranging from 0.04 to 0.22. The percentage of full score for potential indicators ranged from 16% to 74%. In two rounds, the Kendall's W coefficients ranged from 0.423 to 0.535. The weights of structure, process and outcome were 0.175, 0.211 and 0.614, respectively.

CONCLUSION

We developed the first set of healthcare quality indicators for psychiatric hospitals in mainland China, and it will provide a standardized and meaningful guide to evaluate the healthcare quality of psychiatric hospitals across the country.

Reducing AB plasma utilisation through the AB plasma appropriateness index

OBJECTIVES

We hypothesised that there was inappropriate group AB plasma used in our hospital, identifiable by a novel key quality indicator (KQI) and mitigable through massive transfusion protocol (MTP) modification.

BACKGROUND

Group AB plasma is a scarce resource strained by increasing usage worldwide when used as universal donor plasma in non-group AB patients. To reduce inappropriate use and to promote benchmarking to the best practice, we developed the AB plasma appropriateness index (ABAI). ABAI is the ratio of AB plasma transfused to group AB or unknown blood group patients to all AB plasma utilised, where values closer to 1 are better.

METHODS

Data collected included AB plasma disposition by blood group, indications for transfusion, total blood utilisation, patient clinical characteristics and outcomes. ABAI during a 12-month period was retrospectively assessed, which led to implementation of pre-thawed group A plasma instead of group AB plasma for trauma patients starting in July 2017.

RESULTS

The ABAI retrospectively showed inappropriate use in non-group AB patients in our hospital, the majority used to avoid expiry after thaw. When comparing 1-year pre- and post-implementation periods, ABAI improved from 0·464 to 0·900 (P < 0·0001). After exclusion of therapeutic plasma exchange, ABAI still improved (0·486-0·720, P < 0·0001). No differences in the length of stay or mortality associated in 32 patients receiving group A plasma for emergency release were observed.

CONCLUSION

The ABAI is a novel KQI to indicate inappropriate AB plasma usage for quality improvement. This led to thawed A plasma use for MTPs, reducing inappropriate AB plasma usage.

The development of indicator measure for monitoring the quality of patient-centered care in China's tertiary hospitals

OBJECTIVE

To develop a set of structure and process indicators to evaluate tertiary hospitals' performance in the Healthcare Improvement Initiative, a national program with a goal to improve quality of patient-centered care.

METHODS

A modified Delphi technique, including literature review, multidisciplinary panel meeting and anonymous rating, was used to generate a set of indicators. A practice test involving both general and special hospitals was conducted to ensure the feasibility of data collection for these indicators.

RESULTS

62 indicators were generated by literature review. The panel review procedure involving 39 panelists with diverse backgrounds resulted in a total of 59 indicators, which included 40 qualitative indicators and 19 quantitative indicators. In the practice test, six quantitative indicators were found unfeasible. According to the suggestion of the experts in the hospital evaluation committee, three of those indicators were kept by adjusting their data collection methods, while other three ones were discarded.

DISCUSSION

A set of 56 structure and process indicators was developed to evaluate hospitals' performance in the implementation of the Healthcare Improvement Initiative, which could be used in both general and special tertiary hospitals. Results of the indicator measurement could present a panorama of the quality of patient-centered care in tertiary hospitals nation-wide, and inform health administrators of the ways to attain the goal of the Initiative.

Quality indicators for responsible use of medicines: a systematic review

OBJECTIVE

All healthcare systems require valid ways to evaluate service delivery. The objective of this study was to identify existing content validated quality indicators (QIs) for responsible use of medicines (RUM) and classify them using multiple frameworks to identify gaps in current quality measurements.

DESIGN

Systematic review without meta-analysis.

SETTING

All care settings.

SEARCH STRATEGY

CINAHL, Embase, Global Health, International Pharmaceutical Abstract, MEDLINE, PubMed and Web of Science databases were searched up to April 2018. An internet search was also conducted. Articles were included if they described medication-related QIs developed using consensus methods. Government agency websites listing QIs for RUM were also included.

ANALYSIS

Several multidimensional frameworks were selected to assess the scope of QI coverage. These included Donabedian's framework (structure, process and outcome), the Anatomical Therapeutic Chemical (ATC) classification system and a validated classification for causes of drug-related problems (c-DRPs; drug selection, drug form, dose selection, treatment duration, drug use process, logistics, monitoring, adverse drug reactions and others).

RESULTS

2431 content validated QIs were identified from 131 articles and 5 websites. Using Donabedian's framework, the majority of QIs were process indicators. Based on the ATC code, the largest number of QIs pertained to medicines for nervous system (ATC code: N), followed by anti-infectives for systemic use (J) and cardiovascular system (C). The most common c-DRPs pertained to 'drug selection', followed by 'monitoring' and 'drug use process'.

CONCLUSIONS

This study was the first systematic review classifying QIs for RUM using multiple frameworks. The list of the identified QIs can be used as a database for evaluating the achievement of RUM. Although many QIs were identified, this approach allowed for the identification of gaps in quality measurement of RUM. In order to more effectively evaluate the extent to which RUM has been achieved, further development of QIs may be required.

Quality indicators assessing antibiotic use in the outpatient setting: a systematic review followed by an international multidisciplinary consensus procedure

Objectives

Quality indicators (QIs) assessing the appropriateness of antibiotic use are essential to identify targets for improvement and guide antibiotic stewardship interventions. The aim of this study was to develop a set of QIs for the outpatient setting from a global perspective.

Methods

A systematic literature review was performed by searching MEDLINE and relevant web sites in order to retrieve a list of QIs. These indicators were extracted from published trials, guidelines, literature reviews or consensus procedures. This evidence-based set of QIs was evaluated by a multidisciplinary, international group of stakeholders using a RAND-modified Delphi procedure, using two online questionnaires and a face-to-face meeting between them. Stakeholders appraised the QIs' relevance using a nine-point Likert scale. This work is part of the DRIVE-AB project.

Results

The systematic literature review identified 43 unique QIs, from 54 studies and seven web sites. Twenty-five stakeholders from 14 countries participated in the consensus procedure. Ultimately, 32 QIs were retained, with a high level of agreement. The set of QIs included structure, process and outcome indicators, targeting both high- and middle- to low-income settings. Most indicators focused on general practice, addressing the common indications for antibiotic use in the community (particularly urinary and respiratory tract infections), and the organization of healthcare facilities. Twelve indicators specifically addressed outpatient parenteral antimicrobial therapy (OPAT).

Conclusions

We identified a set of 32 outpatient QIs to measure the appropriateness of antibiotic use. These QIs can be used to identify targets for improvement and to evaluate the effects of antibiotic stewardship interventions.

Impact of a multifaceted strategy to improve perioperative diabetes care

AIMS

To assess the impact of a multifaceted strategy to improve perioperative diabetes care throughout the hospital care pathway.

METHODS

We conducted a controlled before-and-after study in six hospitals. The purpose of the strategy was to target four predominant barriers that obstruct optimal care delivery. We provided feedback on baseline indicator performance, developed a multidisciplinary protocol and patient information, and provided professional education. After a 6-month intervention, we determined the performance changes against three outcome indicators and nine process indicators using data on 811 patients with diabetes who underwent major surgery. The progress of the interventions was monitored closely.

RESULTS

Two process indicators improved significantly in the intervention hospitals: the proportion of patients for whom glycaemic control had been evaluated preoperatively increased by 9% (P < 0.002) and the proportion of patients with blood glucose measurements within 1 h after surgery increased by 29% (P < 0.0001). Four other process indicators and all three outcome indicators improved more in the intervention hospitals than in the control hospitals, but the differences were not statistically significant. These included the proportion of patients with all glucose values at 6-10 mmol/l (+3%) and the proportion of patients with hyperglycaemia (-8%). The implementation of the multidisciplinary protocol was still ongoing after the 6-month intervention period.

CONCLUSIONS

The multifaceted improvement strategy had a limited impact on the quality of perioperative diabetes care. This study demonstrates the complexity of improving perioperative diabetes care throughout the multiprofessional hospital care pathway.

Proposal of quality indicators for cardiac rehabilitation after acute coronary syndrome in Japan: a modified Delphi method and practice test

OBJECTIVES

Cardiac rehabilitation is underused and its quality in practice is unclear. A quality indicator is a measurable element of clinical practice performance. This study aimed to propose a set of quality indicators for cardiac rehabilitation following an acute coronary event in the Japanese population and conduct a small-size practice test to confirm feasibility and applicability of the indicators in real-world clinical practice.

DESIGN AND SETTING

This study used a modified Delphi technique (the RAND/UCLA appropriateness method), a consensus method which involves an evidence review, a face-to-face multidisciplinary panel meeting and repeated anonymous rating. Evidence to be reviewed included clinical practice guidelines available in English or Japanese and existing quality indicators. Performance of each indicator was assessed retrospectively using medical records at a university hospital in Japan.

PARTICIPANTS

10 professionals in cardiac rehabilitation for the consensus panel.

RESULTS

In the literature review, 23 clinical practice guidelines and 16 existing indicators were identified to generate potential indicators. Through the consensus-building process, a total of 30 indicators were assessed and finally 13 indicators were accepted. The practice test (n=39) revealed that 74% of patients underwent cardiac rehabilitation. Median performance of process measures was 93% (IQR 46-100%). 'Communication with the doctor who referred the patient to cardiac rehabilitation' and 'continuous participation in cardiac rehabilitation' had low performance (32% and 38%, respectively).

CONCLUSIONS

A modified Delphi technique identified a comprehensive set of quality indicators for cardiac rehabilitation. The single-site, small-size practice test confirmed that most of the proposed indicators were measurable in real-world clinical practice. However, some clinical processes which are not covered by national health insurance in Japan had low performance. Further studies will be needed to clarify and improve the quality of care in cardiac rehabilitation.