Defining and Measuring Quality Outcomes in Long-Term Care

Physician Practice in Ontario Nursing Homes: Defining Physician Commitment

OBJECTIVES

To characterize the practice profile of nursing home (NH) physicians in Ontario, Canada.

DESIGN

Population-based cross-sectional study.

SETTING AND PARTICIPANTS

A total of 1527 most responsible physicians (MRPs) across 626 NHs in Ontario, Canada, for the calendar year, 2017.

METHODS

We examined physician services within all publicly regulated and funded NH facilities. Descriptive summaries were generated to characterize MRPs and their practice patterns by the physician's primary practice location, the NH facility size, and the proportion of physician billings that occurred within NHs. Community sizes were classified into quintiles based on population size and assigned as urban or rural. The number of ministry-designated NH beds were assessed by quintiles to examine physician services by facility size. We also assessed the proportion of physician billings within NHs by quintiles.

RESULTS

MRPs tended to be older, male, and practice family medicine. The majority of MRPs practiced in communities with populations exceeding 100,000 residents, although physicians with greater NH billings tended to practice in rural locations. The mean number of NH residents that a physician was MRP for was positively associated with the community size. Physicians provided care for more NH residents than they were assigned most responsible. Fifty-one percent of physicians were MRP for 90% of all NH residents.

CONCLUSIONS AND IMPLICATIONS

Our work provides an exemplar for characterizing physician commitment in NHs, using 2 approaches, according to the NH specialist model. We demonstrated the medical practice characteristics, locations, and billing patterns of physicians within Ontario NHs. Future work can investigate the association between physician commitment and the quality of care provided to NH residents. A greater understanding of physician commitment may lead to the development of quality metrics based on physician practice patterns.

Identifying the Service Capability of Long-Term Care Facilities in China: An e-Delphi Study

Objective

This study develops a group of service capability indicators for long-term care facilities to assess their current conditions and makes it the first step toward the improvement of service capability in China.

Methods

We constructed an initial indicator framework based on the characteristics of long-term care services and a literature review. Potential indicators were collected, and a 2-round modified web-based Delphi process was conducted by a national multidisciplinary expert panel to construct a service capability evaluation index system. The accepted competencies of indicators were established with mean scores in all three scoring criteria (importance, feasibility, and sensitivity) ≥ 4.0, consensus rate reached 70.0%, and a coefficient of variation ≤ 0.25.

Results

A new indicator framework covering 2 dimensions of inputs and activities was developed in this study. The initial 35 indicators formed an indicator pool for the Delphi questionnaire. According to the final consensus of the expert panel, the Delphi consultation resulted in an index system comprised 31 tertiary indicators across six subdimensions (i) staffing; (ii) facilities and equipment; (iii) funding; (iv) medical inspection services; (v) health management services; (vi) institutional standard management.

Conclusion

This study developed a set of indicators suitable for the long-term care system in China and is expected to be applied to measure and improve the service capability of long-term care facilities. In addition, these indicators can be used for comparisons between different LTCFs and provide an evidence basis for the further development of capability assessment tools.

Assessing Nursing Homes Quality Indicators' Between-Provider Variability and Reliability: A Cross-Sectional Study Using ICCs and Rankability

Nursing home quality indicators are often used to publicly report the quality of nursing home care. In Switzerland, six national nursing home quality indicators covering four clinical domains (polypharmacy, pain, use of physical restraints and weight loss) were recently developed. To allow for meaningful comparisons, these indicators must reliably show differences in quality of care levels between nursing homes. This study’s objectives were to assess nursing home quality indicators’ between-provider variability and reliability using intraclass correlations and rankability. This approach has not yet been used in long-term care contexts but presents methodological advantages. This cross-sectional multicenter study uses data of 11,412 residents from a convenience sample of 152 Swiss nursing homes. After calculating intraclass correlation 1 (ICC1) and rankability, we describe between-provider variability for each quality indicator using empirical Bayes estimate-based caterpillar plots. To assess reliability, we used intraclass correlation 2 (ICC2). Overall, ICC1 values were high, ranging from 0.068 (95% confidence interval (CI) 0.047–0.086) for polypharmacy to 0.396 (95% CI 0.297–0.474) for physical restraints, with quality indicator caterpillar plots showing sufficient between-provider variability. However, testing for rankability produced mixed results, with low figures for two indicators (0.144 for polypharmacy; 0.471 for self-reported pain) and moderate to high figures for the four others (from 0.692 for observed pain to 0.976 for physical restraints). High ICC2 figures, ranging from 0.896 (95% CI 0.852–0.917) (self-reported pain) to 0.990 (95% CI 0.985–0.993) (physical restraints), indicated good reliability for all six quality indicators. Intraclass correlations and rankability can be used to assess nursing home quality indicators’ between-provider variability and reliability. The six selected quality indicators reliably distinguish care differences between nursing homes and can be recommended for use, although the variability of two—polypharmacy and self-reported pain—is substantially chance-driven, limiting their utility.

Patient-reported experience measures are essential to improving quality of care for chronic wounds: An international qualitative study

Traditional quality measures for chronic wounds have focused on objective outcomes that are challenging to risk adjust, lack patient input, and have limited ability to inform quality improvement interventions. Patient-reported experience measures (PREMs) provide information from the patient perspective regarding health care quality and have potential to improve patient-centredness, increase care efficiency, and generate actionable data for quality improvement. The purpose of this study was to understand patient experiences and health care processes that impact quality of care among patients with chronic wounds. Sixty patients at least 18 years of age with various wound aetiologies were recruited from Canada, Denmark, The Netherlands, and the United States as part of a larger phase 1 qualitative study to develop a patient-reported outcome measure for chronic wounds (WOUND-Q). All patients had a chronic wound for at least 3 months, were fluent in their native speaking language, and able to participate in a one-on-one semi-structured interview. Interviews were digitally recorded and transcribed verbatim. Interpretive description was used to identify recurrent themes relating to patient experience and quality of care. We identified five domains (care coordination, establishing/obtaining care, information delivery, patient-provider interaction, and treatment delivery) and 21 sub-domains (access to patient information, interdisciplinary communication, encounter efficiency, provider availability, specialist referral, staff professionalism, travel/convenience, modality, reciprocity, understandability/consistency, accountability, continuity, credentials, rapport, appropriateness, complication management, continuity, environment/setting, equipment and supply needs, expectation, and patient-centred) as potential opportunities to measure and improve quality of care in the chronic wound population. PREMs for chronic wounds represent an important opportunity to engage patients and longitudinally assess quality across clinical settings and providers. Future research should focus on developing PREMs to complement traditional objective and patient-reported outcome measures for chronic wounds.

How to assess experienced quality of care in nursing homes from the client's perspective: results of a qualitative study

BACKGROUND

The culture shift in nursing homes from task-oriented to person-centered care has created a need to assess clients' experienced quality of care (QoC), as this corresponds best with what matters to them. This study aimed to gain insight into how to assess experienced QoC in nursing homes from the client's perspective.

METHOD

A qualitative study was performed consisting of a focus group with client representatives (n = 10), a focus group with nursing home staff (n = 9) and a world café with client representatives and staff recruited from the Living Lab in Ageing & Long-Term Care (n = 24). Three questions about assessing experienced QoC from the client's perspective were addressed during data collection: 1) What content needs to be assessed? 2) What assessment procedures are needed? and, 3) Who needs to be involved in the assessment? Semi-structured questions, photo elicitation and creative writing were used to answer these questions. Conventional content analysis was used to analyze the data.

RESULTS

Participants indicated that experienced QoC mostly occurs within the interactions between clients, family and staff, highlighting the impact of relationships. They suggested assessments should focus on three aspects: 1) knowledge about the client, 2) a responsive approach, and 3) a caring environment. These can be assessed by having conversations with clients, their families and staff, and additionally observing the clients in their living environments. Sufficient time and resources are prerequisites for this. Additionally, the person performing the quality assessments needs to possess certain communication and empathy skills.

CONCLUSION

It is important to include the perspectives of the client, family and staff when assessing experienced QoC, in line with the principles underlying relationship-centered care. In order to be feasible, it is recommended to incorporate quality assessments into the nursing homes' daily routines. Further research with clients, family and staff in nursing homes is needed to develop a feasible, reliable and valid method that assesses experienced QoC from the client's perspective.

Quality Clinical Care in Nursing Facilities

Despite improvements in selected nursing facility (NF) quality measures such as reduction in antipsychotic use; local, state, and national initiatives; and regulatory incentives, the quality of clinical care delivered in this setting remains inconsistent. Herein, recommendations for overcoming barriers to achieving consistent, high-quality clinical outcomes in long-term (LTC) and post-acute care are provided to address inadequate workforce, suboptimal culture and interprofessional teamwork, insufficiently evidence-based processes of care, and poor adoption and fidelity of technology and integrated clinical decision support. With high staff attrition rates in NFs, mechanisms to measure and close knowledge gaps as well as opportunities for practice simulations should be available to educate and ensure adoption of clinical quality standards on clinician hiring and on an ongoing basis. Multipronged, integrated approaches are needed to further the quest for sustainment of high clinical quality in NF care. In addition to setting a tone for attainment of clinical quality, leadership should champion adoption of practice standards, quality initiatives, and evidence-based guidelines. Maintaining an optimal ratio of hours per resident per day of nurses and nurse aides can improve quality outcomes and staff satisfaction. Clinicians must consistently and effectively apply care processes that include recognition, problem definition, diagnosis, goal identification, intervention, and monitoring resident progress. In order to do so they must have rapid, easy access to necessary tools, including evidence-based standards, algorithms, care plans, during the care delivery process. Embedding such tools into workflow of electronic health records has the potential to improve quality outcomes. On a national and international level, quality standards should be developed by interprofessional LTC experts committed to applying the highest levels of clinical evidence to improve the care of older persons. The standards should be realistic and practical, and basic principles of implementation science must be used to achieve the desired outcomes.

Understanding and benchmarking health service achievement of policy goals for chronic disease

BACKGROUND

Key challenges in benchmarking health service achievement of policy goals in areas such as chronic disease are: 1) developing indicators and understanding how policy goals might work as indicators of service performance; 2) developing methods for economically collecting and reporting stakeholder perceptions; 3) combining and sharing data about the performance of organizations; 4) interpreting outcome measures; 5) obtaining actionable benchmarking information. This study aimed to explore how a new Boolean-based small-N method from the social sciences-Qualitative Comparative Analysis or QCA-could contribute to meeting these internationally shared challenges.

METHODS

A 'multi-value QCA' (MVQCA) analysis was conducted of data from 24 senior staff at 17 randomly selected services for chronic disease, who provided perceptions of 1) whether government health services were improving their achievement of a set of statewide policy goals for chronic disease and 2) the efficacy of state health office actions in influencing this improvement. The analysis produced summaries of configurations of perceived service improvements.

RESULTS

Most respondents observed improvements in most areas but uniformly good improvements across services were not perceived as happening (regardless of whether respondents identified a state health office contribution to that improvement). The sentinel policy goal of using evidence to develop service practice was not achieved at all in four services and appears to be reliant on other kinds of service improvements happening.

CONCLUSIONS

The QCA method suggested theoretically plausible findings and an approach that with further development could help meet the five benchmarking challenges. In particular, it suggests that achievement of one policy goal may be reliant on achievement of another goal in complex ways that the literature has not yet fully accommodated but which could help prioritize policy goals. The weaknesses of QCA can be found wherever traditional big-N statistical methods are needed and possible, and in its more complex and therefore difficult to empirically validate findings. It should be considered a potentially valuable adjunct method for benchmarking complex health policy goals such as those for chronic disease.

My eyes, your eyes--the relationship between CMS five-star rating of nursing homes and family rating of experience of care in Maryland

In 2008, the Centers for Medicaid and Medicare Services (CMS) launched the Five-Star Quality Rating System to help consumers compare nursing homes. The quality rating system consists of three domains: nursing home inspection results, staffing, and quality measures (QMs) and an overall rating calculated from the three domains. The Five-Star System has both advocates and detractors. One source of criticism about the rating system is its lack of input from consumer surveys. Although different dimensions of quality have been recognized as important by the experts and studied in the literature, how these dimensions are linked with each other is largely unknown. This article describes an analysis of the relationship between overall experience of care ratings from a family survey and ratings obtained on the CMS Five-Star Quality Rating for Maryland nursing homes. The results indicated a strong positive correlation between family experience of care score and two five-star domains, namely health inspections and nurse staffing, and no relationship with the quality domain. The lack of relationship between the quality domain and the family score may be due to inadequate risk adjustment or that each rating system measures different aspects of quality.

Applying market-based reforms to long-term care

Recent trends in U.S. long-term care policy reflect three broad goals Americans have for the quality of long-term care: improving quality of life, reducing fragmentation of delivery and financing, and increasing use of home and community-based care. At the same time, market-based reforms--namely, public reporting and pay-for-performance--have taken on their own momentum, aimed at improving the clinical quality of care among nursing home and home health care providers. The focus of reporting systems should be broadened to include quality of life in addition to clinical quality and to make measures less dependent on the setting in which care is delivered.

Beyond the 'iron lungs of gerontology': using evidence to shape the future of nursing homes in Canada

Institutionalization of the Elderly in Canada suggested that efforts to address the underlying causes of age-related declines in health might negate the need for nursing homes. However, the prevalence of chronic disease has increased, and conditions like dementia mean that nursing homes are likely to remain important features of the Canadian health care system. A fundamental problem limiting the ability to understand how nursing homes may change to better meet the needs of an aging population was the lack of person-level clinical information. The introduction of interRAI assessment instruments to most Canadian provinces/territories and the establishment of the national Continuing Care Reporting System represent important steps in our capacity to understand nursing home care in Canada. Evidence from eight provinces and territories shows that the needs of persons in long-term care are highly complex, resource allocations do not always correspond to needs, and quality varies substantially between and within provinces.

Cancer in long-term care

This article describes the range of cancer patients in longterm care and provides a framework for clinical decision making. The benefits and burdens of providing standard therapy to a vulnerable population are discussed. To give more specific guidelines for advocates of treatment, skeptics, and others, the authors present best estimates of the current burden of cancer in the long-term care population and current screening guidelines that apply to the elderly under long-term care. Experience-based suggestions are offered for oncologists and clinicians involved in long-term care to help them respond to patient and family concerns about limitations of cancer care.

Temporal and Geographic variation in the validity and internal consistency of the Nursing Home Resident Assessment Minimum Data Set 2.0

Background

The Minimum Data Set (MDS) for nursing home resident assessment has been required in all U.S. nursing homes since 1990 and has been universally computerized since 1998. Initially intended to structure clinical care planning, uses of the MDS expanded to include policy applications such as case-mix reimbursement, quality monitoring and research. The purpose of this paper is to summarize a series of analyses examining the internal consistency and predictive validity of the MDS data as used in the "real world" in all U.S. nursing homes between 1999 and 2007.

Methods

We used person level linked MDS and Medicare denominator and all institutional claim files including inpatient (hospital and skilled nursing facilities) for all Medicare fee-for-service beneficiaries entering U.S. nursing homes during the period 1999 to 2007. We calculated the sensitivity and positive predictive value (PPV) of diagnoses taken from Medicare hospital claims and from the MDS among all new admissions from hospitals to nursing homes and the internal consistency (alpha reliability) of pairs of items within the MDS that logically should be related. We also tested the internal consistency of commonly used MDS based multi-item scales and examined the predictive validity of an MDS based severity measure viz. one year survival. Finally, we examined the correspondence of the MDS discharge record to hospitalizations and deaths seen in Medicare claims, and the completeness of MDS assessments upon skilled nursing facility (SNF) admission.

Results

Each year there were some 800,000 new admissions directly from hospital to US nursing homes and some 900,000 uninterrupted SNF stays. Comparing Medicare enrollment records and claims with MDS records revealed reasonably good correspondence that improved over time (by 2006 only 3% of deaths had no MDS discharge record, only 5% of SNF stays had no MDS, but over 20% of MDS discharges indicating hospitalization had no associated Medicare claim). The PPV and sensitivity levels of Medicare hospital diagnoses and MDS based diagnoses were between .6 and .7 for major diagnoses like CHF, hypertension, diabetes. Internal consistency, as measured by PPV, of the MDS ADL items with other MDS items measuring impairments and symptoms exceeded .9. The Activities of Daily Living (ADL) long form summary scale achieved an alpha inter-consistency level exceeding .85 and multi-item scale alpha levels of .65 were achieved for well being and mood, and .55 for behavior, levels that were sustained even after stratification by ADL and cognition. The Changes in Health, End-stage disease and Symptoms and Signs (CHESS) index, a summary measure of frailty was highly predictive of one year survival.

Conclusion

The MDS demonstrates a reasonable level of consistency both in terms of how well MDS diagnoses correspond to hospital discharge diagnoses and in terms of the internal consistency of functioning and behavioral items. The level of alpha reliability and validity demonstrated by the scales suggest that the data can be useful for research and policy analysis. However, while improving, the MDS discharge tracking record should still not be used to indicate Medicare hospitalizations or mortality. It will be important to monitor the performance of the MDS 3.0 with respect to consistency, reliability and validity now that it has replaced version 2.0, using these results as a baseline that should be exceeded.

Not so black and white: nursing home concentration of Hispanics associated with prevalence of pressure ulcers

OBJECTIVE

To examine the association between the nursing home (NH) concentration of Hispanics and prevalence of pressure ulcer.

DESIGN

Secondary data analysis using data from the national repository of the 2000 Minimum Data Set (MDS) and On-Line Survey Certification and Reporting (OSCAR) data. We used a multivariate logistic model, with the Huber-White correction to account for clustering of persons within a nursing facility, to examine the association of Hispanic NH concentration with the prevalence of pressure ulcers, after adjusting for resident level characteristics.

SETTING

Five states with a high population of Mexican-Americans (California, New Mexico, Arizona, Colorado, and Texas).

PARTICIPANTS

A total of 74,343 persons (9.26% black, 11.28% Hispanic, 79.46% non-Hispanic white) in a NH located in 1 of these 5 states during the last quarter of 2000.

MEASUREMENTS

The prevalence of Stage II-IV pressure ulcers was examined in the last quarter of 2000. Stage II-IV pressure ulcers, resident demographics, and medical illness data were documented by nursing staff on the MDS.

RESULTS

Hispanics and non-Hispanic blacks had a higher prevalence of pressure ulcers than non-Hispanic whites (7.60%, 9.71% and 12.10%, respectively). A facility's concentration of Hispanic residents was associated with prevalent pressure ulcers after adjustment for resident characteristics.

CONCLUSIONS

Residents in nursing homes in which there is a higher concentration of Hispanic residents are more likely to have a pressure ulcer.

Does risk adjustment of the CMS quality measures for nursing homes matter?

BACKGROUND

The Centers for Medicare and Medicaid Services (CMS) publish a report card for nursing homes with 19 clinical quality measures (QMs). These measures include minimal risk adjustment.

OBJECTIVES

To develop QMs with more extensive risk adjustment and to investigate the impact on quality rankings.

RESEARCH DESIGN

Retrospective analysis of individual level data reported in the Minimum Data Set (MDS). Random effect logistic models were used to estimate risk adjustment models for 5 outcomes: pressure ulcers for high and low risk patients, physical restraints, and pain for long- and short-stay patients. These models were used to create 5 QMs with extended risk adjustment, enhanced QMs (EQMs). The EQMs were compared with the corresponding QMs.

SUBJECTS

All (17,469) nursing homes that reported MDS data in the period 2001-2005, and their 9.6 million residents.

MEASURES

QMs were compared with EQMs for all nursing homes in terms of agreement on outlier identification: Kappa, false positive and false negative error rates.

RESULTS

Kappa values ranged from 0.63 to 0.90. False positive and negative error rates ranged from 8% to 37%. Agreement between QMs and EQMs was better on high quality rather than on low quality.

CONCLUSIONS

More extensive risk adjustment changes quality ranking of nursing homes and should be considered as potential improvement to the current QMs. Other methodological issues related to construction of the QMs should also be investigated to determine if they are important in the context of nursing home care.