Validating quality indicators. Quality as relationship between structure, process, and outcome

Quality measures in primary care skin cancer management: a qualitative study of the views of key informants

OBJECTIVES

This study explored potential quality measures to improve skin cancer management in primary care settings, and the barriers and facilitators associated with their implementation.

DESIGN

Semistructured interviews and qualitative proforma surveys were conducted with skin cancer experts from a range of healthcare settings. Framework analysis was employed to identify key groups of quality measures within the domains of the Donabedian model of healthcare quality (structure, process, outcome). Interview and survey data were triangulated to identify common groups of quality measures, barriers and facilitators.

PARTICIPANTS

We purposively recruited skin cancer experts from Australia and internationally with knowledge and experience in skin cancer management. The final sample consisted of 15 participants who had clinical or academic backgrounds.

RESULTS

Participants unequivocally expressed the need for quality measures to guide skin cancer care. Ten groups of quality measures were identified: three groups related to the structural elements of care (eg, diagnostic tools), four related to the processes of care (eg, diagnostic process) and three related to outcomes of care (eg, treatment outcomes). Implementation barriers included clinician resistance, system inadequacies and external factors (eg, patient risk). Facilitators included incentives, education, agreed and feasible indicators and support and guidance.

CONCLUSIONS

To service a growing population of skin cancer patients in Australia, the role of primary care needs to be more clearly specified, and its care providers supported and more engaged in quality improvement processes. Structure, process and outcome quality measures, derived from detailed guidance for primary care settings, can be used to track practitioner performance and facilitate ongoing improvement.

Exploring Service Use Disparities among Suicidal Black Youth in a Suicide Prevention Care Coordination Intervention

OBJECTIVE

The aim of this study is to examine service utilization disparities among Black youth participating in Linking Individuals Needing Care (LINC), a 90-day research-informed suicide care coordination intervention.

METHODS

An open trial pilot was conducted to examine the effectiveness of LINC in increasing access to and engagement in mental health and non-mental health services among suicidal youth (N = 587). Other variables of interest included service use facilitators and service use barriers. Generalized linear mixed models with binomial distribution and logit link were performed to ascertain if service use facilitators and barriers were associated with service utilization and if disparities in service use and engagement existed between Black and White suicidal youth through a comparative analysis.

RESULTS

Service utilization differences were found between Black and White youth. While Black and White youth were both likely to engage in individual therapy (OR = 1.398, p < .001) and non-mental health services (OR = 1.289, p < .001), utilization rates for mental health and medication management services were lower for Black (55.1% to 60.6%) youth compared to White (66.0% to 71.0%) youth. Specifically, Black youth were significantly less likely than Whites to receive medication management (OR = .466, p = .002). Systemic barriers such long waitlists for care (OR = 1.860, p = .039) and poor relationship with providers (OR = 7.680, p = .028) increased odds of engagement in non-mental health services. Clinical disorders and engagement in suicide-related behaviors increased the likelihood of obtaining care from both medication management and non-mental health services.

CONCLUSION

Care coordination services for suicidal youth can increase access and engagement in mental health and non-mental health services. Culturally adapted models attending to cultural and social assets of Black families are needed to reduce disparities and suicide risk among Black youth.

Measuring the quality of skin cancer management in primary care: A scoping review

Skin cancer is a growing global problem and a significant health and economic burden. Despite the practical necessity for skin cancer to be managed in primary care settings, little is known about how quality of care is or should be measured in this setting. This scoping review aimed to capture the breadth and range of contemporary evidence related to the measurement of quality in skin cancer management in primary care settings. Six databases were searched for relevant texts reporting on quality measurement in primary care skin cancer management. Data from 46 texts published since 2011 were extracted, and quality measures were catalogued according to the three domains of the Donabedian model of healthcare quality (structure, process and outcome). Quality measures within each domain were inductively analysed into 13 key emergent groups. These represented what were deemed to be the most relevant components of skin cancer management as related to structure, process or outcomes measurement. Four groups related to the structural elements of care provision (e.g. diagnostic tools and equipment), five related to the process of care delivery (e.g. diagnostic processes) and four related to the outcomes of care (e.g. poor treatment outcomes). A broad range of quality measures have been documented, based predominantly on articles using retrospective cohort designs; systematic reviews and randomised controlled trials were limited.

Validation of patient- and GP-reported core sets of quality indicators for older adults with multimorbidity in primary care: results of the cross-sectional observational MULTIqual validation study

BACKGROUND

Older adults with multimorbidity represent a growing segment of the population. Metrics to assess quality, safety and effectiveness of care can support policy makers and healthcare providers in addressing patient needs. However, there is a lack of valid measures of quality of care for this population. In the MULTIqual project, 24 general practitioner (GP)-reported and 14 patient-reported quality indicators for the healthcare of older adults with multimorbidity were developed in Germany in a systematic approach. This study aimed to select, validate and pilot core sets of these indicators.

METHODS

In a cross-sectional observational study, we collected data in general practices (n = 35) and patients aged 65 years and older with three or more chronic conditions (n = 346). One-dimensional core sets for both perspectives were selected by stepwise backward selection based on corrected item-total correlations. We established structural validity, discriminative capacity, feasibility and patient-professional agreement for the selected indicators. Multilevel multivariable linear regression models adjusted for random effects at practice level were calculated to examine construct validity.

RESULTS

Twelve GP-reported and seven patient-reported indicators were selected, with item-total correlations ranging from 0.332 to 0.576. Fulfilment rates ranged from 24.6 to 89.0%. Between 0 and 12.7% of the values were missing. Seventeen indicators had agreement rates between patients and professionals of 24.1% to 75.9% and one had 90.7% positive and 5.1% negative agreement. Patients who were born abroad (- 1.04, 95% CI =  - 2.00/ - 0.08, p = 0.033) and had higher health-related quality of life (- 1.37, 95% CI =  - 2.39/ - 0.36, p = 0.008), fewer contacts with their GP (0.14, 95% CI = 0.04/0.23, p = 0.007) and lower willingness to use their GPs as coordinators of their care (0.13, 95% CI = 0.06/0.20, p < 0.001) were more likely to have lower GP-reported healthcare quality scores. Patients who had fewer GP contacts (0.12, 95% CI = 0.04/0.20, p = 0.002) and were less willing to use their GP to coordinate their care (0.16, 95% CI = 0.10/0.21, p < 0.001) were more likely to have lower patient-reported healthcare quality scores.

CONCLUSIONS

The quality indicator core sets are the first brief measurement tools specifically designed to assess quality of care for patients with multimorbidity. The indicators can facilitate implementation of treatment standards and offer viable alternatives to the current practice of combining disease-related metrics with poor applicability to patients with multimorbidity.

Caring Transitions - A Care Coordination Intervention to Reduce Suicide Risk Among Youth Discharged From Inpatient Psychiatric Hospitalization

Background: Suicide risk following youth psychiatric hospitalization is of significant concern. This study evaluated Linking Individuals Needing Care (LINC), a theory-driven, comprehensive care coordination approach for youth discharged from crisis services. Aims: To pilot LINC's potential effectiveness in increasing service utilization and decreasing suicide risk. Method: Participants were 460 youth patients who received LINC for approximately 90 days following discharge from crisis services. Service utilization, depressive symptoms, and suicide-related variables were measured at baseline and 30, 60, and 90 days after baseline. Results: Patients significantly increased the use of various beneficial, least restrictive services (individual therapy, medication management, and non-mental health supports) over the 90-day intervention. Significant decreases were observed in depressive symptoms, suicide ideation, and engagement in suicide-related behaviors. Limitations: Absence of a comparison group and nonparticipating families limit causal conclusions and generalizability. Conclusions: LINC may be a promising new approach following inpatient hospitalization that can engage and retain youth in services, likely resulting in improved treatment outcomes. This approach was designed emphasizing patient engagement, suicide risk assessment and management, safety planning, community networking, referral/linkage monitoring, coping and motivational strategies, and linguistic/culturally responsive practices to meet service and support needs of high-risk suicidal youth.

The Conceptualization of Mental Health Service Quality Assessment: Consumer Perspective

This review synthesises theoretical approaches and methodological considerations in mental health service quality assessment from consumers-perspective. We searched published articles from databases: EMBASE, MEDLINE, CIHNAL, Scopus, Web of Science, and PsycINFO. Of the 30 included papers, 16 contained instruments used to mental health quality assessment and 14 focused on theoretical constructs. The review finds that mental health quality assessment is explained and measured using constructs that focus on structure, process and outcome. The methodological issues that need critical consideration are the context and cultural norms of services, outcome perspectives, evaluator, sources of information as well as the selection of consumers and instruments. The review recommends that researchers and clinicians should consider the theoretical constructs and methodological issues in mental health quality assessment.

Development of quality indicators for departments of hospital-based physiotherapy: a modified Delphi study

Background

International hospital accreditation instruments, such as Joint Commission International (JCI) and Qmentum, focus mainly on hospital policy and procedures and do not specifically cover a profession such as hospital-based physiotherapy. This justifies the need for a quality system to which hospital-based physiotherapy can better identify, based on a common framework of quality indicators for effective quality management.

Objective

This study aimed to identify the most important quality indicators of a hospital-based physiotherapy department in the eyes of hospital-based physiotherapists and their managers.

Methods

Based on input from three focus groups and a structured literature review, a first set of quality indicators for hospital physiotherapy was assembled. After checking this set for duplicates and for overlap with JCI and Qmentum, it formed the starting point of a modified Delphi procedure. In two rounds, 17 hospital-based physiotherapy experts rated the quality indicators on relevance through online surveys. In a final consensus meeting, quality indicators were established, classified in quality themes and operationalised by describing for each theme the rationale, specifications, domain and type of indicator.

Results

Three focus groups provided 120 potential indicators, which were complemented with 18 potential indicators based on literature. After duplicate and overlap check and the Delphi procedure, these 138 potential indicators were reduced to a set of 56 quality indicators for hospital-based physiotherapy. Finally, these 56 indicators were condensed into 7 composite indicators, each representing a quality theme based on definitions of the European Foundation for Quality Management.

Conclusion

A set of 56 quality indicators, condensed into 7 composite indicators each representing a quality theme, was developed to assess the quality of a hospital-based physiotherapy department.

Quality indicators for Palliative Day Services: A modified Delphi study

BACKGROUND:

The goal of Palliative Day Services is to provide holistic care that contributes to the quality of life of people with life-threatening illness and their families. Quality indicators provide a means by which to describe, monitor and evaluate the quality of Palliative Day Services provision and act as a starting point for quality improvement. However, currently, there are no published quality indicators for Palliative Day Services.

AIM:

To develop and provide the first set of quality indicators that describe and evaluate the quality of Palliative Day Services.

DESIGN AND SETTING:

A modified Delphi technique was used to combine best available research evidence derived from a systematic scoping review with multidisciplinary expert appraisal of the appropriateness and feasibility of candidate indicators. The resulting indicators were compiled into ‘toolkit’ and tested in five UK Palliative Day Service settings.

RESULTS:

A panel of experts independently reviewed evidence summaries for 182 candidate indicators and provided ratings on appropriateness, followed by a panel discussion and further independent ratings of appropriateness, feasibility and necessity. This exercise resulted in the identification of 30 indicators which were used in practice testing. The final indicator set comprised 7 structural indicators, 21 process indicators and 2 outcome indicators.

CONCLUSION:

The indicators fulfil a previously unmet need among Palliative Day Service providers by delivering an appropriate and feasible means to assess, review, and communicate the quality of care, and to identify areas for quality improvement.

Validity of police contacts as a performance indicator for the public mental health care system in Amsterdam: an open cohort study

PURPOSE

The Public Mental Health Care (PMHC) system is a network of public services and care- and support institutions financed from public funds. Performance indicators based on the registration of police contacts could be a reliable and useful source of information for the stakeholders of the PMHC system to monitor performance. This study aimed to provide evidence on the validity of using police contacts as a performance indicator to assess the continuity of care in the PMHC system.

METHODS

Data on services received, police contacts and detention periods of 1928 people that entered the PMHC system in the city of Amsterdam were collected over a period of 51 months. Continuity of care was defined as receiving more than 90 days of uninterrupted service. The associations between police contacts and continuity were analyzed with multilevel Poisson and multivariate linear regression modeling.

RESULTS

Clients had on average 2.12 police contacts per person-year. Clients with police contacts were younger, more often single, male, and more often diagnosed with psychiatric or substance abuse disorders than clients without police contacts. Incidence rates of police contacts were significantly lower for clients receiving continuous care than for clients receiving discontinuous care. The number of police contacts of clients receiving PMHC coordination per month was found to be a significant predictor of the percentage of clients in continuous care.

CONCLUSION

The number of police contacts of clients can be used as a performance indicator for an urban PMHC system to evaluate the continuity of care in the PMHC system.

Individual and contextual-level factors associated with continuity of care for adults with schizophrenia

This retrospective cohort study examined rates of conformance to continuity of care treatment guidelines and factors associated with conformance for persons with schizophrenia. Subjects were 8,621 adult Ohio Medicaid recipients, aged 18-64, treated for schizophrenia in 2004. Information on individual-level (demographic and clinical characteristics) and contextual-level variables (county socio-demographic, economic, and health care resources) were abstracted from Medicaid claim files and the Area Resource File. Outcome measures captured four dimensions of continuity of care: (1) regularity of care; (2) transitions; (3) care coordination, and (4) treatment engagement. Multilevel modeling was used to assess the association between individual and contextual-level variables and the four continuity of care measures. The results indicated that conformance rates for continuity of care for adults with schizophrenia are below recommended guidelines and that variations in continuity of care are associated with both individual and contextual-level factors. Efforts to improve continuity of care should target high risk patient groups (racial/ethnic minorities, the dually diagnosed, and younger adults with early onset psychosis), as well as community-level risk factors (provider supply and geographic barriers of rural counties) that impede access to care.

A Systems Approach to Improving Tdap Immunization Within 5 Community-Based Family Practice Settings: Working Differently (and Better) by Transforming the Structure and Process of Care

OBJECTIVES

We examined how family medicine clinic physicians and staff worked in collaborative teams to implement an automated clinical reminder to improve tetanus, diphtheria, and acellular pertussis (Tdap) booster vaccine administration and documentation.

METHODS

A clinical reminder was developed at 5 University of Michigan family medicine clinics to identify patients 11 to 64 years old who were in need of the Tdap booster vaccine. Quality improvement cycles were used to improve clinic care processes. Immunization rates from 2008 to 2011 were compared with rates at 4 primary care control clinics.

RESULTS

Vaccination rates among eligible patients increased from 15.5% to 47.3% within the family medicine clinics and from 14.1% to 30.2% within the control clinics. After adjustment for covariates, family medicine patients had a higher probability of vaccination than control patients during each measurement period (0.17 vs 0.15 at baseline, 0.53 vs 0.22 during year 1, and 0.50 vs 0.30 during year 2).

CONCLUSIONS

Automated clinical reminders, when designed and implemented via a consensus-based framework that addresses the process of care, can dramatically improve provision of preventive health care.

Quality of care indicators and their related outcomes: a population-based study in prostate cancer patients treated with radiotherapy

BACKGROUND AND PURPOSE

We describe variations across the regional cancer centres in Ontario, Canada for five prostate cancer radiotherapy (RT) quality indicators: incomplete pre-treatment assessment, follow-up care, leg immobilization, bladder filling, and portal film target localization. Along with cancer centre volume, we examined each indicator's association with relevant outcomes: long-term cause-specific survival, urinary incontinence, and gastrointestinal and genitourinary late morbidities.

MATERIALS AND METHODS

We conducted a population-based retrospective cohort study of 924 prostate cancer patients diagnosed between 1990 and 1998 who received RT within 9 months of diagnosis. Data sources included treating charts and registry and administrative data. The associations between indicators and outcomes were analysed using regression techniques to control for potential confounders.

RESULTS

Practice patterns varied across the regional cancer centres for all indicators (p<0.0001). Incomplete pre-treatment assessment was associated with worse cause-specific survival although this result was not significant when adjusted for confounding (adjusted RR=1.78, 95% CI=0.79-3.98). Treatment without leg immobilization (adjusted RR=1.72, 95% CI=1.16-2.56) and with an empty bladder (adjusted RR=1.98, 95% CI=1.08-3.63) was associated with genitourinary late morbidities. Treatment without leg immobilization was also associated with urinary incontinence (adjusted RR=2.18, 95% CI=1.23-3.87).

CONCLUSIONS

We documented wide variations in practice patterns. We demonstrated that measures of quality of care can be shown to be associated with clinically relevant outcomes in a population-based sample of prostate cancer patients.

Characterizing healthcare quality in the community pharmacy setting: insights from a focus group study

BACKGROUND

There is currently no common frame of reference defining community pharmacy quality. It can therefore be difficult to know whether the provision of care meets minimum standards and how to improve quality of care.

OBJECTIVE

The aim of this research was to develop a conceptual framework characterizing healthcare quality in the community pharmacy setting.

METHODS

Ten focus group discussions with 47 participants were conducted across the northwest of England, United Kingdom. All participants had experiences of health care provided by community pharmacies and included patients and their carers, pharmacists and pharmacy staff, and National Health Service staff who commissioned pharmacy services. Constant comparative analysis was used to analyze the verbatim transcripts.

RESULTS

Community pharmacy quality can be conceptualized as dynamic with 3 interdependent dimensions. Each dimension was associated with structures, processes, and outcomes. The first dimension (accessibility) emphasized that in addition to patients requiring access to the available services, medicines, and health care advice, it was equally important for pharmacy personnel to have access to adequate structures to provide quality health care. The second dimension (effectiveness) highlighted a shift away from simply supplying medicines to supplying medicines appropriately, from passively providing services and information to individualizing advice to achieve intended outcomes, and from having structures available to using them purposefully to achieve outcomes. The third dimension (positive perceptions of the experience) enabled patients and carers to better care for themselves and for others, and it influenced future access. At the same time, when pharmacy personnel believed themselves to be valued and that they had done a good job, they felt motivated to continue to provide high-quality care.

CONCLUSIONS

All 3 dimensions should be considered when the term quality is used in the context of community pharmacy. This research can be used as a springboard for similar studies in other sectors or jurisdictions wishing to characterize quality for their health care services. In particular, this research provides a common frame of reference for those interested in the provision and assessment of quality health care from community pharmacies.

Variation in the use of urgent splenectomy after blunt splenic injury in adults

OBJECTIVE

Recent reports indicate that mortality after trauma center admission may be directly related to the rate of operative intervention after blunt solid organ injury. These findings bring into question the role of urgent splenectomy after blunt splenic injury (BSI). The purpose of this study was to determine the role of urgent splenectomy (defined as splenectomy within 6 hours of admission) in the management of BSI as well as the relationship between urgent splenectomy and in-hospital mortality.

METHODS

The National Trauma Data Bank for 2007 was queried for adults (18-81) who suffered BSI. Patients who died in or were transferred from the emergency department were excluded. Hierarchical multivariate models were used to account for clustering of patients within hospitals and to identify hospital and patient factors associated with urgent splenectomy. Propensity score matching was used to analyze the relationship between urgent splenectomy and mortality.

RESULTS

There were 507,202 total incidents identified. Of those, 11,793 met inclusion criteria. Urgent splenectomy was performed on 1,104 (9.4%). Hierarchical models revealed that age ≥55 years, arrival systolic blood pressure ≤90 mm Hg, no or mild head injury, increasing injury severity, and massive disruption of the spleen were associated with urgent splenectomy. Hospitals level factors associated with urgent splenectomy included hospital region, hospital type, and trauma center level. The propensity-matched cohorts revealed no association between urgent splenectomy and in-hospital mortality (odds ratio, 1.08; 95% confidence interval, 0.82-1.42).

CONCLUSION

Despite ongoing variation in the use of urgent splenectomy after BSI in adults, urgent splenectomy was not associated with in-hospital mortality.

Potential savings without compromising the quality of care

AIMS

This study was designed to analyse the association between adherence to guidelines for rational drug use and surrogate outcome markers for hypertension, diabetes and hypercholesterolaemia.

METHODS

The study used a cross-sectional ecological design. Data from dispensed prescriptions and medical records were analysed from 24 primary healthcare centres with a combined registered population of 330,000 patients in 2006. Guideline adherence was determined calculating the proportion of the prescribed volume of antidiabetic agents, antihypertensives and lipid-lowering agents representing the 14 different drugs included in the guidelines for these three areas. Patient outcome was assessed using surrogate marker data on HbA1C, blood pressure (BP) and s-cholesterol. The association between the guidelines adherence and outcomes measures was analysed by logistic regression.

RESULTS

The proportion of guideline antidiabetic drugs in relation to all antidiabetic drugs prescribed varied between 80% and 97% among the practices, the ratio of angiotensin converting enzyme (ACE)-inhibitors to all renin-angiotensin drugs 40-77% and the ratio of simvastatin to all statins 58-90%. The proportion of patients reaching targets for HbA1C, BP and s-cholesterol varied between 34% and 66%, 36% and 57% and 46% and 71% respectively. No significant associations were found between adherence to the guidelines and outcome. The expenditures for antihypertensives and lipid-lowering drugs could potentially be reduced by 10% and 50% respectively if all practices adhered to the guidelines as the top performing practices.

CONCLUSION

A substantial amount of money can be saved in primary care without compromising the quality of care by using recommended first-line drugs for the treatment diabetes, hypertension and hypercholesterolaemia.

Development of quality indicators for memory clinics

OBJECTIVE

To develop and validate a set of relevant, feasible, and reliable quality indicators (QIs) for the Memory Clinics (MCs).

BACKGROUND

MCs are important care providers for people with dementia and their caregivers. A set of valid QIs is needed to incorporate evidence-based guidelines into MC clinical practice, and measure adherence to guidelines.

METHODS

A total of 17 MC specialists, 12 primary care physicians; and seven informal caregivers participated in several Delphi rounds to select and validate QIs. Ten MCs participated in the indicator compliance study involving the analysis of data extracted from 100 medical records.

RESULTS

The initial set of 56 single QIs was reduced to a final set of 14 indicators measuring the quality of processes, structures, and outcomes of care. The panels of representatives of MCs, primary care physicians, and informal caregivers judged overall face validity to be high. The differences in compliance rates between the three indicator types were significant (p<0.001) as were the differences between the MCs (p<0.005). The compliance measures were highest for the process indicators and lowest for the outcome indicators.

CONCLUSION

The final set of 14 QIs that met the psychometric requirements can be used to facilitate the implementation of guidelines and the assessment of the quality of care offered by MCs. The QIs are acceptable for a broad range of users (specialists, referring physicians, and informal caregivers), and are capable of discriminating between MCs in terms of quality.

Toward the Implementation of Mental Health Consumer Provider Services

Encouraged by the New Freedom Commission, mental health systems such as the Veteran Administration (VA) are now becoming more recovery-oriented. Consumer providers (CPs)--those with serious mental illness who are further along in recovery who provide services to others with similar mental health problems--are viewed as a key part of this change. However, organizational change theories suggest that careful consideration of implementation issues is critical when disseminating new and sometimes controversial services into existing organizations. Therefore, to guide the dissemination of CP services, the literature on the effectiveness of CPs was reviewed, and interviews, focus groups, and a brief survey of 110 administrators, providers, and patients were conducted at three large VA clinics in Southern California. Questions focused on their perceptions of feasibility and acceptability of CP services. Using literature and study findings, an organizational change framework and other strategies to overcome potential implementation challenges of CP services are suggested.

A theoretical model of common process factors in youth and family therapy

Recently there has been an increasing emphasis in the youth and family mental health treatment literature on the use of empirically supported treatments (ESTs). In contrast there has been scant attention paid to more universal aspects of the therapy process that may have even greater impact upon therapy outcomes. It is likely that the success of the techniques proposed by ESTs may depend on the presence of common process factors. In this article, the authors explore the status of common process factors research in the youth and family therapy literature, and propose a theoretical model linking specific therapeutic relationship variables and treatment outcomes for children and adolescents. This model is intended to guide synthesis of the empirical evidence for common process factors in youth and family treatment and to stimulate future research on common process factors.

Further validation of the Psycho-Social Well-Being Scale (PSWS) with community clients

To monitor and evaluate the use of evidence-based approaches with mentally ill persons who abuse alcohol and other drugs, administrators, practitioners and evaluators will need to incorporate brief, reliable, and valid instruments into daily practice. The current two-part study provides further validation of the Psycho-Social Wellbeing Scale (PSWS), a multidisciplinary "debriefing tool" designed to capture and summarize data on clients' wellbeing from multiple sources in team-based community care. In the current investigation the PSWS was correlated with a number of valid instruments including the Brief Psychiatric Rating Scale, the Role Functioning Scale, the Social Functioning-12, the Alcohol Use Disorders Identification Test, the Alcohol Use and Drug Use Scales along with other important indices. Results show strong evidence of internal consistency, concurrent and discriminant validity with these criterion variables. Regression modeling demonstrates that the two main subscales (psychological and social wellbeing) add significantly to a model predicting substance abuse problems.

Research methods used in developing and applying quality indicators in primary care

Quality indicators have been developed throughout Europe primarily for use in hospitals, but also increasingly for primary care. Both development and application are important but there has been less research on the application of indicators. Three issues are important when developing or applying indicators: (1). which stakeholder perspective(s) are the indicators intended to reflect; (2). what aspects of health care are being measured; and (3). what evidence is available? The information required to develop quality indicators can be derived using systematic or non-systematic methods. Non-systematic methods such as case studies play an important role but they do not tap in to available evidence. Systematic methods can be based directly on scientific evidence by combining available evidence with expert opinion, or they can be based on clinical guidelines. While it may never be possible to produce an error free measure of quality, measures should adhere, as far as possible, to some fundamental a priori characteristics (acceptability, feasibility, reliability, sensitivity to change, and validity). Adherence to these characteristics will help maximise the effectiveness of quality indicators in quality improvement strategies. It is also necessary to consider what the results of applying indicators tell us about quality of care.

The accuracy of medical record documentation in schizophrenia

Medical records are commonly used to measure quality of care. However, little is known about how accurately they reflect patients' clinical condition. Even less is understood about what influences the accuracy of provider's documentation and whether patient characteristics impact documentation habits. Discrepancies between symptoms and side effects evaluated by direct assessment and medical records were examined for 224 patients with schizophrenia at two public mental health clinics. Multivariate regression was used to study the relationship between patient, provider, and treatment characteristics and documentation accuracy. Overall, documentation of symptoms and side effects was frequently absent. Documentation varied substantially between clinics, and it was generally less likely for patients who were severely ill, black, or perceived as noncompliant. The accuracy and consistency of medical record documentation should be demonstrated before using it to evaluate care at public mental health clinics.

Quality measures for mental health care: results from a national inventory

The National Inventory of Mental Health Quality Measures was funded by the Agency for Healthcare Research and Quality to (1) inventory process measures for assessing the quality of mental health care; (2) identify clinical, administrative, and quality domains where measures have been developed; and (3) identify areas where further research and development is needed. Among the 86 measures identified, most evaluated treatment of major mental disorders, for example, schizophrenia (24 percent) and major depression (21 percent). A small proportion focused on children (8 percent) or the elderly (9 percent). Domains of quality included treatment appropriateness (65 percent), continuity (26 percent), access (26 percent), coordination (13 percent), detection (12 percent), and prevention (6 percent). Few measures were evaluated for reliability (12 percent) or validity (3 percent). Measures imposing a lower burden were more likely to be in use (chi 2 = 4.41, p = .036). Further measures are needed to assess care for several priority clinical and demographic groups. Research should focus on measure validity, reliability, and implementation costs. In order to foster quality improvement activities and use of common measures and specifications for mental health care, the inventory of quality measures will be made available at www.challiance.org/cqaimh.

Measuring quality in mental health services

This article introduces the special issue on measuring quality of care. The overall purpose of this issue is to encourage an increased presence of evaluators in quality-of-care research. The sections of this special issue are devoted to conceptual issues concerning quality and the future of quality measurement. They include a description of current governmental and private efforts in measuring quality, a brief report on quality measurement efforts in Great Britain, and four quality-of-care research reports.