Using telephone interviews to reduce nonresponse bias to mail surveys of health plan members

Mixed Mode Substantially Increases Hospital Consumer Assessment of Healthcare Providers and Systems Response Rates Relative to Single-Mode Protocols

BACKGROUND

Low response rates (RRs) can affect hospitals' data collection costs for patient experience surveys and value-based purchasing eligibility. Most hospitals use single-mode approaches, even though sequential mixed mode (MM) yields higher RRs and perhaps better patient representativeness. Some hospitals may be reluctant to incur MM's potential additional cost and complexity without knowing how much RRs would increase.

OBJECTIVE

The aim of this study was to estimate the differences in RR and patient representation between MM and single-mode approaches and to identify hospital characteristics associated with the largest RR differences from MM of single-mode protocols (mail-only, phone-only).

RESEARCH DESIGN

Patients were randomized within hospitals to one of 3 modes (mail-only, phone-only, MM).

SUBJECTS

A total of 17,415 patients from the 51 nationally representative US hospitals participating in a randomized HCAHPS mode experiment.

RESULTS

Mail-only RRs were lowest for ages 18-24 (7%) and highest for ages 65+ (31%-35%). Phone-only RRs were 24% for ages 18-24, increasing to 37%-40% by ages 55+. MM RRs were 28% for ages 18-24, increasing to 50%-60% by ages 65-84. Lower hospital-level mail-only RRs strongly predicted greater gains from MM. For example, a hospital with a 15% mail-only RR has a predicted MM RR >40% (with >25% occurring in telephone follow-up).

CONCLUSION

MM increased representation of hard-to-reach (especially young adult) patients and hospital RRs in all mode experiment hospitals, especially in hospitals with low mail-only RRs.

The relationship between line manager training in mental health and organisational outcomes

BACKGROUND

Line manager (LM) training in mental health is gaining recognition as an effective method for improving the mental health and wellbeing of workers. However, research predominantly focuses on the impacts of training at the employee-level, often neglecting the broader organisational-level outcomes. Most studies derive insights from LMs using self-reported data, with very few studies examining impacts on organisational-level outcomes.

AIM

To explore the relationship between LM training in mental health and organisational-level outcomes using company-level data from a diverse range of organisations.

METHODS

This study is a secondary analysis of anonymised panel survey data from firms in England, with data derived from computer-assisted telephone surveys over four waves (2020, 1899 firms; 2021, 1551; 2022, 1904; and 2023, 1902). The analysis merged the four datasets to control for temporal variations. Probit regression was conducted including controls for age of organisation, sector, size, and wave to isolate specific relationships of interest.

RESULTS

We found that LM training in mental health is significantly associated with several organisational-level outcomes, including: improved staff recruitment (β = .317, p < .001) and retention (β = .453, p < .001), customer service (β = .453, p < .001), business performance (β = .349, p < .001), and lower long-term sickness absence due to mental ill-health (β = -.132, p < .05).

CONCLUSION

This is the first study to explore the organisational-level outcomes of LM training in mental health in a large sample of organisations of different types, sizes, and sectors. Training LM in mental health is directly related to diverse aspects of an organisations' functioning and, therefore, has strategic business value for organisations. This knowledge has international relevance for policy and practice in workforce health and business performance.

Survey mode and nonresponse bias: A meta-analysis based on the data from the international social survey programme waves 1996-2018 and the European social survey rounds 1 to 9

The constant increase in survey nonresponse and fieldwork costs are the reality of survey research. Together with other unpredictable events occurring in the world today, this increase poses a challenge: the necessity to accelerate a switch from face-to-face data collection to different modes, that have usually been considered to result in lower response rates. However, recent research has established that the simple response rate is a feeble measure of study quality. Therefore, this article aims to analyze the effect of survey characteristics, especially the survey mode, on the nonresponse bias. The bias measure used is the internal criteria first proposed by Sodeur and first applied by Kohler. The analysis is based on the survey documentation and results from the International Social Survey Programme waves 1996-2018 and the European Social Survey rounds 1 to 9. Random-effects three-level meta-regression models, based on data from countries from each inhabited continent, were created in order to estimate the impact of the survey mode or modes, sampling design, fieldwork experience, year of data collection, and response rate on the nonresponse bias indicator. Several ways of nesting observations within clusters were also proposed. The results suggest that using mail and some types of mixed-mode surveys were connected to lower nonresponse bias than using face-to-face mode surveys.

Development, methodology, and adaptation of the Medicare Consumer Assessment of Healthcare Providers and Systems (CAHPS®) patient experience survey, 2007–2019

The Medicare Consumer Assessment of Healthcare Providers and Systems (CAHPS®) surveys collect standardized information about patient experiences of care from nationally representative samples of people with Medicare to support consumers’ enrollment choices and enable the Centers for Medicare & Medicaid Services to monitor care quality and incentivize high quality patient-centered care. Since 2007, protocols for data collection, analysis, and reporting have evolved to address expanded Medicare coverage options and a shift from a single survey vendor to a model in which health plans hire approved vendors to administer the survey. During that time, response rates for all types of surveys have declined; increasing effort has gone toward increasing survey participation, especially among people whose preferred language is not English. In this paper, we describe the history, goals, and current use of the Medicare CAHPS surveys. We also summarize key methodological issues, such as sample design, field implementation and data cleaning, adjustment, scoring, and report production. Additionally, we discuss issues that may arise more generally in managing a large, annual national survey that has direct impact on policy, and consider how a long-running survey of this nature may need to evolve to reflect changes in health care delivery and promote standardization in survey administration while maintaining survey content.

A novel opt-in vs opt-out approach to referral-based treatment of tobacco use in Veterans Affairs (VA) primary care clinics: A provider-level randomized controlled trial protocol

To determine whether an opt-out approach is effective for referral to treatment for tobacco use, we designed a clinical reminder for nurses in a primary care setting that provides a referral for patients who smoke cigarettes. We will use a two-arm, cluster-randomized design to assign nurses at the VA New York Harbor Healthcare System to test which mode of referral (opt-in vs opt-out) is more effective. All patients will be referred to evidence-based treatment for tobacco cessation including counseling from the New York State Quitline, and VetsQuit, a text messaging-based system for tobacco cessation counseling. We will measure patient engagement with the referral both in the short and long term to determine if referral modality had an impact on tobacco cessation treatment. We will also measure nurse engagement with the referral before, during, and after the implementation of the reminder to determine whether an opt-out approach is cost effective at the health system level. At the conclusion of this project, we expect to have developed and tested an opt-out system for increasing tobacco cessation treatment for Veterans in VA primary care and to have a thorough understanding of factors associated with implementation. Trial Registration:Clinicaltrials.govIdentifierNCT03477435.

Hospital training and preparedness of parents and carers in paediatric tracheostomy care: A mixed methods study

INTRODUCTION

Within the UK, the majority of paediatric tracheostomy care is delivered by parents and carers at home. To facilitate this, extensive in-hospital training is delivered by a variety of health care professionals. Our goal was to assess carer perceptions of this process and highlight areas in which we can further improve our service and the training for other hospital providers of paediatric tracheostomy care.

METHODS

A mixed method approach was adopted. In Phase I, qualitative data from five semi-structured interviews with carers of children with a tracheostomy were thematically analysed and subsequently used to develop a questionnaire. In Phase II, the piloted questionnaire was distributed via telephone, email or post to all eligible caregivers who had been tracheostomy trained at GOSH in the last three years (n = 92). Qualitative and quantitative data were analysed using thematic analysis and descriptive statistics respectively.

RESULTS

Thirty-five completed questionnaires were received (38% response rate). Overall participants were highly satisfied with the training provided (mean score 8.42 on a scale of 1 (lowest) to 10 (highest)). Carer identified areas requiring improvement were caregiver education pre-tracheostomy; emergency and complication training; supervision and training post hospital discharge; training schedule; emotional support; and support from community healthcare teams. These findings led to multiple subsequent interventions to further improve the carer training programme including training videos, psychology provision on request and increased community training.

CONCLUSION

Although the evaluation of the service revealed high participant satisfaction in home carer training overall, in-depth analysis of caregivers' experiences indicated common themes in the tracheostomy training service where further support would be beneficial. A carer-centred rather than health professional focus on training needs will allow future attention to be directed to areas of need identified by carers themselves as important to improve the tracheostomy training programme.

A Physician-Led Communication Initiative to Inform OAB Patients of Dementia Risk Associated With Anticholinergic Medications

OBJECTIVES

Anticholinergic medications are a core treatment strategy for overactive bladder (OAB). There is evidence that exposure to anticholinergic medications is associated with an increased risk of developing dementia. We launched an initiative to inform our patients of this risk and give them an opportunity to engage in shared decision-making about their treatment. This quality improvement initiative encompassed 3 aims: (1) to evaluate the feasibility of 2 different routes to deliver the written outreach; (2) to evaluate if and how patients changed their OAB treatment; and (3) to assess satisfaction with the outreach initiative.

METHODS

A query was performed via the electronic medical record for all patients who had been prescribed an anticholinergic for treatment of OAB. We sent either electronic messages or traditional mail to patients. We contacted patients by telephone to assess if they received the message, were satisfied with their respective method of communication, and decided for ongoing treatment. Health care provider satisfaction was also measured.

RESULTS

Of the 231 patients sent the outreach, 32 were still taking the anticholinergic at the time they received the communication. The majority of patients, 84.38%, were satisfied with the initiative and elected to change therapy after learning about the increased risk of dementia. The physicians also uniformly reported satisfaction with the initiative.

CONCLUSIONS

Overall, this outreach initiative resulted in an increase in patient counseling that led to a change in treatment for most patients. This initiative was received favorably by patients and health care providers.

Impact of Refractive Outcomes on Bias in Follow-up and Completion of Patient-Reported Outcome Measures after Laser Vision Correction

PURPOSE

To examine factors contributing to completion of a patient-reported outcome (PRO) measure in patients undergoing laser vision correction.

DESIGN

Retrospective, population-based study.

PARTICIPANTS

All patients who underwent primary laser vision correction with a target of plano from July 1, 2014, to June 30, 2016, at a large refractive surgery center.

METHODS

Patients were asked to complete a PRO measure at the time of their preoperative and months 1 and 3 postoperative visits. Characteristics between patients who attended and did not attend the follow-up visits and completed and did not complete the PRO measure were compared. A logistic regression was performed to identify factors associated with likelihood of follow-up and completion of PRO measure. An inverse probability censoring weighted model was created to account for selective loss to follow-up and used to adjust the PRO satisfaction measure.

MAIN OUTCOME MEASURE

Completion of the PRO measure at 1 and 3 months.

RESULTS

A total of 37 043 patients were identified. Of these, 20 501 completed a 1-month postoperative PRO measure and 10 474 completed a 3-month postoperative PRO measure. Patients completing a PRO measure were more likely to be older, be female, have had photorefractive keratectomy (PRK), have completed a preoperative PRO measure, and have had a preoperative hyperopic correction (P < 0.001 for all comparisons). For every line of postoperative uncorrected acuity worse than 20/16, the odds ratio of completing a PRO measure was 1.33 (95% confidence interval [CI], 1.30-1.36, P < 0.001) at 1 month and 1.29 (95% CI, 1.26-1.33, P < 0.001) at 3 months. At 1 month, there was no difference between the raw and model-adjusted rates of satisfaction with vision, but at 3 months the adjusted rate was significantly higher than the raw rate.

CONCLUSIONS

Patients with worse objective visual outcomes were more likely to complete PRO measures in this population-based study. In a setting with loss to follow-up, PRO measures require methods to address missing data for correct interpretation.

Non-response did not affect prevalence estimates of asthma and respiratory symptoms - results from a postal questionnaire survey of the general population

BACKGROUND

A high participation rate is warranted in order to ensure validity in surveys of the general population. However, participation rates in such studies have declined during the last decades.

OBJECTIVE

To evaluate the reasons for and potential effects of non-response in a large population-based survey about asthma and respiratory symptoms in Northern Sweden.

METHODS

Within the Obstructive Lung Disease In Norrbotten (OLIN) studies, a random sample of 12,000 adults aged 20-79 was invited to a postal questionnaire survey about asthma, allergic rhino-conjunctivitis and respiratory symptoms in 2016. Three reminders were sent. A random sample of 500 non-responders was invited to a telephone interview.

RESULTS

The participation rate in the initial mailing was 41.4%, and 9.2%, 5.0%, and 2.6% in the subsequent three reminders and totally 58.3% (n = 6854) responded. Of 500 non-responders selected for telephone interviews, 320 were possible to reach and 272 participated. Male sex, younger age, and current smoking were associated with both late and non-response. The prevalence of asthma and most respiratory symptoms did not differ significantly between responders and non-responders while allergic rhino-conjunctivitis and smoking was more common among non-responders. Reminders increased the participation rate but did not alter risk ratios for smoking and occupational exposures. Reasons for non-response were mainly lack of time and having forgotten to answer.

CONCLUSIONS

With a response rate of 58.3%, neither the prevalence estimates of asthma, respiratory symptoms nor the associations to risk factors were affected by non-response, while allergic rhino-conjunctivitis and smoking was underestimated in this Swedish population.

Associations of Mail Survey Length and Layout With Response Rates

We assess the association between survey layout and response rates (RRs) in the 2017 Medicare Advantage Consumer Assessment of Healthcare Providers and Systems mail survey. Among 438 Medicare Advantage plans surveyed by six vendors, there was latitude in survey layout, and plans could add up to 12 supplemental items. Regression models predicted survey response from survey characteristics (page count, number of supplemental items, and survey attractiveness), and beneficiary sociodemographics. Beneficiary-age-by-survey-characteristic interactions assessed whether survey characteristics were more strongly related to RRs among older beneficiaries. We found that surveys with more supplemental items and less attractive layouts had lower adjusted odds of response. RRs were more sensitive to format among older beneficiaries. The difference in adjusted RRs for the most favorable versus the least favorable survey design was 14.5%. For a 65-year-old, this difference was 13.6%; for an 80-year-old, it was 21.0%. These findings suggest that even within a relatively standardized survey, formatting can substantially influence RRs.

Job type and other socio-demographic factors associated with participation in a national, cross-sectional study of Danish employees

OBJECTIVES

Participation in population-based surveys and epidemiological studies has been declining over the years in many countries. The aim of this study was to examine the association between job type and participation in the work environment and health in Denmark survey with/without taking into account other socio-demographic factors.

DESIGN

Cross-sectional survey using questionnaire data on working environment and registry data on job type, industry and socio-economic variables.

SETTING

The work environment and health study.

PARTICIPANTS

A total of 50 806 employees (15 767 in a stratified workplace sample; 35 039 in a random sample) working at least 35 hours/month and earning at least 3000 Danish Krones.

OUTCOME MEASURES

The outcome was participation (yes/no) and logistic regression was used to estimate the OR for participation with 95% CI.

RESULTS

In the random sample, women were more likely to participate than men, and married/non-married couples were more likely to participate than persons living alone or more families living together. Participation increased with higher age, higher annual personal income, higher education and Danish origin, and there were marked differences in participation between job types and geographical regions. For armed forces, craft and related trade workers, and skilled agricultural, forestry and fishery workers, the association between job type and participation was strongly attenuated after adjustment for sex and age. Additional adjustment for annual income, education, cohabitation, country of origin and geographical region generally attenuated the association between job type and participation. Similar results were found in the stratified workplace sample.

CONCLUSION

In this population of Danish employees, participation varied across types of jobs. Some but not all the variation between job types was explained by other socio-demographic factors. Future studies using questionnaires may consider targeting efforts to (sub-)populations, defined by job type and other factors, where response probability is particularly important.

Using predicted Spanish preference to target bilingual mailings in a mail survey with telephone follow-up

OBJECTIVE

Spanish-preferring Medicare beneficiaries are underrepresented in national patient experience surveys. We test a method for improving their representation via higher response rates.

DATA SOURCES/STUDY SETTING

2009-2010 Medicare CAHPS surveys; Medicare population.

STUDY DESIGN

We used surname and address to predict Spanish-language preference for a national sample of 177 139 beneficiaries. We randomized half of the 10 000 non-Puerto Rico beneficiaries with the highest predicted probabilities of Spanish preference (>10 percent) to bilingual mailings (intervention) and half to standard English-only mailings (control).

DATA COLLECTION

Medicare CAHPS Survey data were collected through mail surveys with telephone follow-up of nonrespondents.

PRINCIPAL FINDINGS

Mail response rate was higher for intervention (28.7 percent) than control (23.9 percent) (P < 0.0001); phone response rates among mail nonrespondents were similar in intervention and control arms (15.8 percent vs 15.7 percent, P = 0.90). Targeted bilingual mailings induced 6.5 percent of those who would not have responded to respond by mail and 54.0 percent of those who would have responded in English to respond in Spanish. Beneficiaries with greater Spanish probabilities showed greater increases in response rates, a higher proportion of responses in Spanish, and lower control response rates among.

CONCLUSIONS

Targeted bilingual mailing of mixed-mode surveys using commonly available surname and address information can efficiently increase representation of this underrepresented group.

Geographical characteristics influencing the risk of poisoning in pet dogs: Results of a large population-based epidemiological study in Italy

Pets can act as sentinels for human health and thus surveillance of pet dogs has the potential to improve awareness of emerging risks for animal and public health. The aim of this study was to investigate factors associated with the risk of canine poisoning. In a large population-based epidemiological investigation in Italy performed from January 2015 to January 2016 and April 2016 to April 2017, descriptive statistics were acquired and analysed to determine variables associated with poisoning events in pet dogs. Results were validated in a test population and forecast analysis of risk was performed. The cumulative incidence of poisoning events was low (10.2/1000 dogs/year). Anticoagulant rodenticides, organophosphate pesticides, metaldehyde and strychnine were the most frequent causes of intoxications. Territory characteristics significantly modulated both the frequency and the nature of the involved substances. The seashore area was associated with poisoning by rodenticides (odds ratio, OR, 1.81, 95% confidence interval, CI, 1.54-2.13) and metaldehyde (OR 1.61, 95% CI 1.16-2.28). The hill country area was associated with poisoning by organophosphate pesticides (OR 1.73, 95% CI 1.38-2.15), metaldehyde (OR 2.26, 95% CI 1.53-3.25) and strychnine (OR 1.86, 95% CI, 1.34-2.57). The mountain area was associated with strychnine poisoning (OR 3.79, 95% CI 2.84-5.06). The prospective cumulative incidence of poisoning over 10 years was 9.74% (95% CI 9.57-9.91). These results may be useful for predicting the risk of poisoning and for estimating the risk index related to specific toxic compounds in specific territories. This study suggests that poisoning events in dogs may represent a problem of public health with the potential to affect wildlife and human beings.

Development and Implementation of the Family Experiences With Coordination of Care Survey Quality Measures

OBJECTIVE

Ensuring high-quality care coordination for children with medical complexity (CMC) could yield significant health and economic benefits because they account for one-third of pediatric health care expenditures. The objective of this study was to develop and field test the Family Experiences with Coordination of Care (FECC) survey, which facilitates assessment of 20 new caregiver-reported quality measures for CMC.

METHODS

We identified caregivers of Medicaid-insured CMC aged 0 to 17 years in Minnesota and Washington state, categorized by the Pediatric Medical Complexity Algorithm as having complex chronic disease. Eligible caregivers had CMC with at least 4 visits to health care providers participating in Medicaid in 2012. Caregivers were randomized to telephone or mixed mode (mail with telephone follow-up). Survey administration and data were collected in 2013.

RESULTS

Twelve hundred nine caregivers responded to the FECC survey (response rate, 41%; 36% via telephone only, 46% via mixed mode; P < .001). Among CMC with a hospitalization, caregivers were invited to join hospital rounds in 51% of cases. Seventy-two percent of caregivers reported their child had a care coordinator; among these, 96% reported knowing how to access the care coordinator. Few children had written shared care plans (44%) or emergency care plans (20%). Only 10% of adolescents had a written transition care plan. Scores were lower from mixed mode respondents than from telephone-only respondents for some measures.

CONCLUSIONS

The FECC survey enables the evaluation of care coordination quality for CMC. Both survey modes were feasible to implement, but mixed mode administration produced a higher response rate.

Effect of Hospital Case Mix on the Hospital Consumer Assessment of Healthcare Providers and Systems Star Scores: Are All Stars the Same?

OBJECTIVE

We aimed to evaluate variations in patient experience measures across different surgical specialties and to assess the impact of further case-mix adjustment.

BACKGROUND

Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) is a publicly reported survey of patients' hospital experiences that directly influence Medicare reimbursement.

METHODS

All adult surgical inpatients meeting criteria for HCAHPS sampling from 2013 to 2014 at a single academic center were identified. HCAHPS measures were analyzed according to published top-box and Star-rating methodologies, and were dichotomized ("high" vs "low"). Multivariable logistic regression was used to identify independent associations of high patient scores on various HCAHPS measures with specialty, diagnosis-related group complexity, cancer diagnosis, sex, and emergency admission after adjusting for HCAHPS case-mix adjusters (education, overall health status, language, and age).

RESULTS

We identified 36,551 eligible patients, of which 30.8% (n = 11,273) completed HCAHPS. Women [odds ratio (OR) 0.78, 95% confidence interval (CI) 0.72-0.85, P < 0.001], complex cases (OR 0.90, 95% CI 0.82-0.99, P = 0.02), and emergency admissions (OR 0.67, 95% CI 0.55-0.82, P < 0.001) had lesser Star scores on adjusted analysis, whereas patients with a cancer diagnosis had greater Star scores (OR 1.15, 95% CI 1.03-1.29, P = 0.01). Using general surgery as the reference, the Star scores varied significantly across 12 specialties (range OR 0.65 for plastics to 1.29 for transplant surgery). Patient responses to individual composite scores (pain, care transition, physician, and nurse) varied by specialty.

CONCLUSIONS

HCAHPS case-mix adjustment does not include adjustment for specialty or diagnosis, which may result in artificially lower scores for centers that provide a high level of complex care. Further research is needed to ensure that the HCAHPS is an unbiased comparison tool.

Development and validation of an instrument to measure collaborative goal setting in the care of patients with diabetes

OBJECTIVE

Despite known benefits of patient-perceived collaborative goal setting, we have a limited ability to monitor this process in practice. We developed the Patient Measure of Collaborative Goal Setting (PM-CGS) to evaluate the use of collaborative goal setting from the patient's perspective.

RESEARCH DESIGN AND METHODS

A random sample of 400 patients aged 40 years or older, receiving diabetes care from the Virginia Commonwealth University Health System between 8/2012 and 8/2013, were mailed a survey containing potential PM-CGS items (n=44) as well as measures of patient demographics, perceived self-management competence, trust in their physician, and self-management behaviors. Confirmatory factor analysis was used to evaluate construct validity. External validity was evaluated via a structural equation model (SEM) that tested the association of the PM-CGS with self-management behaviors. The direct and two mediated (via trust and self-efficacy) pathways were tested.

RESULTS

A total of 259 patients responded to the survey (64% response rate), of which 192 were eligible for inclusion. Results from the factor analysis supported a 37-item measure of patient-perceived CGS spanning five domains: listen and learn; share ideas; caring relationship; measurable objective; and goal achievement support (χ=4366.13, p<0.001; RMSEA=0.08). Results from the SEM supported the external validity of the PM-CGS. The relationship between CGS and self-management was partially mediated by perceived competence (p<0.05). The direct effect between the PM-CGS and self-management was significant (p<0.001).

CONCLUSIONS

CGS can be validly measured by the 37-item PM-CGS. Use of the PM-CGS can help illustrate actionable deficits in goal-setting discussions.

Comparison of Mail and Telephone in Assessing Patient Experiences in Receiving Care from Medical Group Practices

The medical group survey from the CAHPS® (formerly Consumer Assessment of Health Plans Study) project, G-CAHPS, focuses on patient experiences in receiving care from their medical group practice. We compared mail and telephone responses to the GCAHPS survey in a sample of 880 patients fromfour physician groups. Patients were randomly assigned to mode. Analyses included comparison of response rates, missing data, internal consistency reliability of six multiitem scales, and mean scores. A total of 537 phone completes and 343 mail completes were obtained (54% response rate). There were no significant differences in internal consistency by mode. In addition, there was only one significant mode difference in item and composite means by mode of administration after adjusting for case-mix differences. This study indicates that mail and telephone modes of data collection for the G-CAHPS survey produce similar results.

Incidence of and risk for post-traumatic stress disorder and depression in a representative sample of US Reserve and National Guard

PURPOSE

We aim to determine the incidence rates (IR) of first-ever post-traumatic stress disorder (PTSD) and depression in a population-based cohort of US Reserve and National Guard service members.

METHODS

We used data from the US Reserve and National Guard Study (n = 2003) to annually investigate incident and recurrent PTSD and depression symptoms from 2010 to 2013. We estimated the IR and recurrence rate over 4 years and according to several sociodemographic and military characteristics.

RESULTS

From 2010 to 2013, IRs were 4.7 per 100 person-years for both PTSD and depression symptoms using the sensitive criteria, 2.9 per 100 person-years using the more specific criteria, recurrence rates for both PTSD and depression were more than 4 times as high as IRs, and IRs were higher among those with past-year civilian trauma, but not past-year deployment.

CONCLUSIONS

The finding that civilian trauma, but not past-year military deployment, is associated with an increased risk of PTSD and depression incidence suggest that Reserve National Guard psychopathology could be driven by other, nonmilitary, traumatic experiences.

Approaches to Mixed Methods Dissemination and Implementation Research: Methods, Strengths, Caveats, and Opportunities

Limited translation of research into practice has prompted study of diffusion and implementation, and development of effective methods of encouraging adoption, dissemination and implementation. Mixed methods techniques offer approaches for assessing and addressing processes affecting implementation of evidence-based interventions. We describe common mixed methods approaches used in dissemination and implementation research, discuss strengths and limitations of mixed methods approaches to data collection, and suggest promising methods not yet widely used in implementation research. We review qualitative, quantitative, and hybrid approaches to mixed methods dissemination and implementation studies, and describe methods for integrating multiple methods to increase depth of understanding while improving reliability and validity of findings.

What we don't know can hurt us: Nonresponse bias assessment in birth defects research

BACKGROUND

Nonresponse bias assessment is an important and underutilized tool in survey research to assess potential bias due to incomplete participation. This study illustrates a nonresponse bias sensitivity assessment using a survey on perceived barriers to care for children with orofacial clefts in North Carolina.

METHODS

Children born in North Carolina between 2001 and 2004 with an orofacial cleft were eligible for inclusion. Vital statistics data, including maternal and child characteristics, were available on all eligible subjects. Missing 'responses' from nonparticipants were imputed using assumptions based on the distribution of responses, survey method (mail or phone), and participant maternal demographics.

RESULTS

Overall, 245 of 475 subjects (51.6%) responded to either a mail or phone survey. Cost as a barrier to care was reported by 25.0% of participants. When stratified by survey type, 28.3% of mail respondents and 17.2% of phone respondents reported cost as a barrier. Under various assumptions, the bias-adjusted estimated prevalence of cost as barrier to care ranged from 16.1% to 30.0%. Maternal age, education, race, and marital status at time of birth were not associated with subjects reporting cost as a barrier.

CONCLUSION

As survey response rates continue to decline, the importance of assessing the potential impact of nonresponse bias has become more critical. Birth defects research is particularly conducive to nonresponse bias analysis, especially when birth defect registries and birth certificate records are used. Future birth defect studies which use population-based surveillance data and have incomplete participation could benefit from this type of nonresponse bias assessment. Birth Defects Research (Part A) 103:603-609, 2015. © 2015 Wiley Periodicals, Inc.

Comparison of paper and electronic surveys for measuring patient-reported outcomes after anterior cruciate ligament reconstruction

OBJECTIVE

This study compared response rates of paper and electronic versions of the Knee injury Osteoarthritis and Outcome Score questionnaire and examined the characteristics of patients who responded to each survey method.

METHODS

A total of 1486 patients registered by the Kaiser Permanente Anterior Cruciate Ligament Reconstruction Registry between 2005 and 2010 were included in this study. Response rates by survey modality for the overall cohort, by the specific time periods, and by age and sex at time of anterior cruciate ligament reconstruction were compared using χ(2) tests or the Fisher exact test when appropriate. Independent Student t tests were used to compare the Knee injury Osteoarthritis and Outcome Scores of survey respondents.

RESULTS

The overall survey response rate was 42%. The 36% response rate in the electronic-survey group was significantly higher than the 22% response rate in the paper-survey group (p < 0.001). The electronic response rate was also significantly higher than the paper response rate at all follow-up times (35% vs 25% at 1 year, p = 0.004, 38% vs 20% at 2 years, p < 0.001, and 35% vs 21% at 3 years; p < 0.001) and among all age groups 19 years and older.

CONCLUSION

Although the electronic survey produced higher response rates, it is not sufficient alone to replace the traditional paper version among this Kaiser Permanente population.

How are those “lost to follow-up” patients really doing? A compliance comparison in arthroplasty patients

AIM: To determine whether there is a functional difference between patients who actively follow-up in the office (OFU) and those who are non-compliant with office follow-up visits (NFU).

METHODS: We reviewed a consecutive group of 588 patients, who had undergone total joint arthroplasty (TJA), for compliance and functional outcomes at one to two years post-operatively. All patients were given verbal instructions by the primary surgeon to return at one year for routine follow-up visits. Patients that were compliant with the instructions at one year were placed in the OFU cohort, while those who were non-compliant were placed in the NFU cohort. Survey mailings and telephone interviews were utilized to obtain complete follow-up for the cohort. A χ² test and an unpaired t test were used for comparison of baseline characteristics. Analysis of covariance was used to compare the mean clinical outcomes after controlling for confounding variables.

RESULTS: Complete follow-up data was collected on 554 of the 588 total patients (93%), with 75.5% of patients assigned to the OFU cohort and 24.5% assigned to the NFU cohort. We found significant differences between the cohorts with the OFU group having a higher mean age (P = 0.026) and a greater proportion of females (P = 0.041). No significant differences were found in either the SF12 or WOMAC scores at baseline or at 12 mo postoperative.

CONCLUSION: Patients who are compliant to routine follow-up visits at one to two years post-operation do not experience better patient reported outcomes than those that are non-compliant. Additionally, after TJA, older women are more likely to be compliant in following surgeon instructions with regard to follow-up office care.

Analysis of factors influencing telephone call response rate in an epidemiological study

Descriptive epidemiology research involves collecting data from large numbers of subjects. Obtaining these data requires approaches designed to achieve maximum participation or response rates among respondents possessing the desired information. We analyze participation and response rates in a population-based epidemiological study though a telephone survey and identify factors implicated in consenting to participate. Rates found exceeded those reported in the literature and they were higher for afternoon calls than for morning calls. Women and subjects older than 40 years were the most likely to answer the telephone. The study identified geographical differences, with higher RRs in districts in southern Spain that are not considered urbanized. This information may be helpful for designing more efficient community epidemiology projects.

Measuring patient satisfaction with health care treatment using the Short Assessment of Patient Satisfaction measure delivered superior and robust satisfaction estimates

OBJECTIVES

Reviews of patient satisfaction suggest seven dimensions, each of which should be assessed. This study reports development of a short generic patient satisfaction measure for use in routine clinical practice.

STUDY DESIGN AND SETTINGS

Participants were randomly recruited from two Australian incontinence clinics. Participants completed a follow-up questionnaire including patient satisfaction items. Iterative Mokken and Rasch analyses derived the Short Assessment of Patient Satisfaction (SAPS) scale from the item bank.

RESULTS

The SAPS psychometric properties illustrated the following features, namely its descriptive system covers all seven patient satisfaction dimensions, there were no misfitting items, and the scale exceeded the Loevinger H criteria for a strong unidimensional scale. The reliability of the SAPS was Cronbach α=0.86. When discriminatory function was examined, the SAPS scale was more sensitive than two other generic patient satisfaction instruments.

CONCLUSION

The SAPS scale is based on a firm theoretical model of patient satisfaction and its descriptive system covers the known dimensions contributing to patient satisfaction. Its internal psychometric properties exceeded standard psychometric standards, and it discriminated at least as well as other longer patient satisfaction measures. Although it needs further validation, the study results suggest that it may be useful for assessing patient satisfaction with health care.

Proactive tobacco treatment for low income smokers: study protocol of a randomized controlled trial

Background

There is a high prevalence of smoking and high burden of tobacco-related diseases among low-income populations. Effective, evidenced-based smoking cessation treatments are available, but low-income smokers are less likely than higher-income smokers to use these treatments, especially the most comprehensive forms that include a combination of pharmacotherapy and intensive behavioral counseling.

Methods/Design

The primary objectives of this randomized controlled trial are to compare the effects of a proactive tobacco treatment intervention compared to usual care on population-level smoking abstinence rates and tobacco treatment utilization rates among a diverse population of low-income smokers, and to determine the cost-effectiveness of proactive tobacco treatment intervention. The proactive care intervention systematically offers low-income smokers free and easy access to evidence-based treatments and has two primary components: (1) proactive outreach to current smokers in the form of mailed invitation materials and telephone calls containing targeted health messages, and (2) facilitated access to free, comprehensive, evidence-based tobacco cessation treatments in the form of NRT and intensive, telephone-based behavioral counseling. The study aims to include a population-based sample (N = 2500) of adult smokers enrolled in the Minnesota Health Care Programs (MHCP), a state-funded health insurance plan for low-income persons. Baseline data is obtained from MHCP administrative databases and a participant survey that is conducted prior to randomization. Outcome data is collected from a follow-up survey conducted 12 months after randomization and MHCP administrative data. The primary outcome is six-month prolonged smoking abstinence at one year and is assessed at the population level. All randomized individuals are asked to complete the follow-up survey, regardless of whether they participated in tobacco treatment. Data analysis of the primary aims will follow intent-to-treat methodology.

Discussion

There is a critical need to increase access to effective tobacco dependence treatments. This randomized trial evaluates the effects of proactive outreach coupled with free NRT and telephone counseling on the population impact of tobacco dependence treatment. If proven to be effective and cost-effective, national dissemination of proactive treatment approaches would reduce tobacco-related morbidity, mortality, and health care costs for low income Americans.

Clinical trials registration

ClinicalTrials.gov: NCT01123967

Inter-method reliability of paper surveys and computer assisted telephone interviews in a randomized controlled trial of yoga for low back pain

Background

Little is known about the reliability of different methods of survey administration in low back pain trials. This analysis was designed to determine the reliability of responses to self-administered paper surveys compared to computer assisted telephone interviews (CATI) for the primary outcomes of pain intensity and back-related function, and secondary outcomes of patient satisfaction, SF-36, and global improvement among participants enrolled in a study of yoga for chronic low back pain.

Results

Pain intensity, back-related function, and both physical and mental health components of the SF-36 showed excellent reliability at all three time points; ICC scores ranged from 0.82 to 0.98. Pain medication use showed good reliability; kappa statistics ranged from 0.68 to 0.78. Patient satisfaction had moderate to excellent reliability; ICC scores ranged from 0.40 to 0.86. Global improvement showed poor reliability at 6 weeks (ICC = 0.24) and 12 weeks (ICC = 0.10).

Conclusion

CATI shows excellent reliability for primary outcomes and at least some secondary outcomes when compared to self-administered paper surveys in a low back pain yoga trial. Having two reliable options for data collection may be helpful to increase response rates for core outcomes in back pain trials.

Trial registration

ClinicalTrials.gov: NCT01761617. Date of trial registration: December 4, 2012.

NICU patient satisfaction: how you measure counts

OBJECTIVE

To examine whether the method of measuring patient satisfaction influences the results.

STUDY DESIGN

All families with NICU patients discharged home alive to parent(s) were surveyed at 2 to 42 days post discharge with two parallel surveys (mailed and phone) from August 2010 to December 2011. The responses to the same five questions on each survey were recorded and subjected to statistical analysis via paired Student's t and Pearson correlation coefficients to see whether the two surveys yielded the same population attitudes.

RESULT

Eight hundred and thirteen families were included in the study. Seven hundred and sixty three (93.8%) completed the phone survey and 237 (29.2%) completed the mail in survey. Three of the five questions yielded significantly different answers between mailed and phone responses. In addition, no significant linear correlation between mail and survey could be found for the other two questions.

CONCLUSION

As no linear correlation could be found between two of the five questions, a process constant mathematical value could not be identified. This indicates that mail survey and phone survey respondents have different attitudes that cannot be adjusted because of methodological measurement effects.

A Randomized Experiment Investigating the Suitability of Speech-Enabled IVR and Web Modes for Publicly Reported Surveys of Patients’ Experience of Hospital Care

The HCAHPS Survey obtains hospital patients’ experiences using four modes: Mail Only, Phone Only, Mixed (mail/phone follow-up), and Touch-Tone (push-button) Interactive Voice Response with option to transfer to live interviewer (TT-IVR/Phone). A new randomized experiment examines two less expensive modes: Web/Mail (mail invitation to participate by Web or request a mail survey) and Speech-Enabled IVR (SE-IVR/Phone; speaking to a voice recognition system; optional transfer to an interviewer). Web/Mail had a 12% response rate (vs. 32% for Mail Only and 33% for SE-IVR/Phone); Web/Mail respondents were more educated and less often Black than Mail Only respondents. SE-IVR/Phone respondents (who usually switched to an interviewer) were less often older than 75 years, more often English-preferring, and reported better care than Mail Only respondents. Concerns regarding inconsistencies across implementations, low adherence to primary modes, or low response rate may limit the applicability of the SE-IVR/Phone and Web/Mail modes in HCAHPS and similar standardized environments.

Evaluating survey quality in health services research: a decision framework for assessing nonresponse bias

OBJECTIVE

To address the issue of nonresponse as problematic and offer appropriate strategies for assessing nonresponse bias.

STUDY DESIGN

A review of current strategies used to assess the quality of survey data and the challenges associated with these strategies is provided along with appropriate post-data collection techniques that researchers should consider.

PRINCIPAL FINDINGS

Response rates are an incomplete assessment of survey data quality, and quick reactions to response rate should be avoided. Based on a five-question decision making framework, we offer potential ways to assess nonresponse bias, along with a description of the advantages and disadvantages to each.

CONCLUSIONS

It is important that the quality of survey data be considered to assess the relative contribution to the literature of a given study. Authors and funding agencies should consider the potential effects of nonresponse bias both before and after survey administration and report the results of assessments of nonresponse bias in addition to response rates.

Dating violence victimization across the teen years: abuse frequency, number of abusive partners, and age at first occurrence

Background

Prior longitudinal studies have shown high cumulative dating violence exposure rates among U.S adolescents, with 36 percent of males and 44 percent to 88 percent of females experiencing victimization across adolescence/young adulthood. Despite promising information characterizing adolescents’ dating violence experiences longitudinally, prior studies tended to concentrate on physical and sexual types of violence only, and did not report information on the number of times dating violence was experienced across multiple abusive partners. We used a method similar to the timeline follow-back interview to query adolescents about dating violence victimization from age 13 to 19—including dating violence types (physical, sexual, and psychological), frequency, age at first occurrence, and number of abusive partners.

Methods

A total of 730 subjects were randomly sampled from university registrar records and invited to complete an online survey, which utilized methods similar to the timeline follow-back interview, to retrospectively assess relationship histories and dating violence victimization from age 13 to 19 (eight questions adapted from widely-used surveys covering physical, sexual, and psychological abuse). Then, for each dating violence type, we asked about the number of occurrences, number of abusive partners, and age at first occurrence. Of 341 subjects who completed the survey, we included 297 (64 percent females; 36 percent males) who had a dating partner from age 13 to 19.

Results

Fully 64.7 percent of females and 61.7 percent of males reported dating violence victimization between age 13 and 19, with most experiencing multiple occurrences. More than one-third of abused females had two or more abusive partners: controlling behavior (35.6 percent); put downs/name calling (37.0); pressured sex (42.9); insults (44.3); slapped/hit (50.0); and threats (62.5). Males also had two or more abusive partners, as follows: controlling behavior (42.1 percent); insults (51.2); put downs (53.3); threats (55.6); and unwanted calls/texts/visits (60.7). Among abused females, 44.7 percent first experienced controlling behavior between age 13 and 15, whereas the majority (62.5 percent) first experienced pressured sex between age 16 and 17. Among males, for most abuse types, 16 percent to 30 percent of victimization began before age 15.

Conclusions

Our study adds information to a substantial, but still growing, body of literature about dating violence frequency, age of occurrence, and number of abusive partners among adolescents.

Effect of survey instrument on participation in a follow-up study: a randomization study of a mailed questionnaire versus a computer-assisted telephone interview

BACKGROUND

Many epidemiological and public health surveys report increasing difficulty obtaining high participation rates. We conducted a pilot follow-up study to determine whether a mailed or telephone survey would better facilitate data collection in a subset of respondents to an earlier telephone survey conducted as part of the National Birth Defects Prevention Study.

METHODS

We randomly assigned 392 eligible mothers to receive a self-administered, mailed questionnaire (MQ) or a computer-assisted telephone interview (CATI) using similar recruitment protocols. If mothers gave permission to contact the fathers, fathers were recruited to complete the same instrument (MQ or CATI) as mothers.

RESULTS

Mothers contacted for the MQ, within all demographic strata examined, were more likely to participate than those contacted for the CATI (86.6% vs. 70.6%). The median response time for mothers completing the MQ was 17 days, compared to 29 days for mothers completing the CATI. Mothers completing the MQ also required fewer reminder calls or letters to finish participation versus those assigned to the CATI (median 3 versus 6), though they were less likely to give permission to contact the father (75.0% vs. 85.8%). Fathers contacted for the MQ, however, had higher participation compared to fathers contacted for the CATI (85.2% vs. 54.5%). Fathers recruited to the MQ also had a shorter response time (median 17 days) and required fewer reminder calls and letters (median 3 reminders) than those completing the CATI (medians 28 days and 6 reminders).

CONCLUSIONS

We concluded that offering a MQ substantially improved participation rates and reduced recruitment effort compared to a CATI in this study. While a CATI has the advantage of being able to clarify answers to complex questions or eligibility requirements, our experience suggests that a MQ might be a good survey option for some studies.

Deployment of a mixed-mode data collection strategy does not reduce nonresponse bias in a general population health survey

OBJECTIVE

To assess nonresponse bias in a mixed-mode general population health survey.

DATA SOURCES

Secondary analysis of linked survey sample frame and administrative data, including demographic and health-related information.

STUDY DESIGN

The survey was administered by mail with telephone follow-up to nonrespondents after two mailings. To determine whether an additional mail contact or mode switch reduced nonresponse bias, we compared all respondents (N = 3,437) to respondents from each mailing and telephone respondents to the sample frame (N = 6,716).

PRINCIPAL FINDINGS

Switching modes did not minimize the under-representation of younger people, nonwhites, those with congestive heart failure, high users of office-based services, and low-utilizers of the emergency room but did reduce the over-representation of older adults.

CONCLUSIONS

Multiple contact and mixed-mode surveys may increase response rates, but they do not necessarily reduce nonresponse bias.

The Swiss National Vaccination Coverage Survey, 2005-2007

OBJECTIVES

We described the results from the Swiss National Vaccination Coverage Survey (SNVCS) 2005-2007, a survey designed to monitor immunization coverage of children and adolescents residing in Switzerland in each canton within a three-year period.

METHODS

The SNVCS is a cross-sectional survey using a two-stage sampling design targeting children aged 2, 8, and 16 years. Families of selected children were contacted by mail and telephone. Coverage was determined via vaccination cards or vaccination summary forms.

RESULTS

A total of 25 out of 26 cantons participated in the survey, with 8,286 respondents for children aged 24-35 months, 10,314 respondents for children aged 8 years, and 9,301 respondents for teenagers aged 16 years. Compared with data from 1999-2003, coverage estimates for toddlers remained unchanged for diphtheria, tetanus, pertussis, poliomyelitis, and Haemophilus influenzae type b vaccines at three doses, but increased five percentage points to 86%-87% for measles-mumps-rubella at one dose and was 71% at two doses. Coverage for measles, mumps, and rubella were 89%-90% at one dose and 75% at two doses for 8-year-olds, and 94% and 76% for the two dosages, respectively, for 16-year-olds. Linguistic region and nationality were highly correlated with being vaccinated against measles for the two younger age groups.

CONCLUSION

Despite the increase in vaccine coverage, measles vaccination is still low, and the World Health Organization goal to eliminate measles by 2010 was not achieved in Switzerland. More efforts are needed by the cantons and the central government to increase vaccination coverage.

Understanding nonresponse to the 2007 Medicare CAHPS survey

PURPOSE

The Medicare Consumer Assessments of Healthcare Providers and Systems (MCAHPS) survey, a primarily English-language mail survey with English and Spanish telephone follow-up, is the primary means of assessing the health care experiences of American seniors. We examine unit (whole survey) and item nonresponse for this survey to explore issues regarding surveying seniors about their health care.

DESIGN AND METHODS

We describe overall rates and analyze predictors of unit and item nonresponse for the 695,197 Medicare beneficiaries selected for the 2007 MCAHPS survey (335,249 unit respondents, 49% overall response rate).

RESULTS

Asians, African Americans, and Hispanics responded at adjusted response rates 7-17 percentage points lower than non-Hispanic Whites (p < .001 for each). Among seniors, response rates dropped beyond age 75. Asians and older beneficiaries were especially likely to respond by mail, and African Americans and Hispanics by phone. Breakoff from telephone surveys was most common among African Americans and older respondents. Among respondents, older age was the strongest predictor of item missingness (e.g., those 85 years and older failed to answer items at twice the rate of those aged 65-74 years, p < .001). Non-Hispanic Whites had lower rates of item missingness than other racial/ethnic groups (p < .001 for each; one-third lower than African Americans).

IMPLICATIONS

Survey research on older adults, especially regarding racial/ethnic disparities in health care, could benefit from improved response rates. These results suggest that targeted prenotification materials and campaigns, tailored follow-up, targeted Spanish mailings, Chinese translations/calls, and adjustments to telephone protocols may improve representation and response.

Fruit and vegetable intake of US adults: comparing intake by mode of survey administration

Modes for collecting dietary data vary across studies and include in-person/interviewer-administered surveys, mail, and telephone surveys. Few studies use mixed modes to assess dietary intakes. Using data from the 2007 Health Information National Trends Survey, we compared fruit and vegetable intake of adults measured through dual modes (mail and random-digit dial [RDD] telephone), and discussed potential factors that could account for mode differences. The Health Information National Trends Survey data were collected through mailed (n=3,582), and RDD (n=4,092) surveys from December 2007 to May 2008. Data were weighted and analyzed in SUDAAN. Unadjusted mean fruit and vegetable intake was 0.48 servings higher (P<0.001) among mail (mean 5.40) vs RDD (mean 4.09) participants. In a multivariate model that controlled for other predictors, the odds of consuming ≥5 servings of fruit and vegetables per day was 83% higher among mail respondents compared to RDD (odds ratio 1.83, 95% confidence interval 1.62 to 2.07). Other predictors of fruit and vegetable intake were sex, education, participation in physical activity, self-rated health, and knowledge of the fruit and vegetable recommendation. Methodologic issues may account for modal differences in fruit and vegetable intake. Different measures (cups, servings) were used to assess fruit and vegetable intake in both modes, details about portion sizes were provided on the mail mode vs RDD, and closed-ended responses were provided on the mail vs open-ended responses for RDD. We cannot recommend one mode over the other nor attribute mode differences to real differences in reported fruit and vegetable intake between participants from both modes. Future research that uses dual modes needs to use identical methods of dietary assessment to minimize these potential sources of error. Further research is needed to validate the use of dual modes to assess dietary intake and inform research practice.

Case-mix adjustment and the comparison of community health center performance on patient experience measures

OBJECTIVE

To assess the effect of case-mix adjustment on community health center (CHC) performance on patient experience measures.

DATA SOURCES

A Medicaid-managed care plan in Washington State collected patient survey data from 33 CHCs over three fiscal quarters during 2007-2008. The survey included three composite patient experience measures (6-month reports) and two overall ratings of care. The analytic sample includes 2,247 adult patients and 2,859 adults reporting for child patients.

STUDY DESIGN

We compared the relative importance of patient case-mix adjusters by calculating each adjuster's predictive power and variability across CHCs. We then evaluated the impact of case-mix adjustment on the relative ranking of CHCs.

PRINCIPAL FINDINGS

Important case-mix adjusters included adult self-reported health status or parent-reported child health status, adult age, and educational attainment. The effects of case-mix adjustment on patient reports and ratings were different in the adult and child samples. Adjusting for race/ethnicity and language had a greater impact on parent reports than adult reports, but it impacted ratings similarly across the samples. The impact of adjustment on composites and ratings was modest, but it affected the relative ranking of CHCs.

CONCLUSIONS

To ensure equitable comparison of CHC performance on patient experience measures, reports and ratings should be adjusted for adult self-reported health status or parent-reported child health status, adult age, education, race/ethnicity, and survey language. Because of the differential impact of case-mix adjusters for child and adult surveys, initiatives should consider measuring and reporting adult and child scores separately.

Psychiatric disorders in students in six French universities: 12-month prevalence, comorbidity, impairment and help-seeking

PURPOSE

Few studies have explored the prevalence of psychiatric disorders (PD) among university students. This article aims to study 12-month prevalence of PD in university students, their socio-economic correlates, impairment in daily life and help-seeking behaviours.

METHODS

Cross-sectional study of randomly selected first-year students aged 18-24 years, enrolled in one of the six universities in south-eastern France in 2005-2006. We used the WHO CIDI-Short Form to derive DSM-IV diagnoses and the Sheehan disability scale to evaluate impairment. We studied their correlates with multiple logistic regressions.

RESULTS

The 12-month prevalence of major depressive disorder (MDD), anxiety disorders (AD) and substance use disorders (SUD) were 8.9% (95% CI: 7.2-10.9), 15.7% (95% CI: 13.5-18.2) and 8.1% (95% CI: 6.7-9.8), respectively. MDD was associated with precarious economic situation (OR = 1.83; 95% CI: 1.03-3.23), AD with a precarious job or unemployment of the father (OR = 2.08; 95% CI: 1.04-4.14) and SUD with higher educational level of father (OR = 2.17; 95% CI: 1.28-3.67) or having a paid job (OR = 1.82; 95% CI: 1.06-3.13). "Marked" or "extreme" impairment (score > or =7 for at least one of the domains in the Sheehan scale) was noted for 51.7% of students presenting a PD and was even more frequent in the presence of MDD/AD comorbidity. Only 30.5% of the students with a PD had sought professional help in the past 12 months.

CONCLUSIONS

This study provides new results regarding university students suggesting a link between precarious economic situations and MDD. The frequent impairment arising from PD alongside low rates of help-seeking suggests that PD could be one of the factors in academic failure in first year of university. These results should be used to improve prevention and care of PD in university students in France.

Impact of perceived innovation characteristics on adoption of pharmacy-based in-house immunization services

Objectives

An in-house immunization service in which staff pharmacists administer vaccines was conceptualized as an innovation. Prior to making adoption decisions, community pharmacies evaluated characteristics of in-house immunization services. This study examined the impact of three specific characteristics (perceived benefit, perceived compatibility and perceived complexity) of in-house immunization services on community pharmacies' adoption decisions.

Methods

A multi-stage mixed-mode survey design was used to collect data from key informants of community pharmacies in Washington State, USA. Key informants included pharmacy managers or pharmacists-on-duty who were able to answer questions related to immunization activities in their pharmacies. Perceived characteristics of in-house immunization services and pharmacy adoption decisions were measured in 2004 and in 2006–2007, respectively.

Key findings

Each perceived characteristic individually predicted adoption of in-house immunization services. When all three characteristics were included in logistic regression, perceived benefit was the only significant predictor of in-house immunization service adoption.

Conclusions

Appropriate strategies, particularly promoting the benefit of in-house immunization services, should be implemented. The proposed model and findings may be applicable to other pharmacy-based innovative practices or other public health initiatives. We recommend that organizational leaders, researchers and practitioners consider the impact of perceived benefit and incorporate it when they design strategies to foster adoption of innovative practices. Doing this may increase the number of adopters and also increase diffusion rates for innovative services.

Interpretations of the clinical outcomes of the nonresponders to mail surveys in patients after total knee arthroplasty

This study examined whether or not nonresponders to mail survey have poorer clinical outcomes than responders. A postal questionnaire, which was designed to evaluate the functional disability and patient's satisfaction, was mailed to 387 patients whose 1-year clinical outcomes were available. Of the 270 patients (69.8%) who responded, 247 (91.4%) reported that they were satisfied with their replaced knees. The knees of the nonresponders showed significantly poorer results in terms of the function-related scales (American Knee Society score function, Western Ontario McMaster University Osteoarthritis Index scale function, Short-Form 36 physical and functional scores) than the knees of the responders, whereas there were no significant differences in the pain-related scales. The clinical results of the nonresponders were poorer in most of the clinical outcome scales than those of the satisfied subgroup of responders but better than those of the dissatisfied subgroup. The results of the pain-related scales were similar to the satisfied subgroup but the function-related scales were similar to the dissatisfied subgroup.

Attributing sources of variation in patients' experiences of ambulatory care

BACKGROUND

Public reporting and pay-for-performance programs increasingly rely on patient experience data to evaluate individual physicians and guide quality improvement efforts. The extent to which performance variation is attributable to physicians versus other system-level units, however, remains unclear.

METHODS

Using ambulatory care experience survey data from 61,839 patients of 1729 primary care physicians in California (response rate = 39.1%), this study assesses the proportion of explainable performance variation attributable to various organizational units in composite measures of physician-patient interaction, organizational features of care, and global assessments of care. For each measure, multilevel regression models that controlled for respondent characteristics and used random effects to account for the clustering of patients within physicians, physicians within care sites, care sites within medical groups, and medical groups within primary care service areas, estimated the proportion of explainable performance variation attributable to each system-level unit.

RESULTS

System-level factors explained between 27.9% to 47.7% of variation, with the highest proportion explained for the access to care composite and the lowest explained for the quality of chronic care composite. Physicians accounted for the largest proportion of explainable variance for all measures (range: 35.1%-49.0%). Care sites and primary care service areas explained substantial proportions of variance (>20% each) for the access to care and care coordination measures. Medical groups explained the largest proportions of variation (>20%) for global assessments of care.

CONCLUSIONS

Individual physicians and their care sites are the most important foci for patient experience improvement efforts. Because markets contribute substantially to performance variation on organizational features of care, future research should clarify the extent to which associated performance deficits are modifiable.

Psychological distress in first year university students: socioeconomic and academic stressors, mastery and social support in young men and women

PURPOSE

Little is known about the role of stressors associated with university life on psychological distress (PD). The aims of this article are to: (1) assess the prevalence of PD among students during their first year of university; (2) study its associations with stressors (socioeconomic and university-related) and protective factors (mastery, social support); and (3) to compare these factors according to gender.

METHODS

Cross-sectional study of a random sample of students aged 18-24 years, in their first year of university in 2005-2006, enrolled in the 6 universities of southeastern France. Standardised questionnaire, by self-administration or telephone interview. Overall, 1,743 students agreed to participate (71.0%).

RESULTS

PD prevalence was estimated at 15.7% (95% CI: 12.9-18.5) among the young men and 33.0% (95% CI: 30.2-35.9) among the young women. Multiple logistic regressions adjusted for social and demographic variables, mode of questionnaire administration, psychiatric history, and recent adverse life events, showed that among men PD was associated with lack of adjustment to the university academic environment (OR = 1.08; 95% CI: 1.00-1.17, P = 0.04), and mastery (OR = 0.73; 95% CI: 0.68-0.79). Among women, the prevalence of PD was associated with medical studies (OR = 2.46; 95% CI: 1.50-4.05), lack of adjustment to the university academic environment (OR = 1.07; 95% CI: 1.03-1.12), mastery (OR = 0.78; 95% CI: 0.75-0.82), and social support (OR = 0.68; 95% CI: 0.54-0.85), with a strong negative statistical interaction between mastery and lack of adjustment.

CONCLUSIONS

This study shows an intermediate prevalence of PD among French first-year university students compared with those observed in university students in other countries. It suggests that PD is related to university-related stressors but failed to find a relation to socioeconomic factors. Risk and protective factors for PD in first-year university students differed somewhat according to gender. However, mastery appeared to have a protective role in both genders. Further research is necessary to confirm these results in other universities and years.

Sustainability of pharmacy-based innovations: the case of in-house immunization services

OBJECTIVE

To examine the effect of organization-level factors on sustainability of pharmacy-based in-house immunization services.

DESIGN

Cross-sectional study.

SETTING

Washington State community pharmacies in 2006.

PARTICIPANTS

Key informants of 490 community pharmacies.

INTERVENTION

Mixed-mode survey; five mail and telephone contacts were used.

MAIN OUTCOME MEASURES

Effectiveness of champions (i.e., influential individuals within the host organization who actively and continuously promote the service), formal evaluation process, degree of modifications made to in-house services, degree of compatibility between in-house services and the host pharmacy, and sustainability of in-house immunization services were measured and included in the proposed model. Using survey responses, factor analysis and path analysis were performed to determine the relationships among these variables.

RESULTS

Of the 490 survey instruments sent, 1 was undeliverable, 2 were incomplete, and 206 were completed (42.1% response rate). A total of 104 pharmacies that reported offering immunization services in 2006 were included in the analysis. Compatibility, which was defined as the fit between in-house immunization services and the host pharmacy, was the key to sustainability of immunization services. To enhance compatibility between in-house services and the host pharmacy, two pathways were found. First, in-house services underwent formal evaluations and subsequent modifications were made to the services. The second pathway bypassed the adaptation process. Through the second pathway, an operational champion implemented in-house services in a way that was already compatible with the host pharmacy.

CONCLUSION

Organizational leaders and practitioners had the potential to sustain in-house services. The key factors included in the model should be incorporated as an integral part of programs planning to foster sustainability of in-house immunization services.

Strategies for achieving a high response rate in a home interview survey

Background

Response rates in surveys have been falling over the last 20 years, leading to the need for novel approaches to enhance recruitment. This study describes strategies used to maximise recruitment to a home interview survey of mothers with young children living in areas of high deprivation.

Methods

Mothers of two year old children received a letter from their GP inviting them to take part in a survey on diet. Participants were subsequently recruited by a researcher. The researcher first tried to contact potential participants by telephone, to discuss the study and make an appointment to conduct a home interview. Where telephone numbers for women could not be obtained from GP records, web searches of publicly available databases were conducted. After obtaining correct telephone numbers, up to six attempts were made to establish contact by telephone. If this was unsuccessful, a postal request for telephone contact was made. Where no telephone contact was achieved, the researcher sent up to two appointments by post to conduct a home interview.

Results

Participating GPs invited 372 women to take part in a home based interview study. GP practices provided telephone numbers for 162 women, of which 134 were valid numbers. The researcher identified a further 187 numbers from electronic directories. Further searches of GP records by practice staff yielded another 38 telephone numbers. Thus, telephone numbers were obtained for 99% of potential participants.

The recruitment rate from telephone contacts was 77%. Most of the gain was achieved within four calls. For the remaining women, contact by post and home visits resulted in 18 further interviews, corresponding to 35% of the women not recruited by telephone. The final interview rate was 82%. This was possible because personal contact was established with 95% of potential participants.

Conclusion

This study achieved a high response rate in a hard to reach group. This was mainly achieved by first establishing contact by telephone. The use of multiple sources identified the telephone numbers of almost all the sample. Multiple attempts at telephone contact followed by postal approaches led to a high home interview rate.