Methods to increase response to postal and electronic questionnaires

The health and well-being of cancer survivors in the UK: findings from a population-based survey

Background:

To compare self-reported health and well-being in a sample of cancer survivors with individuals who have not had cancer and with individuals who have a serious chronic condition other than cancer.

Patients and methods

A cross-sectional survey drawn from an online panel of 400 000 UK citizens supplemented with other online recruitment and telephone recruitment. The participants were 4892 individuals 30 years of age or above, including 780 individuals with a previous cancer diagnosis, 1372 individuals with one or more of 10 chronic conditions but not cancer and 2740 individuals without a previous cancer diagnosis or chronic condition. Thirteen measures of health and well-being were constructed from answers to 25 survey items covering physical, psychological and social dimensions of health and well-being.

Results:

Cancer survivors were significantly more likely to report poor health outcomes across all 13 measures than those with no history of cancer or a chronic condition. The adjusted odds ratios for cancer survivors with no chronic conditions compared with healthy participants ranged from 1.37 (95% confidence interval (CI): 1.31–1.96) for emotional well-being to 3.34 (95% CI: 2.74–4.08) for number of health professionals consulted in the last 12 months. The health profile of cancer survivors was similar to those with a history of a serious chronic health condition.

Conclusions:

A substantial number of individuals who have had a diagnosis of cancer experience ongoing poor health and well-being following cancer and cancer treatment. The results of this study provide an initial basis for the development of specific help and support for cancer survivors.

Computerised cognitive behavioural therapy for the treatment of depression in people with multiple sclerosis: external pilot trial

Background

People with multiple sclerosis (MS) are at high risk of depression. We undertook a pilot trial of computerised cognitive behavioural therapy (CCBT) for the treatment of depression in people with MS to test the feasibility of undertaking a full trial.

Methods

Participants with a diagnosis of MS and clinical levels of depression were recruited through out-patient clinics and postal screening questionnaires at two UK centres and randomised to CCBT or usual care. Clinical outcomes included the Beck Depression Inventory (BDI-II) and Multiple Sclerosis Impact Scale (MSIS-29) at baseline, 8 and 21 weeks. Feasibility outcomes included: recruitment rate; reasons for refusal, withdrawal and dropout; feasibility and acceptability of the proposed outcome measures; sample size estimation and variation in and preferences for service delivery.

Results

Twenty-four participants were recruited. The recruitment rate, calculated as the proportion of those invited to fill in a screening questionnaire who were consented into the trial, was 4.1%. Recruitment through out-patient clinics was somewhat slower than through screening questionnaire mail-out but the overall recruitment yield was similar. Of the 12 patients in the CCBT arm, 9 (75%) completed at least four, and 6 completed all 8 CCBT sessions. For completers, the median time (IQR) to complete all eight CCBT sessions was 15 (13 to 20) weeks. Participants expressed concern about the face validity of the Beck Depression Inventory II for the measurement of self-reported depression in people with MS. The MSIS-29 was the patient-reported outcome measure which participants felt best reflected their concerns. The estimated sample size for a full trial is between 180 and 390 participants. NHS partners were not delivering CCBT in community facilities and participants preferred to access CCBT at home, with no one expressing a preference for use of CCBT in an alternative location.

Conclusions

A definitive trial, with a recruitment window of one year, would require the participation of around 13 MS centres. This number of centres could be reduced by expanding the eligibility criteria to include either other neurological conditions or people with more severe depression. The MSIS-29 should be used as a patient-important outcome measurement.

Trial registration

ISRCTN: ISRCTN81846800

Management of slipped capital femoral epiphysis: results of a survey of the members of the European Paediatric Orthopaedic Society

AIM

To determine current practice recommendations for the treatment of slipped capital femoral epiphysis (SCFE) among members of the European Paediatric Orthopaedic Society (EPOS).

MATERIALS AND METHODS

A questionnaire with 4 case vignettes of a 12-year-old boy presenting with a stable and unstable SCFE. Each, stable and unstable slips, was of mild (20° epiphyseal-shaft angle) and of severe (60° epiphyseal-shaft angle) degree was sent to all members of EPOS in 2009 in order to ascertain their views on the best management of SCFE. Specifically, respondents were asked about the role of reduction, methods of fixation, prophylactic fixation of the non-affected hip, postoperative management and their view on the anticipated need for secondary surgery.

RESULTS

The response rate was 25% (72/287). The participating surgeons' average workload was 76% in paediatric orthopaedics, with mean 16 years of experience. Surgeons were most consistent in their advice for stable slips, where around 90% of the respondents did not recommend a reduction of the slip regardless of severity of slip. Seventy per cent of the respondents recommended the use of only one screw for fixation of a stable slip and for mild unstable slips. For severe unstable slips, 46% of surgeons recommended reduction only by positioning of the hip on the fracture table, 35% by manipulation and 11% advised open reduction. Responders were less consistent in their advice on the anticipated need for secondary osteotomies (in mild slips about 40% and about 60% in severe slips would advise an osteotomy) and on treatment of the contralateral hip (with 32% of surgeons recommending prophylactic fixation of the contralateral hip).

CONCLUSION

Within members of EPOS, there is controversy on several aspects of the management of SCFE particularly on aspects of the treatment of unstable SCFE.

SIGNIFICANCE

Members of EPOS predominantly use traditional means of treatment for patients with SCFE. In contrast, the more modern treatment concepts, such as open reduction via surgical dislocation, are rarely used.

Pharmacists' attitudes towards an evidence-based approach for over-the-counter medication

BACKGROUND

With increasing deregulation of prescription-only medicines and drive for self-care, pharmacists have greater scope to manage more conditions. This brings added responsibility to be competent healthcare professionals who deliver high quality evidence-based patient care.

OBJECTIVE

This study sought to establish pharmacists' attitudes towards an evidence based approach for over-the-counter medication.

SETTING

Pharmacists working in community pharmacies across Northern Ireland.

METHOD

Following ethical approval, a pre-piloted, self-completed questionnaire was distributed to all community pharmacies in Northern Ireland (n = 529) in September 2008. The development of the questionnaire was largely informed by the findings of a previous qualitative study. It consisted of six sections (mainly closed questions) covering factors that influence decisions regarding over-the-counter medication, recently deregulated prescription-only medicines, medications that lack evidence of effectiveness, knowledge of evidence-based practice, evidence-based practice with over-the-counter medication and demographic information. On receipt of questionnaires, responses to the closed questions were imported into SPSS(®) (version 17.0) for analysis which largely took the form of descriptive statistics. Chi-square and the Mann-Whitney U test were used for association between responses and demographic information with an a priori level of less than 0.05 (P < 0.05) set as significant.

MAIN OUTCOME MEASURE

Pharmacists' attitudes and opinions in relation to decision making about over-the-counter medication and evidence of effectiveness were measured.

RESULTS

A 39.5% (209/529) response rate was achieved. Most pharmacists [191/208 (91.8%)] 'strongly agreed' or 'agreed' that safety was the over-riding concern when dealing with over-the-counter medication. While 88.3% (181/205) 'strongly agreed' or 'agreed' that they were familiar with the concept of evidence-based practice, only 38.0% (78/205) 'strongly agreed' or 'agreed' they knew how to critically appraise research papers. Furthermore, less than a quarter [49/205 (23.9%)] appeared to be familiar with the work of the Cochrane Collaboration. Most [188/207 (90.8%)] 'strongly agreed' or 'agreed' that regardless of evidence of effectiveness, cough medicines were an important management option.

CONCLUSION

Safety was the primary concern when making decisions about over-the counter medicines. Pharmacists lacked knowledge of evidence-based practice and considered medicines which lacked evidence of effectiveness to have an important role in self-care. These factors present barriers to the widespread implementation of evidence-based practice.

Impact of length or relevance of questionnaires on attrition in online trials: randomized controlled trial

BACKGROUND

There has been limited study of factors influencing response rates and attrition in online research. Online experiments were nested within the pilot (study 1, n = 3780) and main trial (study 2, n = 2667) phases of an evaluation of a Web-based intervention for hazardous drinkers: the Down Your Drink randomized controlled trial (DYD-RCT).

OBJECTIVES

The objective was to determine whether differences in the length and relevance of questionnaires can impact upon loss to follow-up in online trials.

METHODS

A randomized controlled trial design was used. All participants who consented to enter DYD-RCT and completed the primary outcome questionnaires were randomized to complete one of four secondary outcome questionnaires at baseline and at follow-up. These questionnaires varied in length (additional 23 or 34 versus 10 items) and relevance (alcohol problems versus mental health). The outcome measure was the proportion of participants who completed follow-up at each of two follow-up intervals: study 1 after 1 and 3 months and study 2 after 3 and 12 months.

RESULTS

At all four follow-up intervals there were no significant effects of additional questionnaire length on follow-up. Randomization to the less relevant questionnaire resulted in significantly lower rates of follow-up in two of the four assessments made (absolute difference of 4%, 95% confidence interval [CI] 0%-8%, in both study 1 after 1 month and in study 2 after 12 months). A post hoc pooled analysis across all four follow-up intervals found this effect of marginal statistical significance (unadjusted difference, 3%, range 1%-5%, P = .01; difference adjusted for prespecified covariates, 3%, range 0%-5%, P = .05).

CONCLUSIONS

Apparently minor differences in study design decisions may have a measurable impact on attrition in trials. Further investigation is warranted of the impact of the relevance of outcome measures on follow-up rates and, more broadly, of the consequences of what we ask participants to do when we invite them to take part in research studies.

TRIAL REGISTRATION

ISRCTN Register 31070347; http://www.controlled-trials.com/ISRCTN31070347/31070347 Archived by WebCite at (http://www.webcitation.org/62cpeyYaY).

Predicting complete loss to follow-up after a health-education program: number of absences and face-to-face contact with a researcher

Background

Research on health-education programs requires longitudinal data. Loss to follow-up can lead to imprecision and bias, and complete loss to follow-up is particularly damaging. If that loss is predictable, then efforts to prevent it can be focused on those program participants who are at the highest risk. We identified predictors of complete loss to follow-up in a longitudinal cohort study.

Methods

Data were collected over 1 year in a study of adults with chronic illnesses who were in a program to learn self-management skills. Following baseline measurements, the program had one group-discussion session each week for six weeks. Follow-up questionnaires were sent 3, 6, and 12 months after the baseline measurement. A person was classified as completely lost to follow-up if none of those three follow-up questionnaires had been returned by two months after the last one was sent.

We tested two hypotheses: that complete loss to follow-up was directly associated with the number of absences from the program sessions, and that it was less common among people who had had face-to-face contact with one of the researchers. We also tested predictors of data loss identified previously and examined associations with specific diagnoses.

Using the unpaired t-test, the U test, Fisher's exact test, and logistic regression, we identified good predictors of complete loss to follow-up.

Results

The prevalence of complete loss to follow-up was 12.2% (50/409). Complete loss to follow-up was directly related to the number of absences (odds ratio; 95% confidence interval: 1.78; 1.49-2.12), and it was inversely related to age (0.97; 0.95-0.99). Complete loss to follow-up was less common among people who had met one of the researchers (0.51; 0.28-0.95) and among those with connective tissue disease (0.29; 0.09-0.98). For the multivariate logistic model the area under the ROC curve was 0.77.

Conclusions

Complete loss to follow-up after this health-education program can be predicted to some extent from data that are easy to collect (age, number of absences, and diagnosis). Also, face-to-face contact with a researcher deserves further study as a way of increasing participation in follow-up, and health-education programs should include it.

Cardiovascular magnetic resonance activity in the United Kingdom: a survey on behalf of the British Society of Cardiovascular Magnetic Resonance

BACKGROUND

The indications, complexity and capabilities of cardiovascular magnetic resonance (CMR) have rapidly expanded. Whether actual service provision and training have developed in parallel is unknown.

METHODS

We undertook a systematic telephone and postal survey of all public hospitals on behalf of the British Society of Cardiovascular Magnetic Resonance to identify all CMR providers within the United Kingdom.

RESULTS

Of the 60 CMR centres identified, 88% responded to a detailed questionnaire. Services are led by cardiologists and radiologists in equal proportion, though the majority of current trainees are cardiologists. The mean number of CMR scans performed annually per centre increased by 44% over two years. This trend was consistent across centres of different scanning volumes. The commonest indication for CMR was assessment of heart failure and cardiomyopathy (39%), followed by coronary artery disease and congenital heart disease. There was striking geographical variation in CMR availability, numbers of scans performed, and distribution of trainees. Centres without on site scanning capability refer very few patients for CMR. Just over half of centres had a formal training programme, and few performed regular audit.

CONCLUSION

The number of CMR scans performed in the UK has increased dramatically in just two years. Trainees are mainly located in large volume centres and enrolled in cardiology as opposed to radiology training programmes.

Medical Test Results Do Not Tell the Whole Story

Children born today with congenital heart disease (CHD) are likely to reach adulthood, even those with complex disease. As survival rates have increased, attention has focused on the longer-term morbidity associated with CHD and its treatment, but this has largely addressed the physical and physiological outcomes rather than psychosocial morbidity and health-related quality of life (QoL). The purpose of this article is to outline the arguments in favor of routine evaluation of health-related QoL, describe how such measurements might be used, and the barriers and challenges associated with the collection of the data. Finally, a strategy is suggested for the routine collection and use of health-related QoL data with children and adolescents with CHD.

Skill based mentored laparoscopy course participation leads to laparoscopic practice expansion and assists in transition to robotic surgery

PURPOSE

Prior studies suggest poor long-term incorporation of laparoscopy into urology practice after a postgraduate course. We evaluated the influence of the American Urological Association Mentored Laparoscopy Course on urologist clinical practice.

MATERIALS AND METHODS

The 2-day Mentored Laparoscopy Course includes lectures, standardized dry laboratory training with videotape analysis and a porcine laboratory with consistent mentors. Surveys to assess the impact of the course were sent in April 2010 to the 153 urologists who had taken the course from 2004 through 2009.

RESULTS

Of the 153 surveys 91 (60%) were returned a mean of 34.5 months after completing the course. Of the respondents 82% were in a group private practice, followed by solo private practice (15%) and full-time academic practice (3%). Of the respondents 92% reported that they had sutured laparoscopically, 52% had sutured a bleeding vessel and 51% had performed reconstructive laparoscopy since taking the course. Of the respondents 77% reported that their laparoscopic practice had expanded since taking the course (mean 2.9 cases monthly). Of the 41 respondents (45%) who now performed robotic surgery (mean 3.8 cases monthly) 39 (95%) thought that the course experience had helped with the transition into robotic surgery. Overall survey respondents were pleased with the experience during the course with 89 of 91 (98%) stating that they would recommend the course to a colleague.

CONCLUSIONS

Long-term results reveal that the American Urological Association Mentored Laparoscopy Course attendees reported expansion in their laparoscopic practice since taking the course. They described the course as benefiting the transition to robotic surgery.

Two controlled trials to increase participant retention in a randomized controlled trial of mobile phone-based smoking cessation support in the United Kingdom

BACKGROUND

Loss to follow-up of trial participants represents a threat to research validity. To date, interventions designed to increase participants' awareness of benefits to society of completing follow-up, and the impact of a telephone call from a senior female clinician and researcher requesting follow-up have not been evaluated robustly.

PURPOSE

Trial 1 aimed to evaluate the effect on trial follow-up of written information regarding the benefits of participation to society. Trial 2 aimed to evaluate the effect on trial follow-up of a telephone call from a senior female clinician and researcher.

METHODS

Two single-blind randomized controlled trials were nested within a larger trial, Txt2stop. In Trial 1, participants were allocated using minimization to receive a refrigerator magnet and a text message emphasizing the benefits to society of completing follow-up, or to a control group receiving a simple reminder regarding follow-up. In Trial 2, participants were randomly allocated to receive a telephone call from a senior female clinician and researcher, or to a control group receiving standard Txt2stop follow-up procedures.

RESULTS

Trial 1: 33.5% (327 of 976) of the intervention group and 33.8% (329 of 974) of the control group returned the questionnaire within 26 weeks of randomization, risk ratio (RR) 0.99; 95% confidence interval (CI) 0.88-1.12. In all, 83.3% (813 of 976) of the intervention group and 82.2% (801 of/974) of the control group sent back the questionnaire within 30 weeks of randomization, RR 1.01; 95% CI 0.97, 1.05. Trial 2: 31% (20 of 65) of the intervention group and 32% (20 of 62) of the control group completed trial follow-up, RR 0.93; 95%CI 0.44, 1.98.

CONCLUSIONS

In presence of other methods to increase follow-up neither experimental method (refrigerator magnet and text message emphasizing participation's benefits to society nor a telephone call from study's principal investigator) increased participant follow-up in the Txt2stop trial.

A randomised trial and economic evaluation of the effect of response mode on response rate, response bias, and item non-response in a survey of doctors

BACKGROUND

Surveys of doctors are an important data collection method in health services research. Ways to improve response rates, minimise survey response bias and item non-response, within a given budget, have not previously been addressed in the same study. The aim of this paper is to compare the effects and costs of three different modes of survey administration in a national survey of doctors.

METHODS

A stratified random sample of 4.9% (2,702/54,160) of doctors undertaking clinical practice was drawn from a national directory of all doctors in Australia. Stratification was by four doctor types: general practitioners, specialists, specialists-in-training, and hospital non-specialists, and by six rural/remote categories. A three-arm parallel trial design with equal randomisation across arms was used. Doctors were randomly allocated to: online questionnaire (902); simultaneous mixed mode (a paper questionnaire and login details sent together) (900); or, sequential mixed mode (online followed by a paper questionnaire with the reminder) (900). Analysis was by intention to treat, as within each primary mode, doctors could choose either paper or online. Primary outcome measures were response rate, survey response bias, item non-response, and cost.

RESULTS

The online mode had a response rate 12.95%, followed by the simultaneous mixed mode with 19.7%, and the sequential mixed mode with 20.7%. After adjusting for observed differences between the groups, the online mode had a 7 percentage point lower response rate compared to the simultaneous mixed mode, and a 7.7 percentage point lower response rate compared to sequential mixed mode. The difference in response rate between the sequential and simultaneous modes was not statistically significant. Both mixed modes showed evidence of response bias, whilst the characteristics of online respondents were similar to the population. However, the online mode had a higher rate of item non-response compared to both mixed modes. The total cost of the online survey was 38% lower than simultaneous mixed mode and 22% lower than sequential mixed mode. The cost of the sequential mixed mode was 14% lower than simultaneous mixed mode. Compared to the online mode, the sequential mixed mode was the most cost-effective, although exhibiting some evidence of response bias.

CONCLUSIONS

Decisions on which survey mode to use depend on response rates, response bias, item non-response and costs. The sequential mixed mode appears to be the most cost-effective mode of survey administration for surveys of the population of doctors, if one is prepared to accept a degree of response bias. Online surveys are not yet suitable to be used exclusively for surveys of the doctor population.

A randomised trial and economic evaluation of the effect of response mode on response rate, response bias, and item non-response in a survey of doctors

BACKGROUND

Surveys of doctors are an important data collection method in health services research. Ways to improve response rates, minimise survey response bias and item non-response, within a given budget, have not previously been addressed in the same study. The aim of this paper is to compare the effects and costs of three different modes of survey administration in a national survey of doctors.

METHODS

A stratified random sample of 4.9% (2,702/54,160) of doctors undertaking clinical practice was drawn from a national directory of all doctors in Australia. Stratification was by four doctor types: general practitioners, specialists, specialists-in-training, and hospital non-specialists, and by six rural/remote categories. A three-arm parallel trial design with equal randomisation across arms was used. Doctors were randomly allocated to: online questionnaire (902); simultaneous mixed mode (a paper questionnaire and login details sent together) (900); or, sequential mixed mode (online followed by a paper questionnaire with the reminder) (900). Analysis was by intention to treat, as within each primary mode, doctors could choose either paper or online. Primary outcome measures were response rate, survey response bias, item non-response, and cost.

RESULTS

The online mode had a response rate 12.95%, followed by the simultaneous mixed mode with 19.7%, and the sequential mixed mode with 20.7%. After adjusting for observed differences between the groups, the online mode had a 7 percentage point lower response rate compared to the simultaneous mixed mode, and a 7.7 percentage point lower response rate compared to sequential mixed mode. The difference in response rate between the sequential and simultaneous modes was not statistically significant. Both mixed modes showed evidence of response bias, whilst the characteristics of online respondents were similar to the population. However, the online mode had a higher rate of item non-response compared to both mixed modes. The total cost of the online survey was 38% lower than simultaneous mixed mode and 22% lower than sequential mixed mode. The cost of the sequential mixed mode was 14% lower than simultaneous mixed mode. Compared to the online mode, the sequential mixed mode was the most cost-effective, although exhibiting some evidence of response bias.

CONCLUSIONS

Decisions on which survey mode to use depend on response rates, response bias, item non-response and costs. The sequential mixed mode appears to be the most cost-effective mode of survey administration for surveys of the population of doctors, if one is prepared to accept a degree of response bias. Online surveys are not yet suitable to be used exclusively for surveys of the doctor population.

A randomised trial and economic evaluation of the effect of response mode on response rate, response bias, and item non-response in a survey of doctors

BACKGROUND

Surveys of doctors are an important data collection method in health services research. Ways to improve response rates, minimise survey response bias and item non-response, within a given budget, have not previously been addressed in the same study. The aim of this paper is to compare the effects and costs of three different modes of survey administration in a national survey of doctors.

METHODS

A stratified random sample of 4.9% (2,702/54,160) of doctors undertaking clinical practice was drawn from a national directory of all doctors in Australia. Stratification was by four doctor types: general practitioners, specialists, specialists-in-training, and hospital non-specialists, and by six rural/remote categories. A three-arm parallel trial design with equal randomisation across arms was used. Doctors were randomly allocated to: online questionnaire (902); simultaneous mixed mode (a paper questionnaire and login details sent together) (900); or, sequential mixed mode (online followed by a paper questionnaire with the reminder) (900). Analysis was by intention to treat, as within each primary mode, doctors could choose either paper or online. Primary outcome measures were response rate, survey response bias, item non-response, and cost.

RESULTS

The online mode had a response rate 12.95%, followed by the simultaneous mixed mode with 19.7%, and the sequential mixed mode with 20.7%. After adjusting for observed differences between the groups, the online mode had a 7 percentage point lower response rate compared to the simultaneous mixed mode, and a 7.7 percentage point lower response rate compared to sequential mixed mode. The difference in response rate between the sequential and simultaneous modes was not statistically significant. Both mixed modes showed evidence of response bias, whilst the characteristics of online respondents were similar to the population. However, the online mode had a higher rate of item non-response compared to both mixed modes. The total cost of the online survey was 38% lower than simultaneous mixed mode and 22% lower than sequential mixed mode. The cost of the sequential mixed mode was 14% lower than simultaneous mixed mode. Compared to the online mode, the sequential mixed mode was the most cost-effective, although exhibiting some evidence of response bias.

CONCLUSIONS

Decisions on which survey mode to use depend on response rates, response bias, item non-response and costs. The sequential mixed mode appears to be the most cost-effective mode of survey administration for surveys of the population of doctors, if one is prepared to accept a degree of response bias. Online surveys are not yet suitable to be used exclusively for surveys of the doctor population.

A clinical decision support needs assessment of community-based physicians

OBJECTIVE

To conduct a grounded needs assessment to elicit community-based physicians' current views on clinical decision support (CDS) and its desired capabilities that may assist future CDS design and development for community-based practices.

MATERIALS AND METHODS

To gain insight into community-based physicians' goals, environments, tasks, and desired support tools, we used a human-computer interaction model that was based in grounded theory. We conducted 30 recorded interviews with, and 25 observations of, primary care providers within 15 urban and rural community-based clinics across Oregon. Participants were members of three healthcare organizations with different commercial electronic health record systems. We used a grounded theory approach to analyze data and develop a user-centered definition of CDS and themes related to desired CDS functionalities.

RESULTS

Physicians viewed CDS as a set of software tools that provide alerts, prompts, and reference tools, but not tools to support patient management, clinical operations, or workflow, which they would like. They want CDS to enhance physician-patient relationships, redirect work among staff, and provide time-saving tools. Participants were generally dissatisfied with current CDS capabilities and overall electronic health record usability.

DISCUSSION

Physicians identified different aspects of decision-making in need of support: clinical decision-making such as medication administration and treatment, and cognitive decision-making that enhances relationships and interactions with patients and staff.

CONCLUSION

Physicians expressed a need for decision support that extended beyond their own current definitions. To meet this requirement, decision support tools must integrate functions that align time and resources in ways that assist providers in a broad range of decisions.

Elective surgical referral guidelines--background educational material or essential shared decision making tool? A survey of GPs' in England

Background

To investigate general practitioners' (GPs') attitudes to guidelines for elective surgical referral in England. To understand their use of guidelines, and attitudes to shared decision making in the referral decision.

Methods

A questionnaire was developed which investigated attitudes to and use of guidelines. It was given to a stratified random sample 30% (n = 310) drawn from GP lists of 10 English health districts (primary care trusts (PCTs)). GPs were invited to respond online, by telephone, fax or post. Data were analysed using descriptive statistics and backwards stepwise logistic regression.

Results

Responses were representative of GPs in England, but (despite up to 6 contacts per non-responder) the overall response rate was 41.6% (n = 129; with the range across PCTs of 25-61%). Most responding GPs indicated support for referral guidelines but 18% reported that they had never used them. Less than three per cent reported use for most or all referral decisions. The odds of using guidelines decreased with increasing age, with a ten year increase in age associated with halving odds of use (OR = 0.53, 95%CI = 0.29-0.90). Over 50% of GPs wanted good access to electronic guidelines with expert information and advice on guideline availability. Almost all (>89%) GPs agreed with sharing referral decisions with patients. Female doctors (OR = 5.2, 95%CI: 1.02-26.3) were more likely to agree with this than male GPs as were those working in larger compared to small or single handed practices (OR = 5.3, 95%CI: 1.4-19.9).

Conclusions

This group of responding GPs was supportive of guidelines but used them in different ways. Referral guidelines should have an educational component for background reading; include key messages for internalisation and application; and incorporate mechanisms to facilitate accessibility and appropriate shared decision making with patients.

Telephone interviews can be used to collect follow-up data subsequent to no response to postal questionnaires in clinical trials

OBJECTIVE

Follow-up data were collected using postal questionnaires and if participants did not respond, then data was collected using telephone interviews. The objectives of this study were to examine, for the two methods, how respondents differed in characteristics and whether the observed treatment difference varied.

STUDY DESIGN AND SETTING

A large clinical trial of lower back pain.

RESULTS

About 60% (98/163) of the nonresponders to postal questionnaire provided data by telephone, which increased the overall response rate by 14% (from 71% to 85%). A consistent treatment difference was found across the methods for the outcome measures at 12 months, implying that the observed treatment effect had not been modified. There were some differences between the participants: responders of postal questionnaire were older, likely to be female, white (ethnic origin), not working, with less disability of back pain, compared with those who responded by a telephone interview. At 12 months, there was greater improvement in back pain, disability, and general health for those who responded by postal questionnaires.

CONCLUSION

Researchers should consider the use of more than one method of collecting data as this increases response rate, participant representativeness, and enhances precision of effect estimates.

Numbering questionnaires had no impact on the response rate and only a slight influence on the response content of a patient safety culture survey: a randomized trial

OBJECTIVES

In self-completed surveys, anonymous questionnaires are sometimes numbered so as to avoid sending reminders to initial nonrespondents. This number may be perceived as a threat to confidentiality by some respondents, which may reduce the response rate, or cause social desirability bias. In this study, we evaluated whether using nonnumbered vs. numbered questionnaires influenced the response rate and the response content.

STUDY DESIGN AND SETTING

During a patient safety culture survey, we randomized participants into two groups: one received an anonymous nonnumbered questionnaire and the other a numbered questionnaire. We compared the survey response rates and distributions of the responses for the 42-questionnaire items across the two groups.

RESULTS

Response rates were similar in the two groups (nonnumbered, 75.2%; numbered, 72.8%; difference, 2.4%; P=0.28). Five of the 42 questions had statistically significant differences in distributions, but these differences were small. Unexpectedly, in all five instances, the patient safety culture ratings were more favorable in the nonnumbered group.

CONCLUSION

Numbering of mailed questionnaires had no impact on the response rate. Numbering influenced significantly the response content of several items, but these differences were small and ran against the hypothesis of social desirability bias.

Practical strategies to circumvent and/or surmount six barriers in health disparities research: observations from a pilot project among Vietnamese Americans

This paper describes six practical strategies to circumvent and/or surmount barriers encountered in community-based health disparities research, as illustrated within a pilot study on Vietnamese Americans' perceptions of the US healthcare system. Health issues, including higher rates of cancer in this group, prompted the current study. These six strategies include the following: (1) identify a population with health concerns, (2) establish the role of the community partner early, (3) recruit an investigator who understands not only the language and culture but also the research process, (4) accept the exploratory nature of a study in an understudied group, (5) put in place the groundwork for recontacting community members, and 6) assemble a motivated research team. The descriptive experience reported here might enable other investigators to undertake and complete work in the field of health disparities in minority groups.

Methods used for successful follow-up in a large scale national cohort study in Thailand

Background

Ensuring successful follow-up is essential when conducting a prospective cohort study. Most existing literature reviewing methods to ensure a high response rate is based on experience in developed nations.

Findings

We report our 4-year follow-up success for a national cohort study examining the health transition underway in Thailand. We began the cohort study in 2005 with a baseline postal questionnaire sent to all 200,000 Thais enrolled as distance learning students at Sukhothai Thammathirat Open University and residing all over Thailand; 87,134 or 44% of the students responded. Subsequently we used University and national media to inform cohort members of study progress. Also, we prepared a health book with study results and health advice which was distributed to all cohort members. After 4 years we repeated the survey and achieved a 71% response rate. In this paper we report the methods used to achieve this response

The initial follow-up mail-out generated a response rate of about 48% reflecting the extensive preparatory work between baseline and follow-up. After 4 rounds of telephone contact (more than 100,000 phone calls) and 4 related mail-out rounds progressively over 16 months an overall response rate was achieved of just over 71% (n = 60,774). The total cost was US$4.06/respondent - 19% for printing, 21% for postage, 14% for tape measures (included in mail-out), 18% for data processing 22% for prizes and 6% for telephone.

Conclusions

Many of the methods reported as effective for mail questionnaire and cohort response rates held true for Thailand. These included being associated with a university, incentivating cooperation, follow-up contact, providing a second copy of questionnaire where necessary, and assurance of confidentiality. Telephone contact with the cohort and the small prizes given to responders were particularly important in the Thai context as was Thai leadership of the research team.

Attitudinal and demographic predictors of measles-mumps-rubella vaccine (MMR) uptake during the UK catch-up campaign 2008-09: cross-sectional survey

Background and Objective

Continued suboptimal measles-mumps-rubella (MMR) vaccine uptake has re-established measles epidemic risk, prompting a UK catch-up campaign in 2008–09 for children who missed MMR doses at scheduled age. Predictors of vaccine uptake during catch-ups are poorly understood, however evidence from routine schedule uptake suggests demographics and attitudes may be central. This work explored this hypothesis using a robust evidence-based measure.

Design

Cross-sectional self-administered questionnaire with objective behavioural outcome.

Setting and Participants

365 UK parents, whose children were aged 5–18 years and had received <2 MMR doses before the 2008–09 UK catch-up started.

Main Outcome Measures

Parents' attitudes and demographics, parent-reported receipt of invitation to receive catch-up MMR dose(s), and catch-up MMR uptake according to child's medical record (receipt of MMR doses during year 1 of the catch-up).

Results

Perceived social desirability/benefit of MMR uptake (OR = 1.76, 95% CI = 1.09–2.87) and younger child age (OR = 0.78, 95% CI = 0.68–0.89) were the only independent predictors of catch-up MMR uptake in the sample overall. Uptake predictors differed by whether the child had received 0 MMR doses or 1 MMR dose before the catch-up. Receipt of catch-up invitation predicted uptake only in the 0 dose group (OR = 3.45, 95% CI = 1.18–10.05), whilst perceived social desirability/benefit of MMR uptake predicted uptake only in the 1 dose group (OR = 9.61, 95% CI = 2.57–35.97). Attitudes and demographics explained only 28% of MMR uptake in the 0 dose group compared with 61% in the 1 dose group.

Conclusions

Catch-up MMR invitations may effectively move children from 0 to 1 MMR doses (unimmunised to partially immunised), whilst attitudinal interventions highlighting social benefits of MMR may effectively move children from 1 to 2 MMR doses (partially to fully immunised). Older children may be best targeted through school-based programmes. A formal evaluation element should be incorporated into future catch-up campaigns to inform their continuing improvement.

A systematic review of the effect of retention methods in population-based cohort studies

Background

Longitudinal studies are of aetiological and public health relevance but can be undermined by attrition. The aim of this paper was to identify effective retention strategies to increase participation in population-based cohort studies.

Methods

Systematic review of the literature to identify prospective population-based cohort studies with health outcomes in which retention strategies had been evaluated.

Results

Twenty-eight studies published up to January 2011 were included. Eleven of which were randomized controlled trials of retention strategies (RCT). Fifty-seven percent of the studies were postal, 21% in-person, 14% telephone and 7% had mixed data collection methods. A total of 45 different retention strategies were used, categorised as 1) incentives, 2) reminder methods, repeat visits or repeat questionnaires, alternative modes of data collection or 3) other methods. Incentives were associated with an increase in retention rates, which improved with greater incentive value. Whether cash was the most effective incentive was not clear from studies that compared cash and gifts of similar value. The average increase in retention rate was 12% for reminder letters, 5% for reminder calls and 12% for repeat questionnaires. Ten studies used alternative data collection methods, mainly as a last resort. All postal studies offered telephone interviews to non-responders, which increased retention rates by 3%. Studies that used face-to-face interviews increased their retention rates by 24% by offering alternative locations and modes of data collection.

Conclusions

Incentives boosted retention rates in prospective cohort studies. Other methods appeared to have a beneficial effect but there was a general lack of a systematic approach to their evaluation.

Adhesion awareness: a national survey of surgeons

Background

Postoperative adhesions are the most frequent complication of abdominal surgery, leading to high morbidity, mortality, and costs. However, the problem seems to be neglected by surgeons for largely unknown reasons.

Methods

A survey assessing knowledge and personal opinion about the extent and impact of adhesions was sent to all Dutch surgeons and surgical trainees. The informed-consent process and application of antiadhesive agents were questioned in addition.

Results

The response rate was 34.4%. Two thirds of all respondents (67.7%) agreed that adhesions exert a clinically relevant, negative effect. A negative perception of adhesions correlated with a positive attitude regarding adhesion prevention (ρ = 0.182, p < 0.001). However, underestimation of the extent and impact of adhesions resulted in low knowledge scores (mean test score 37.6%). Lower scores correlated with more uncertainty about indications for antiadhesive agents which, in turn, correlated with never having used any of these agents (ρ = 0.140, p = 0.002; ρ = 0.095, p = 0.035; respectively). Four in 10 respondents (40.9%) indicated that they never inform patients on adhesions and only 9.8% informed patients routinely. A majority of surgeons (55.9%) used antiadhesive agents in the past, but only a minority (13.4%) did in the previous year. Of trainees, 82.1% foresaw an increase in the use of antiadhesive agents compared to 64.5% of surgeons (p < 0.001).

Conclusions

The magnitude of the problem of postoperative adhesions is underestimated and informed consent is provided inadequately by Dutch surgeons. Exerting adhesion prevention is related to the perception of and knowledge about adhesions.

Effect of reminders on mitigating participation bias in a case-control study

Background

Researchers commonly employ strategies to increase participation in health studies. These include use of incentives and intensive reminders. There is, however, little evidence regarding the quantitative effect that such strategies have on study results. We present an analysis of data from a case-control study of Campylobacter enteritis in England to assess the usefulness of a two-reminder strategy for control recruitment.

Methods

We compared sociodemographic characteristics of participants and non-participants, and calculated odds ratio estimates for a wide range of risk factors by mailing wave.

Results

Non-participants were more often male, younger and from more deprived areas. Among participants, early responders were more likely to be female, older and live in less deprived areas, but despite these differences, we found little evidence of a systematic bias in the results when using data from early reponders only.

Conclusions

We conclude that the main benefit of using reminders in our study was the gain in statistical power from a larger sample size.

Developing and evaluating interventions to reduce inappropriate prescribing by general practitioners of antibiotics for upper respiratory tract infections: a randomised controlled trial to compare paper-based and web-based modelling experiments

BACKGROUND

Much implementation research is focused on full-scale trials with little evidence of preceding modelling work. The Medical Research Council Framework for developing and evaluating complex interventions has argued for more and better theoretical and exploratory work prior to a trial as a means of improving intervention development. Intervention modelling experiments (IMEs) are a way of exploring and refining an intervention before moving to a full-scale trial. They do this by delivering key elements of the intervention in a simulation that approximates clinical practice by, for example, presenting general practitioners (GPs) with a clinical scenario about making a treatment decision.

METHODS

The current proposal will run a full, web-based IME involving 250 GPs that will advance the methodology of IMEs by directly comparing results with an earlier paper-based IME. Moreover, the web-based IME will evaluate an intervention that can be put into a full-scale trial that aims to reduce antibiotic prescribing for upper respiratory tract infections in primary care. The study will also include a trial of email versus postal invitations to participate.

DISCUSSION

More effective behaviour change interventions are needed and this study will develop one such intervention and a system to model and test future interventions. This system will be applicable to any situation in the National Health Service where behaviour needs to be modified, including interventions aimed directly at the public.

TRIAL REGISTRATION

ClinicalTrials (NCT): NCT01206738.

Impact and costs of incentives to reduce attrition in online trials: two randomized controlled trials

Background

Attrition from follow-up is a major methodological challenge in randomized trials. Incentives are known to improve response rates in cross-sectional postal and online surveys, yet few studies have investigated whether they can reduce attrition from follow-up in online trials, which are particularly vulnerable to low follow-up rates.

Objectives

Our objective was to determine the impact of incentives on follow-up rates in an online trial.

Methods

Two randomized controlled trials were embedded in a large online trial of a Web-based intervention to reduce alcohol consumption (the Down Your Drink randomized controlled trial, DYD-RCT). Participants were those in the DYD pilot trial eligible for 3-month follow-up (study 1) and those eligible for 12-month follow-up in the DYD main trial (study 2). Participants in both studies were randomly allocated to receive an offer of an incentive or to receive no offer of an incentive. In study 1, participants in the incentive arm were randomly offered a £5 Amazon.co.uk gift voucher, a £5 charity donation to Cancer Research UK, or entry in a prize draw for £250. In study 2, participants in the incentive arm were offered a £10 Amazon.co.uk gift voucher. The primary outcome was the proportion of participants who completed follow-up questionnaires in the incentive arm(s) compared with the no incentive arm.

Results

In study 1 (n = 1226), there was no significant difference in response rates between those participants offered an incentive (175/615, 29%) and those with no offer (162/611, 27%) (difference = 2%, 95% confidence interval [CI] –3% to 7%). There was no significant difference in response rates among the three different incentives offered. In study 2 (n = 2591), response rates were 9% higher in the group offered an incentive (476/1296, 37%) than in the group not offered an incentive (364/1295, 28%) (difference = 9%, 95% CI 5% to 12%, P < .001). The incremental cost per extra successful follow-up in the incentive arm was £110 in study 1 and £52 in study 2.

Conclusion

Whereas an offer of a £10 Amazon.co.uk gift voucher can increase follow-up rates in online trials, an offer of a lower incentive may not. The marginal costs involved require careful consideration.

Trial registration

ISRCTN31070347; http://www.controlled-trials.com/ISRCTN31070347 (Archived by WebCite at http://www.webcitation.org/5wgr5pl3s)

The effects of tracking responses and the day of mailing on physician survey response rate: three randomized trials

BACKGROUND

The response rates to physician postal surveys remain modest. The primary objective of this study was to assess the effect of tracking responses on physician survey response rate (i.e., determining whether each potential participant has responded or not). A secondary objective was to assess the effects of day of mailing (Monday vs. Friday) on physician survey response rate.

METHODS

We conducted 3 randomized controlled trials. The first 2 trials had a 2 x 2 factorial design and tested the effect of day of mailing (Monday vs. Friday) and of tracking vs. no tracking responses. The third trial tested the effect of day of mailing (Monday vs. Friday). We meta-analyzed these 3 trials using a random effects model.

RESULTS

The total number of participants in the 3 trials was 1339. The response rate with tracked mailing was not statistically different from that with non-tracked mailing by the time of the first reminder (RR = 1.01 95% CI 0.84, 1.22; I²  =  0%). There was a trend towards lower response rate with tracked mailing by the time of the second reminder (RR = 0.91; 95% CI 0.78, 1.06; I²  =  0%). The response rate with mailing on Mondays was not statistically different from that with Friday mailing by the time of first reminder (RR = 1.01; 95% CI 0.87, 1.17; I²  =  0%), and by the time of the 2(nd) reminder (RR = 1.08; 95% CI 0.84, 1.39; I²  =  77%).

CONCLUSIONS

Tracking response may negatively affect physicians' response rate. The day of mailing does not appear to affect physicians' response rate.

Electronic reminders did not improve postal questionnaire response rates or response times: a randomized controlled trial

OBJECTIVE

We aim to evaluate the effectiveness of electronic reminders (ERs) to improve the response rates and time to response of postal questionnaires in a health research setting.

STUDY DESIGN AND SETTING

This pragmatic randomized controlled trial (RCT) was nested within a multicenter RCT of yoga for lower back pain. Participants who provided an electronic mail address and/or mobile phone number were randomized to receive an ER or no reminder (controls) on the day they were due to receive a follow-up questionnaire.

RESULTS

One hundred twenty-five participants (32 males and 93 females) mean age 46 (standard deviation: 11, range: 20-65) were randomized to ER (n=62) or controls (n=63). Overall 85.6% of participants returned postal questionnaires (87.1% ER group and 84.1% from controls). No significant differences were found between the two groups for response rate (difference between groups=3.0%, 95% confidence interval [CI]=-10, 16; P=0.64) or time to response after adjusting for age, gender, and treatment allocation (χ(2) ([3df])=7.10; P=0.07).

CONCLUSION

In the present RCT, we found little evidence for the effectiveness of ERs to increase response rates or time to respond for the return of questionnaires in this study population group.

"Do I really want to do this?" Longitudinal cohort study participants' perspectives on postal survey design: a qualitative study

Background

Randomised controlled trials have investigated aspects of postal survey design yet cannot elaborate on reasons behind participants' decision making and survey behaviour. This paper reports participants' perspectives of the design of, and participation in, a longitudinal postal cohort survey. It describes strengths and weaknesses in study design from the perspectives of study participants and aims to contribute to the: 1) design of future cohort surveys and questionnaires generally and, 2) design of cohort surveys for people with musculoskeletal disorders (MSDs) specifically.

Methods

In-depth interviews explored the design of postal surveys previously completed by participants. Interviews used open ended questioning with a topic guide for prompts if areas of interest were not covered spontaneously. Thematic data analysis was undertaken based on the framework method. A second researcher verified all coding.

Results

Data from fourteen interviews were analysed within three main themes; participation, survey design and survey content. One of the main findings was the importance of clear communication aimed at the correct audience both when inviting potential participants to take part and within the survey itself. Providing enough information about the study, having a topic of interest and an explanation of likely benefits of the study were important when inviting people to participate. The neutrality of the survey and origination from a reputable source were both important; as was an explanation about why information was being collected within the survey itself. Study findings included participants' impressions when invited to take part, why they participated, the acceptability of follow-up of non-responders and why participants completed the follow-up postal survey. Also discussed were participants' first impression of the survey, its length, presentation and participants' views about specific questions within the survey.

Conclusions

Ideas generated in this study provide an insight into participants' decision making and survey behaviour and may enhance the acceptability of future surveys to potential participants. As well as clear communication, participants valued incentives and survey questions that were relevant to them. However, opinions varied as to the preferred format for responses with some advising more opportunity for open-ended feedback. We also found that some standard format questions can raise quandaries for individual participants.

Variations in clinical PET/CT operations: results of an international survey of active PET/CT users

This study gathered information about clinical PET/CT operations worldwide to help guide discussions on the use and standardization of clinical PET/CT.

METHODS

A Web-based survey of PET/CT users was initiated in November 2009 through e-mail advertising using Academy of Molecular Imaging databases. Recipients were asked 58 questions related to demographics (e.g., location, number of PET/CT systems, and staffing), PET/CT operations and use, and variations in (18)F-FDG oncology imaging protocols.

RESULTS

The responders were from centers in the Americas (71%), Europe (22%), Asia-Pacific (6%), and Middle East (1%), with most responding sites representing public health care institutions (60%). PET/CT systems were most frequently installed in nuclear medicine departments (59%). Of the sites operating a PET/CT system, 16% had 10 y or more of stand-alone PET experience. About 40% of all sites operated at least 2 PET/CT systems. PET/CT was most frequently used for applications in torso or whole-body oncology (87%), radiation therapy planning (4%), cardiology (4%), and neurology (5%). The average interval of fasting before an (18)F-FDG PET/CT examination was 7 ± 3 h (range, 4-12 h). Blood glucose levels were measured at 99% of sites, but acceptable maximal glucose levels varied substantially (an upper limit of 200 mg/dL was applied at >50% of the institutions). A weight-based radioactivity dose injection was performed at 44% of sites. The mean (18)F-FDG activity injected was 390 MBq (range, 110-585 MBq) for 3-dimensional PET of a 75-kg patient. The mean uptake time was 64 ± 14 min (range, 20-90 min). Split protocols involving patient repositioning and adapted imaging parameters were used at 51% of sites. Only 41% used patient positioning aids. Intravenous or oral CT contrast material was used at 52% of sites in up to 25% of patients. Most sites (90%) measured maximum standardized uptake value as an index of tissue glucose use. Only 62% of sites provided a fully integrated PET/CT report.

CONCLUSION

An international survey among clinical PET/CT users revealed significant variations in standard (18)F-FDG PET/CT protocols. This finding illustrates the need for continuous training and ongoing standardization in an effort to optimize PET/CT in oncology.

Nonresponse Error in Mail Surveys: Top Ten Problems

Conducting mail surveys can result in nonresponse error, which occurs when the potential participant is unwilling to participate or impossible to contact. Nonresponse can result in a reduction in precision of the study and may bias results. The purpose of this paper is to describe and make readers aware of a top ten list of mailed survey problems affecting the response rate encountered over time with different research projects, while utilizing the Dillman Total Design Method. Ten nonresponse error problems were identified, such as inserter machine gets sequence out of order, capitalization in databases, and mailing discarded by postal service. These ten mishaps can potentiate nonresponse errors, but there are ways to minimize their frequency. Suggestions offered stem from our own experiences during research projects. Our goal is to increase researchers' knowledge of nonresponse error problems and to offer solutions which can decrease nonresponse error in future projects.

Evaluating a County-Sponsored Social Marketing Campaign to Increase Mothers' Initiation of HPV Vaccine for their Pre-teen Daughters in a Primarily Rural Area

Routine vaccination against human papillomavirus (HPV), the main cause of cervical cancer, is recommended for 11-12 year old girls, yet vaccine uptake is low. This study evaluates a social marketing campaign initiated by 13 North Carolina counties to raise awareness among parents and reduce barriers to accessing the vaccine in a primarily rural area. The 3-month campaign targeted mothers of girls ages 11-12 and healthcare practices serving pre-teen girls in four counties. Principles of social marketing were: product (recommended vaccine against HPV), price (cost, perception of safety and efficacy, and access), promotion (posters, brochures, website, news releases, doctor's recommendation), and place (doctors' offices, retail outlets). We analyzed (1) website traffic, hotline calls, and media placement; (2) cross-sectional surveys of mothers and providers; and (3) HPV immunization rates in intervention versus non-intervention counties. Of respondent mothers (n=225), 82% heard or saw campaign messages or materials. Of respondent providers (n=35), 94% used campaign brochures regularly or occasionally in conversations with parents. HPV vaccination rates within six months of campaign launch were 2% higher for 9-13 year old girls in two of the four intervention counties compared to 96 non-intervention counties. This evaluation supports campaign use in other primarily rural and underserved areas.

Development and analysis of D-RECT, an instrument measuring residents' learning climate

BACKGROUND

Measurement of learning climates can serve as an indicator of a department's educational functioning.

AIM

This article describes the development and psychometric qualities of an instrument to measure learning climates in postgraduate specialist training: the Dutch Residency Educational Climate Test (D-RECT).

METHOD

A preliminary questionnaire was evaluated in a modified Delphi procedure. Simultaneously, all residents in the Netherlands were invited to fill out the preliminary questionnaire. We used exploratory factor analysis to analyze the outcomes and construct the definitive D-RECT. Confirmatory factor analysis tested the questionnaire's goodness of fit. Generalizability studies tested the number of residents needed for a reliable outcome.

RESULTS

In two rounds, the Delphi panel reached consensus. In addition, 1278 residents representing 26 specialties completed the questionnaire. The Delphi panel's input in combination with the exploratory factor analysis of 600 completed surveys led to the definitive D-RECT, consisting of 50 items and 11 subscales (e.g., feedback, supervision, patient handover and professional relations between attendings). Confirmatory factor analyses of the remaining surveys confirmed the construct. The results showed that a feasible number of residents is needed for a reliable outcome.

CONCLUSION

D-RECT appears to be a valid, reliable and feasible tool to measure the quality of clinical learning climates.

Differential effects of pre and post-payment on neurologists' response rates to a postal survey

BACKGROUND

Monetary incentives are an effective way of increasing response rates to surveys, though they are generally less effective in physicians, and are more effective when the incentive is paid up-front rather than when made conditional on completion.

METHODS

In this study we examine the effectiveness of pre- and post-completion incentives on the response rates of all the neurologists in the UK to a survey about conversion disorder, using a cluster randomised controlled design. A postal survey was sent to all practicing consultant neurologists, in two rounds, including either a book token, the promise of a book token, or nothing at all.

RESULTS

Three hundred and fifty-one of 591 eligible neurologists completed the survey, for a response rate of 59%. While the post-completion incentive exerted no discernible influence on response rates, a pre-completion incentive did, with an odds-ratio of 2.1 (95% confidence interval 1.5-3.0).

CONCLUSIONS

We conclude that neurologists, in the UK at least, may be influenced to respond to a postal survey by a pre-payment incentive but are unaffected by a promised reward.

The influence of response mode on study results: offering cigarette smokers a choice of postal or online completion of a survey

Background

It is unclear whether offering online data collection to study participants affects compliance or produces bias.

Objective

To compare response rates, baseline characteristics, test-retest reliability, and outcomes between cigarette smokers who chose to complete a survey by mail versus those who chose to complete it online.

Methods

We surveyed cigarette smokers who intended to stop smoking within the next 30 days to determine barriers to calling a smoking quit line. Participants were offered the choice of completing a paper version of the survey sent through the mail or an online version at a password-protected website. Participants were called 2 months later to determine if they had made a quit attempt and/or called a smoking quit line since the baseline survey. We compared characteristics and outcomes among those who chose postal versus online completion. We measured test-retest reliability of the baseline survey by resurveying a semirandom sample of participants within 10 days of the original survey.

Results

Of 697 eligible respondents to newspaper ads in 12 US cities, 438 (63%) chose to receive a mailed paper survey and 259 (37%) chose an Internet survey. Survey return rates were the same for the 2 modes (92% versus 92%, P = .82). Online respondents were younger (mean of 46 versus 51 years old for postal, P < .001), more likely to be white (76% versus 62%, P < .001), less likely to be African American (18% versus 30%, P < .001), more highly educated (34% college graduate versus 23%, P < .001), more likely to intend to stop smoking in the next 30 days (47% definitely versus 30%, P < .001), and more likely to have heard of a smoking quit line (51% versus 40%, P = .008). Participants did not differ on gender (54% female for online versus 55% for postal, P = .72) or cigarettes smoked per day (mean of 19 versus 21, P = .30). Online respondents had slightly fewer missing items on the 79-item survey (mean of 1.7% missing versus 2.3%, P = .02). Loss to follow-up at 2 months was similar (16% for online and 15% for postal, P = .74). There was no significant difference between online and postal respondents in having called a smoking quit line during the 2-month follow-up period (20% versus 24%, P = .22) or in having made a quit attempt (76% versus 79%, P = .41).

Conclusions

Cigarette smokers who chose to complete a survey using the Internet differed in several ways from those who chose mailed surveys. However, more importantly, online and postal responses produced similar outcomes.

Preventing disease through opportunistic, rapid engagement by primary care teams using behaviour change counselling (PRE-EMPT): protocol for a general practice-based cluster randomised trial

Background

Smoking, excessive alcohol consumption, lack of exercise and an unhealthy diet are the key modifiable factors contributing to premature morbidity and mortality in the developed world. Brief interventions in health care consultations can be effective in changing single health behaviours. General Practice holds considerable potential for primary prevention through modifying patients' multiple risk behaviours, but feasible, acceptable and effective interventions are poorly developed, and uptake by practitioners is low. Through a process of theoretical development, modeling and exploratory trials, we have developed an intervention called Behaviour Change Counselling (BCC) derived from Motivational Interviewing (MI). This paper describes the protocol for an evaluation of a training intervention (the Talking Lifestyles Programme) which will enable practitioners to routinely use BCC during consultations for the above four risk behaviours.

Methods/Design

This cluster randomised controlled efficacy trial (RCT) will evaluate the outcomes and costs of this training intervention for General Practitioners (GPs) and nurses. Training methods will include: a practice-based seminar, online self-directed learning, and reflecting on video recorded and simulated consultations. The intervention will be evaluated in 29 practices in Wales, UK; two clinicians will take part (one GP and one nurse) from each practice. In intervention practices both clinicians will receive training. The aim is to recruit 2000 patients into the study with an expected 30% drop out. The primary outcome will be the proportion of patients making changes in one or more of the four behaviours at three months. Results will be compared for patients seeing clinicians trained in BCC with patients seeing non-BCC trained clinicians. Economic and process evaluations will also be conducted.

Discussion

Opportunistic engagement by health professionals potentially represents a cost effective medical intervention. This study integrates an existing, innovative intervention method with an innovative training model to enable clinicians to routinely use BCC, providing them with new tools to encourage and support people to make healthier choices. This trial will evaluate effectiveness in primary care and determine costs of the intervention.

Trial Registration

ISRCTN22495456

Characteristics of accelerometry respondents to a mail-based surveillance study

Background

Differences in the characteristics of respondents and nonrespondents to a survey can be a cause of selection bias. The aim of this study was to determine the sociodemographic and lifestyle characteristics of respondents to a field-based accelerometry survey.

Methods

A cross-sectional mail survey was sent to 4000 adults (50% male; age 20 to 69 years) who were randomly selected from the registries of residential addresses of 4 cities in Japan. There were 1508 respondents (responding subsample) to the initial questionnaire. A total of 786 participants from the responding subsample also agreed to wear an accelerometer for 7 days (accelerometer subsample). Age, sex, and city of residence were compared between the accelerometer subsample and all 3214 nonrespondents, including those who did not respond to the initial questionnaire. In addition, multiple logistic regression analyses were used to compare the sociodemographic and lifestyle characteristics of the accelerometer subsample and the 722 respondents who participated in the questionnaire survey but not the accelerometry (questionnaire-only subsample).

Results

As compared with all nonrespondents, the accelerometer subsample included significantly more women, middle-aged and older adults, and residents of specific cities. Multiple logistic regression analyses comparing the accelerometer and questionnaire-only subsamples revealed that participation in the accelerometry survey was greater among nonsmokers (odds ratio, 1.35; 95% confidence interval, 1.02–1.79) and persons who reported a habit of leisure walking (1.56, 1.21–2.01).

Conclusions

Sex, age, city of residence, smoking status, and leisure walking were associated with participation in accelerometry. This response pattern reveals potential selection bias in mail-based accelerometry studies.