In a randomized trial, outcomes were not affected by intensive follow-up over 1 year

Methods to increase response to postal and electronic questionnaires

BACKGROUND

Self-administered questionnaires are widely used to collect data in epidemiological research, but non-response reduces the effective sample size and can introduce bias. Finding ways to increase response to postal and electronic questionnaires would improve the quality of epidemiological research.

OBJECTIVES

To identify effective strategies to increase response to postal and electronic questionnaires.

SEARCH METHODS

We searched 14 electronic databases up to December 2021 and manually searched the reference lists of relevant trials and reviews. We contacted the authors of all trials or reviews to ask about unpublished trials; where necessary, we also contacted authors to confirm the methods of allocation used and to clarify results presented.

SELECTION CRITERIA

Randomised trials of methods to increase response to postal or electronic questionnaires. We assessed the eligibility of each trial using pre-defined criteria.

DATA COLLECTION AND ANALYSIS

We extracted data on the trial participants, the intervention, the number randomised to intervention and comparison groups and allocation concealment. For each strategy, we estimated pooled odds ratios (OR) and 95% confidence intervals (CI) in a random-effects model. We assessed evidence for selection bias using Egger's weighted regression method and Begg's rank correlation test and funnel plot. We assessed heterogeneity amongst trial odds ratios using a Chi2 test and quantified the degree of inconsistency between trial results using the I2 statistic.

MAIN RESULTS

Postal We found 670 eligible trials that evaluated over 100 different strategies of increasing response to postal questionnaires. We found substantial heterogeneity amongst trial results in half of the strategies. The odds of response almost doubled when: using monetary incentives (odds ratio (OR) 1.86; 95% confidence interval (CI) 1.73 to 1.99; heterogeneity I2 = 85%); using a telephone reminder (OR 1.96; 95% CI 1.03 to 3.74); and when clinical outcome questions were placed last (OR 2.05; 95% CI 1.00 to 4.24). The odds of response increased by about half when: using a shorter questionnaire (OR 1.58; 95% CI 1.40 to 1.78); contacting participants before sending questionnaires (OR 1.36; 95% CI 1.23 to 1.51; I2 = 87%); incentives were given with questionnaires (i.e. unconditional) rather than when given only after participants had returned their questionnaire (i.e. conditional on response) (OR 1.53; 95% CI 1.35 to 1.74); using personalised SMS reminders (OR 1.53; 95% CI 0.97 to 2.42); using a special (recorded) delivery service (OR 1.68; 95% CI 1.36 to 2.08; I2 = 87%); using electronic reminders (OR 1.60; 95% CI 1.10 to 2.33); using intensive follow-up (OR 1.69; 95% CI 0.93 to 3.06); using a more interesting/salient questionnaire (OR 1.73; 95% CI 1.12 to 2.66); and when mentioning an obligation to respond (OR 1.61; 95% CI 1.16 to 2.22). The odds of response also increased with: non-monetary incentives (OR 1.16; 95% CI 1.11 to 1.21; I2 = 80%); a larger monetary incentive (OR 1.24; 95% CI 1.15 to 1.33); a larger non-monetary incentive (OR 1.15; 95% CI 1.00 to 1.33); when a pen was included (OR 1.44; 95% CI 1.38 to 1.50); using personalised materials (OR 1.15; 95% CI 1.09 to 1.21; I2 = 57%); using a single-sided rather than a double-sided questionnaire (OR 1.13; 95% CI 1.02 to 1.25); using stamped return envelopes rather than franked return envelopes (OR 1.23; 95% CI 1.13 to 1.33; I2 = 69%), assuring confidentiality (OR 1.33; 95% CI 1.24 to 1.42); using first-class outward mailing (OR 1.11; 95% CI 1.02 to 1.21); and when questionnaires originated from a university (OR 1.32; 95% CI 1.13 to 1.54). The odds of response were reduced when the questionnaire included questions of a sensitive nature (OR 0.94; 95% CI 0.88 to 1.00). Electronic We found 88 eligible trials that evaluated over 30 different ways of increasing response to electronic questionnaires. We found substantial heterogeneity amongst trial results in half of the strategies. The odds of response tripled when: using a brief letter rather than a detailed letter (OR 3.26; 95% CI 1.79 to 5.94); and when a picture was included in an email (OR 3.05; 95% CI 1.84 to 5.06; I2 = 19%). The odds of response almost doubled when: using monetary incentives (OR 1.88; 95% CI 1.31 to 2.71; I2 = 79%); and using a more interesting topic (OR 1.85; 95% CI 1.52 to 2.26). The odds of response increased by half when: using non-monetary incentives (OR 1.60; 95% CI 1.25 to 2.05); using shorter e-questionnaires (OR 1.51; 95% CI 1.06 to 2.16; I2 = 94%); and using a more interesting e-questionnaire (OR 1.85; 95% CI 1.52 to 2.26). The odds of response increased by a third when: offering survey results as an incentive (OR 1.36; 95% CI 1.16 to 1.59); using a white background (OR 1.31; 95% CI 1.10 to 1.56); and when stressing the benefits to society of response (OR 1.38; 95% CI 1.07 to 1.78; I2 = 41%). The odds of response also increased with: personalised e-questionnaires (OR 1.24; 95% CI 1.17 to 1.32; I2 = 41%); using a simple header (OR 1.23; 95% CI 1.03 to 1.48); giving a deadline (OR 1.18; 95% CI 1.03 to 1.34); and by giving a longer time estimate for completion (OR 1.25; 95% CI 0.96 to 1.64). The odds of response were reduced when: "Survey" was mentioned in the e-mail subject (OR 0.81; 95% CI 0.67 to 0.97); when the email or the e-questionnaire was from a male investigator, or it included a male signature (OR 0.55; 95% CI 0.38 to 0.80); and by using university sponsorship (OR 0.84; 95%CI 0.69 to 1.01). The odds of response using a postal questionnaire were over twice those using an e-questionnaire (OR 2.33; 95% CI 2.25 to 2.42; I2 = 98%). Response also increased when: providing a choice of response mode (electronic or postal) rather than electronic only (OR 1.76 95% CI 1.67 to 1.85; I2 = 97%); and when administering the e-questionnaire by computer rather than by smartphone (OR 1.62 95% CI 1.36 to 1.94).

AUTHORS' CONCLUSIONS

Researchers using postal and electronic questionnaires can increase response using the strategies shown to be effective in this Cochrane review.

Reactivity of measurement in health psychology: how much of a problem is it? What can be done about it?

PURPOSE

Measurement reactivity is defined as being present where measurement results in changes in the people being measured. The main aim of this review is to provide an overview of the current state of knowledge concerning the extent and nature of psychological measurement affecting people who complete the measures. Other aims are to describe how this may affect conclusions drawn in health psychology research and to outline where more research is needed.

METHODS

Narrative review.

RESULTS

Several studies, using a variety of methods, have found measurement procedures to alter subsequent cognition, emotion, and behaviour. In many instances, the effects obtained were of up to medium size. However, the extent to which such studies are representative is not clear: do other studies which find no reactive effects of measurement not exist or do they exist but are not reported?

CONCLUSIONS

Although measurement reactivity can yield medium-sized effects, our understanding of this phenomenon is still rudimentary. We do not know the precise circumstances that are likely to result in measurement reactivity: we cannot predict when problems are more likely to arise. There is a particular absence of studies of the mechanisms by which measurement reactivity arises. There is a need for a systematic review of this literature, which should aim to quantify the extent of measurement reactivity effects and to provide a firmer evidence base for theorizing about the sources of reactivity.

Screening for type 2 diabetes is feasible, acceptable, but associated with increased short-term anxiety: a randomised controlled trial in British general practice

Background

To assess the feasibility and uptake of a diabetes screening programme; to examine the effects of invitation to diabetes screening on anxiety, self-rated health and illness perceptions.

Methods

Randomised controlled trial in two general practices in Cambridgeshire. Individuals aged 40–69 without known diabetes were identified as being at high risk of having undiagnosed type 2 diabetes using patient records and a validated risk score (n = 1,280). 355 individuals were randomised in a 2 to 1 ratio into non-invited (n = 238) and invited (n = 116) groups. A stepwise screening programme confirmed the presence or absence of diabetes. Six weeks after the last contact (either test or invitation), a questionnaire was sent to all participants, including non-attenders and those who were not originally invited. Outcome measures included attendance, anxiety (short-form Spielberger State Anxiety Inventory-STAI), self-rated health and diabetes illness perceptions.

Results

95 people (82% of those invited) attended for the initial capillary blood test. Six individuals were diagnosed with diabetes. Invited participants were more anxious than those not invited (37.6 vs. 34.1 STAI, p-value = 0.015), and those diagnosed with diabetes were considerably more anxious than those classified free of diabetes (46.7 vs. 37.0 STAI, p-value = 0.031). Non-attenders had a higher mean treatment control sub-scale (3.87 vs. 3.56, p-value = 0.016) and a lower mean emotional representation sub-scale (1.81 vs. 2.68, p-value = 0.001) than attenders. No differences in the other five illness perception sub-scales or self-rated health were found.

Conclusion

Screening for type 2 diabetes in primary care is feasible but may be associated with higher levels of short-term anxiety among invited compared with non-invited participants.

Trial registration

ISRCTN99175498

Completing a postal health questionnaire did not affect anxiety or related measures: randomized controlled trial

OBJECTIVE

There is evidence from laboratory studies that anxiety scores are elevated by completing questionnaires about health problems for the first time. This limits interpretation of the common finding that people receiving risk information from screening programs show elevated anxiety (as assessed by questionnaire) in the short-term, which subsides over time. We examine the extent to which postal questionnaire studies are affected by this potential measurement artifact.

STUDY DESIGN AND SETTING

Participants were 964 patients at high risk of undiagnosed diabetes, registered at five general practices. A two-group randomized experimental design was used, with the experimental group (n=484) receiving an initial questionnaire concerning screening for diabetes, and the control group (n=480) not receiving this questionnaire. Outcomes were assessed by an identical questionnaire 3 months later.

RESULTS

There were no significant differences in questionnaire scores at three months between the two groups on any of the outcome measures, including anxiety, symptoms, perceptions of diabetes severity, and perceived diabetes risk.

CONCLUSION

These results suggest that the problems associated with the use of anxiety questionnaires that are found in laboratory studies do not occur in postal studies: the observed changes in anxiety after receiving screening results are therefore unlikely to be artifactual.