Effects of a gift certificate incentive and specialized delivery on prostate cancer survivors' response rate to a mailed survey: a randomized-controlled trial

Methods to increase response to postal and electronic questionnaires

BACKGROUND

Self-administered questionnaires are widely used to collect data in epidemiological research, but non-response reduces the effective sample size and can introduce bias. Finding ways to increase response to postal and electronic questionnaires would improve the quality of epidemiological research.

OBJECTIVES

To identify effective strategies to increase response to postal and electronic questionnaires.

SEARCH METHODS

We searched 14 electronic databases up to December 2021 and manually searched the reference lists of relevant trials and reviews. We contacted the authors of all trials or reviews to ask about unpublished trials; where necessary, we also contacted authors to confirm the methods of allocation used and to clarify results presented.

SELECTION CRITERIA

Randomised trials of methods to increase response to postal or electronic questionnaires. We assessed the eligibility of each trial using pre-defined criteria.

DATA COLLECTION AND ANALYSIS

We extracted data on the trial participants, the intervention, the number randomised to intervention and comparison groups and allocation concealment. For each strategy, we estimated pooled odds ratios (OR) and 95% confidence intervals (CI) in a random-effects model. We assessed evidence for selection bias using Egger's weighted regression method and Begg's rank correlation test and funnel plot. We assessed heterogeneity amongst trial odds ratios using a Chi2 test and quantified the degree of inconsistency between trial results using the I2 statistic.

MAIN RESULTS

Postal We found 670 eligible trials that evaluated over 100 different strategies of increasing response to postal questionnaires. We found substantial heterogeneity amongst trial results in half of the strategies. The odds of response almost doubled when: using monetary incentives (odds ratio (OR) 1.86; 95% confidence interval (CI) 1.73 to 1.99; heterogeneity I2 = 85%); using a telephone reminder (OR 1.96; 95% CI 1.03 to 3.74); and when clinical outcome questions were placed last (OR 2.05; 95% CI 1.00 to 4.24). The odds of response increased by about half when: using a shorter questionnaire (OR 1.58; 95% CI 1.40 to 1.78); contacting participants before sending questionnaires (OR 1.36; 95% CI 1.23 to 1.51; I2 = 87%); incentives were given with questionnaires (i.e. unconditional) rather than when given only after participants had returned their questionnaire (i.e. conditional on response) (OR 1.53; 95% CI 1.35 to 1.74); using personalised SMS reminders (OR 1.53; 95% CI 0.97 to 2.42); using a special (recorded) delivery service (OR 1.68; 95% CI 1.36 to 2.08; I2 = 87%); using electronic reminders (OR 1.60; 95% CI 1.10 to 2.33); using intensive follow-up (OR 1.69; 95% CI 0.93 to 3.06); using a more interesting/salient questionnaire (OR 1.73; 95% CI 1.12 to 2.66); and when mentioning an obligation to respond (OR 1.61; 95% CI 1.16 to 2.22). The odds of response also increased with: non-monetary incentives (OR 1.16; 95% CI 1.11 to 1.21; I2 = 80%); a larger monetary incentive (OR 1.24; 95% CI 1.15 to 1.33); a larger non-monetary incentive (OR 1.15; 95% CI 1.00 to 1.33); when a pen was included (OR 1.44; 95% CI 1.38 to 1.50); using personalised materials (OR 1.15; 95% CI 1.09 to 1.21; I2 = 57%); using a single-sided rather than a double-sided questionnaire (OR 1.13; 95% CI 1.02 to 1.25); using stamped return envelopes rather than franked return envelopes (OR 1.23; 95% CI 1.13 to 1.33; I2 = 69%), assuring confidentiality (OR 1.33; 95% CI 1.24 to 1.42); using first-class outward mailing (OR 1.11; 95% CI 1.02 to 1.21); and when questionnaires originated from a university (OR 1.32; 95% CI 1.13 to 1.54). The odds of response were reduced when the questionnaire included questions of a sensitive nature (OR 0.94; 95% CI 0.88 to 1.00). Electronic We found 88 eligible trials that evaluated over 30 different ways of increasing response to electronic questionnaires. We found substantial heterogeneity amongst trial results in half of the strategies. The odds of response tripled when: using a brief letter rather than a detailed letter (OR 3.26; 95% CI 1.79 to 5.94); and when a picture was included in an email (OR 3.05; 95% CI 1.84 to 5.06; I2 = 19%). The odds of response almost doubled when: using monetary incentives (OR 1.88; 95% CI 1.31 to 2.71; I2 = 79%); and using a more interesting topic (OR 1.85; 95% CI 1.52 to 2.26). The odds of response increased by half when: using non-monetary incentives (OR 1.60; 95% CI 1.25 to 2.05); using shorter e-questionnaires (OR 1.51; 95% CI 1.06 to 2.16; I2 = 94%); and using a more interesting e-questionnaire (OR 1.85; 95% CI 1.52 to 2.26). The odds of response increased by a third when: offering survey results as an incentive (OR 1.36; 95% CI 1.16 to 1.59); using a white background (OR 1.31; 95% CI 1.10 to 1.56); and when stressing the benefits to society of response (OR 1.38; 95% CI 1.07 to 1.78; I2 = 41%). The odds of response also increased with: personalised e-questionnaires (OR 1.24; 95% CI 1.17 to 1.32; I2 = 41%); using a simple header (OR 1.23; 95% CI 1.03 to 1.48); giving a deadline (OR 1.18; 95% CI 1.03 to 1.34); and by giving a longer time estimate for completion (OR 1.25; 95% CI 0.96 to 1.64). The odds of response were reduced when: "Survey" was mentioned in the e-mail subject (OR 0.81; 95% CI 0.67 to 0.97); when the email or the e-questionnaire was from a male investigator, or it included a male signature (OR 0.55; 95% CI 0.38 to 0.80); and by using university sponsorship (OR 0.84; 95%CI 0.69 to 1.01). The odds of response using a postal questionnaire were over twice those using an e-questionnaire (OR 2.33; 95% CI 2.25 to 2.42; I2 = 98%). Response also increased when: providing a choice of response mode (electronic or postal) rather than electronic only (OR 1.76 95% CI 1.67 to 1.85; I2 = 97%); and when administering the e-questionnaire by computer rather than by smartphone (OR 1.62 95% CI 1.36 to 1.94).

AUTHORS' CONCLUSIONS

Researchers using postal and electronic questionnaires can increase response using the strategies shown to be effective in this Cochrane review.

A comparison of survey incentive methods to recruit rural cancer survivors into cancer care delivery research studies

Unconditional (upfront) incentives are proposed to improve acceptance of cancer research among underrepresented, racial/ethnic minority populations, but few studies have tested incentive strategies among rural cancer survivors. Descriptive statistics summarized demographic characteristics of survey respondents, and response rates by arm were compared using Chi-square tests. We compared upfront ($2) and response-based ($10 conditional) incentives in a mailed survey of adult post-treatment rural survivors. Individuals meeting eligibility criteria from the electronic medical record (n = 2,830) were randomized into two incentive arms (n = 1,414 for the upfront arm and n = 1,416 for the contingent arm). Of the total delivered, presumed eligible participants (n = 1,304 upfront arm; n = 1,317 contingent arm), 67.8% were aged 65y+, 49.8% were female, and 95.1% were non-Hispanic white. The response rate for all participants was 18.5%. We received eligible surveys from 281 rural survivors in the first arm (response rate: 21.5%); and 205 surveys in the second arm (response rate: 15.6%). Participants who received the upfront incentive had a higher response rate than those receiving a response-based incentive, X2 (1, 2,621) = 15.53, p < 0.0001. Incentivizing survey completion with an upfront $2 bill encouraged a higher survey response rate; other supplemental strategies are needed to achieve a higher response rate for this population.

Improving Electronic Survey Response Rates Among Cancer Center Patients During the COVID-19 Pandemic: Mixed Methods Pilot Study

BACKGROUND

Surveys play a vital role in cancer research. During the COVID-19 pandemic, the use of electronic surveys is crucial to improve understanding of the patient experience. However, response rates to electronic surveys are often lower compared with those of paper surveys.

OBJECTIVE

The aim of this study was to determine the best approach to improve response rates for an electronic survey administered to patients at a cancer center during the COVID-19 pandemic.

METHODS

We contacted 2750 patients seen at Moffitt Cancer Center in the prior 5 years via email to complete a survey regarding their experience during the COVID-19 pandemic, with patients randomly assigned to a series of variations of prenotifications (ie, postcard, letter) or incentives (ie, small gift, modest gift card). In total, eight combinations were evaluated. Qualitative interviews were conducted to understand the level of patient understanding and burden with the survey, and quantitative analysis was used to evaluate the response rates between conditions.

RESULTS

A total of 262 (9.5%) patients completed the survey and 9 participated in a qualitative interview. Interviews revealed minimal barriers in understanding or burden, which resulted in minor survey design changes. Compared to sending an email only, sending a postcard or letter prior to the email improved response rates from 3.7% to 9.8%. Similarly, inclusion of an incentive significantly increased the response rate from 5.4% to 16.7%, especially among racial (3.0% to 12.2%) and ethnic (6.4% to 21.0%) minorities, as well as among patients with low socioeconomic status (3.1% to 14.9%).

CONCLUSIONS

Strategies to promote effective response rates include prenotification postcards or letters as well as monetary incentives. This work can inform future survey development to increase response rates for electronic surveys, particularly among hard-to-reach populations.

Most response-inducing strategies do not increase participation in observational studies: a systematic review and meta-analysis

OBJECTIVES

To evaluate response-inducing strategies for observational studies using health-related questionnaires or interviews.

STUDY DESIGN AND SETTING

We searched PubMed, EMBASE, CINAHL, PsycINFO, and Web of Science up to December 28, 2017. Studies evaluating the effect of a response-inducing strategy on participation rates of observational studies were included. For each strategy, we estimated pooled response ratios with 95% confidence intervals (CIs) in a Hartung-Knapp/Sidik-Jonkman random effects model with the final participation rate as outcome, stratified for type of participants and method of data collection.

RESULTS

The search yielded 168 eligible studies involving 367,616 potential participants and 33 strategies. Among patients, response-inducing strategies for paper-based questionnaires included unconditional monetary incentives (response ratio 1.15; 95% CI 1.09-1.21) and shorter questionnaires (1.04; 1.02-1.06). Among nonpatients, a personalized mode of delivery (1.47; 1.24-1.74), more expensive mailing type (1.25; 1.00-1.56), unconditional monetary incentives (1.24; 1.12-1.38), prenotification (1.12; 1.03-1.22), unconditional scratch lottery tickets (1.09; 1.01-1.18), and shorter questionnaires (1.06; 1.02-1.11) increased response rates to paper-based questionnaires. For Web-based questionnaires and interviews among nonpatients, response rates were increased by conditional lottery tickets (1.17; 1.02-1.34) and conditional monetary incentives (1.39; 1.01-1.91), respectively.

CONCLUSION

Although the majority of strategies evaluated were unsuccessful, some may increase response rates to observational studies, particularly among nonpatients.

Physical and emotional health information needs and preferences of long-term prostate cancer survivors

OBJECTIVE

Many men diagnosed with prostate cancer (PC) will experience physical and psychosocial late effects of treatment. Their interest/preferences for receiving information about addressing common sequelae is not well understood. We examined long-term PC survivors' level of interest, whether this differed based upon symptomatology, and their preferred coping information source.

METHODS

N=615 PC survivors (3-8 years post-diagnosis) completed a survey on physical and psychological health and their information interests and preferences related to late effects of cancer treatment.

RESULTS

Over half of PC survivors reported interest in information about late effects of treatment or sexual health, while approximately a quarter were interested in emotional health information. Survivors preferred to receive information about late effects of treatment from their oncologists, sexual health information from their primary care providers (PCP), oncologist, or written/online resources, and emotional health information from their PCP. Information needs were more commonly reported among men with poorer domain-specific health functioning.

CONCLUSION

Long-term PC survivors report significant interest in receiving information about their physical, sexual, and emotional health.

PRACTICE IMPLICATIONS

Medical providers caring for these men should inquire about survivors' information needs and future intervention efforts should consider who delivers the information, dependent upon the type of dysfunction reported.

Lottery ticket was more effective than a prize draw in increasing questionnaire response among cancer survivors

OBJECTIVES

Compare the effect of financial incentives on response to a cancer survivors' postal questionnaire.

STUDY DESIGN AND SETTING

Prostate cancer survivors in Ireland, 1.5-18 years after diagnosis, were randomized to the (1) "lottery" arm [a € 1 lottery scratch card sent with the questionnaire (n = 2,413)] or (2) "prize" arm [entry into a draw on return of a completed questionnaire (n = 2,407)]. Impact of interventions on response overall and by survival period ("short term": < 5 years after diagnosis; "long term": ≥ 5 years after diagnosis) was compared as was cost-effectiveness.

RESULTS

Adjusted response rate was 54.4%. Response was higher among younger men (P < 0.001) and those with earlier stage disease (P = 0.002). A modest 2.6% higher response rate was observed in the lottery compared with the prize arm [multivariate relative risk (RR) = 1.06; 95% confidence interval (CI): 1.00, 1.11]. When stratified by survival period, higher response in the lottery arm was only observed among long-term survivors (multivariate RR = 1.10; 95% CI: 1.02, 1.19; short-term survivors: RR = 1.01; 95% CI: 0.94, 1.09). Costs per completed questionnaire were € 4.54 and € 3.57 for the lottery and prize arms, respectively. Compared with the prize arm, cost per additional questionnaire returned in the lottery arm was € 25.65.

CONCLUSION

Although more expensive, to optimize response to postal questionnaires among cancer survivors, researchers might consider inclusion of a lottery scratch card.

Identifying suicidal symptoms in prostate cancer survivors using brief self-report

PURPOSE

Prostate cancer (PC) survivors are at elevated risk for completed suicide even many years post-treatment. Despite this risk, practical and efficient methods for assessing these symptoms have not been established. We sought to determine if suicidal symptoms could be effectively and efficiently identified in a cohort of PC survivors, and whether these men were receptive to emotional health interventions.

METHODS

Six hundred fifty-six PC survivors, an average of 5 years post-diagnosis, completed eight self-report items about suicidal symptoms and behavior in the past 7 days, and 12 months, as well as medical utilization and interest in emotional health support.

RESULTS

Between 3.6 and 17.9% of PC survivors endorsed a single suicidal ideation item, and denied all other ideation. All survivors who endorsed serious suicidal ideation/behavior also endorsed either passive or active ideation. 58.3% of survivors denied any suicidal symptoms within the past week, but endorsed it within the past year. Most survivors had medical provider contact within the past year and were open to receiving information about emotional health interventions.

CONCLUSIONS

Suicidal ideation in PC survivors cannot be accurately evaluated using only a one-item screen, or by inquiring within a single time frame.

IMPLICATIONS FOR CANCER SURVIVORS

In both research and clinical settings, the evaluation for suicidal ideation in PC survivors should utilize multiple questions, across several time periods. It is possible to skip queries about serious ideation/behavior if passive or active ideation is denied. Once identified, medical providers should refer these men to psychosocial providers who can offer emotional support.