Self-Reported Interest to Participate in a Health Survey if Different Amounts of Cash or Non-Monetary Incentive Types Were Offered

Methods to increase response to postal and electronic questionnaires

BACKGROUND

Self-administered questionnaires are widely used to collect data in epidemiological research, but non-response reduces the effective sample size and can introduce bias. Finding ways to increase response to postal and electronic questionnaires would improve the quality of epidemiological research.

OBJECTIVES

To identify effective strategies to increase response to postal and electronic questionnaires.

SEARCH METHODS

We searched 14 electronic databases up to December 2021 and manually searched the reference lists of relevant trials and reviews. We contacted the authors of all trials or reviews to ask about unpublished trials; where necessary, we also contacted authors to confirm the methods of allocation used and to clarify results presented.

SELECTION CRITERIA

Randomised trials of methods to increase response to postal or electronic questionnaires. We assessed the eligibility of each trial using pre-defined criteria.

DATA COLLECTION AND ANALYSIS

We extracted data on the trial participants, the intervention, the number randomised to intervention and comparison groups and allocation concealment. For each strategy, we estimated pooled odds ratios (OR) and 95% confidence intervals (CI) in a random-effects model. We assessed evidence for selection bias using Egger's weighted regression method and Begg's rank correlation test and funnel plot. We assessed heterogeneity amongst trial odds ratios using a Chi2 test and quantified the degree of inconsistency between trial results using the I2 statistic.

MAIN RESULTS

Postal We found 670 eligible trials that evaluated over 100 different strategies of increasing response to postal questionnaires. We found substantial heterogeneity amongst trial results in half of the strategies. The odds of response almost doubled when: using monetary incentives (odds ratio (OR) 1.86; 95% confidence interval (CI) 1.73 to 1.99; heterogeneity I2 = 85%); using a telephone reminder (OR 1.96; 95% CI 1.03 to 3.74); and when clinical outcome questions were placed last (OR 2.05; 95% CI 1.00 to 4.24). The odds of response increased by about half when: using a shorter questionnaire (OR 1.58; 95% CI 1.40 to 1.78); contacting participants before sending questionnaires (OR 1.36; 95% CI 1.23 to 1.51; I2 = 87%); incentives were given with questionnaires (i.e. unconditional) rather than when given only after participants had returned their questionnaire (i.e. conditional on response) (OR 1.53; 95% CI 1.35 to 1.74); using personalised SMS reminders (OR 1.53; 95% CI 0.97 to 2.42); using a special (recorded) delivery service (OR 1.68; 95% CI 1.36 to 2.08; I2 = 87%); using electronic reminders (OR 1.60; 95% CI 1.10 to 2.33); using intensive follow-up (OR 1.69; 95% CI 0.93 to 3.06); using a more interesting/salient questionnaire (OR 1.73; 95% CI 1.12 to 2.66); and when mentioning an obligation to respond (OR 1.61; 95% CI 1.16 to 2.22). The odds of response also increased with: non-monetary incentives (OR 1.16; 95% CI 1.11 to 1.21; I2 = 80%); a larger monetary incentive (OR 1.24; 95% CI 1.15 to 1.33); a larger non-monetary incentive (OR 1.15; 95% CI 1.00 to 1.33); when a pen was included (OR 1.44; 95% CI 1.38 to 1.50); using personalised materials (OR 1.15; 95% CI 1.09 to 1.21; I2 = 57%); using a single-sided rather than a double-sided questionnaire (OR 1.13; 95% CI 1.02 to 1.25); using stamped return envelopes rather than franked return envelopes (OR 1.23; 95% CI 1.13 to 1.33; I2 = 69%), assuring confidentiality (OR 1.33; 95% CI 1.24 to 1.42); using first-class outward mailing (OR 1.11; 95% CI 1.02 to 1.21); and when questionnaires originated from a university (OR 1.32; 95% CI 1.13 to 1.54). The odds of response were reduced when the questionnaire included questions of a sensitive nature (OR 0.94; 95% CI 0.88 to 1.00). Electronic We found 88 eligible trials that evaluated over 30 different ways of increasing response to electronic questionnaires. We found substantial heterogeneity amongst trial results in half of the strategies. The odds of response tripled when: using a brief letter rather than a detailed letter (OR 3.26; 95% CI 1.79 to 5.94); and when a picture was included in an email (OR 3.05; 95% CI 1.84 to 5.06; I2 = 19%). The odds of response almost doubled when: using monetary incentives (OR 1.88; 95% CI 1.31 to 2.71; I2 = 79%); and using a more interesting topic (OR 1.85; 95% CI 1.52 to 2.26). The odds of response increased by half when: using non-monetary incentives (OR 1.60; 95% CI 1.25 to 2.05); using shorter e-questionnaires (OR 1.51; 95% CI 1.06 to 2.16; I2 = 94%); and using a more interesting e-questionnaire (OR 1.85; 95% CI 1.52 to 2.26). The odds of response increased by a third when: offering survey results as an incentive (OR 1.36; 95% CI 1.16 to 1.59); using a white background (OR 1.31; 95% CI 1.10 to 1.56); and when stressing the benefits to society of response (OR 1.38; 95% CI 1.07 to 1.78; I2 = 41%). The odds of response also increased with: personalised e-questionnaires (OR 1.24; 95% CI 1.17 to 1.32; I2 = 41%); using a simple header (OR 1.23; 95% CI 1.03 to 1.48); giving a deadline (OR 1.18; 95% CI 1.03 to 1.34); and by giving a longer time estimate for completion (OR 1.25; 95% CI 0.96 to 1.64). The odds of response were reduced when: "Survey" was mentioned in the e-mail subject (OR 0.81; 95% CI 0.67 to 0.97); when the email or the e-questionnaire was from a male investigator, or it included a male signature (OR 0.55; 95% CI 0.38 to 0.80); and by using university sponsorship (OR 0.84; 95%CI 0.69 to 1.01). The odds of response using a postal questionnaire were over twice those using an e-questionnaire (OR 2.33; 95% CI 2.25 to 2.42; I2 = 98%). Response also increased when: providing a choice of response mode (electronic or postal) rather than electronic only (OR 1.76 95% CI 1.67 to 1.85; I2 = 97%); and when administering the e-questionnaire by computer rather than by smartphone (OR 1.62 95% CI 1.36 to 1.94).

AUTHORS' CONCLUSIONS

Researchers using postal and electronic questionnaires can increase response using the strategies shown to be effective in this Cochrane review.

Promoting Adolescent Healthy Relationships (The About Us Program): Protocol for a Randomized Clinical Trial

BACKGROUND

Romantic relationships play a critical role in adolescent development, and by middle adolescence, most young people have been involved in at least one romantic relationship, a context in which most sexual interactions occur. Research suggests adolescents lack positive models and skills related to building healthy relationships.

OBJECTIVE

This project aims to test the impact of an innovative healthy relationships intervention, called About Us, implemented in school-based health centers (SBHCs) in California in a randomized controlled trial.

METHODS

About Us is being tested using a 7-site, 2-group, parallel randomized controlled trial with a treatment versus control allocation ratio of 3:2 to assess the impact of the intervention relative to the standard of care among adolescents aged 14 to 18 years. Adolescents with active parental consent provide study assent at each of the 3 survey time points: baseline, 3 months postintervention, and 9 months postintervention. A stratified randomization procedure was used to ensure balance in key covariates and screening criteria across intervention groups. Through benchmark intent-to-treat analyses, we will examine the primary outcome of this study-the impact of About Us relative to the standard of care 9 months following the end of the intervention on the prevalence of vaginal or anal sex without condoms in the past 3 months. The secondary outcomes are four-fold: what is the impact of About Us relative to the standard of care 3 and 9 months following the end of the intervention, on (1) the prevalence of abstinence from vaginal or anal sex in the past 3 months, (2) composite scores of relationship communication and positive conflict resolution among participants involved in a relationship at baseline, (3) the prevalence of SBHC service use or information receipt in the past 3 months, and (4) composite scores of condom use intentions and attitudes regarding condoms and other birth control? Additionally, as part of our sensitivity analyses, two additional analyses will be implemented: modified intent-to-treat and complete case analysis.

RESULTS

This project (ClinicalTrials.gov #NCT03736876) was funded in 2016 through the Family Youth Services Bureau as part of the Personal Responsibility Education Innovative Strategies program. Baseline data collection took place between February 2018 and March 2020, yielding a total of 5 cohorts and 533 study participants: 316 assigned to treatment and 217 assigned to control. Ongoing follow-up data collection continued through May 2021.

CONCLUSIONS

About Us draws on developmental science to create a contextually and developmentally relevant program that addresses motivation and emotional influences in sexual decision-making. The intervention was designed for implementation within SBHCs, an understudied venue for relationship and sexual health promotion interventions. Unfortunately, COVID-19 pandemic restrictions led to school closures, interrupting ongoing programming, and in-person follow-up data collection, which has affected study attrition.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03736876; https://clinicaltrials.gov/ct2/show/NCT03736876.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/30499.

Knowledge and perceptions of human trafficking among community-based and faith-based organization members in South Los Angeles

The objectives of this study were (1) to assess the knowledge and perceptions of human trafficking (HT) among leaders and staff from 11 community-based organizations (CBOs) and faith-based organizations (FBOs) in South Los Angeles, and (2) to identify gaps in knowledge of HT and inform community organizations regarding possible best practices in health promotion for addressing this emerging public health problem. A self-administered survey was conducted during the period from 4 December 2015 to 28 January 2016. Descriptive statistics were generated and a logistic regression model was constructed using SAS 9.3. A total of 277 CBO and FBO leaders and staff completed the survey. Participants demonstrated high levels of knowledge of HT but their knowledge was not comprehensive, as gaps exist in recognizing the context in which HT usually takes place; understanding the local laws that govern this activity; and ways to follow related policies/procedures when the problem is suspected. A majority (a) believed there were not enough services in Los Angeles County to help survivors of HT, (b) could not recognize the signs of HT, and (c) did not know what steps to take if they suspected this criminal activity. A statistically significant association was found between education and participants' knowledge of HT, and with their beliefs and attitudes toward this violation of human rights. Study findings suggest that, generally, CBO/FBO leaders and staff in South Los Angeles have good knowledge about HT. However, notable gaps in knowledge and misperceptions remain, suggesting opportunities for Public Health to further educate and intervene.

Challenge Accepted! a Critical Reflection on How to Perform a Health Survey Among University Students-An Example of the Healthy Campus Mainz Project

Background: Universities represent an important setting of everyday life for health promotion. The Healthy Campus Mainz project aims to develop an evidence-based and comprehensive student health management program covering physical, mental, and social health promotion. Hence, an initial health survey was performed in order to identify the students' health concerns and resources. Up until now, it remains unclear which topics to choose in a health survey among university students and which strategies can be recommended to receive an acceptable response rate or representative student sample within a university setting. The present paper contributes to the call for the present research topic "Public Health Promotion in University Students" by describing methods for health assessment. Therefore, the current paper aims to give an empirical example on how to perform a health survey among university students, focusing on (1) choosing topics for the survey and (2) methodological considerations of how to reach the target population. Methods: An online questionnaire including around 270 items was developed covering a comprehensive set of health topics. Participants were recruited via the university email. Mixed channels for survey promotion, such as lecture visits and social media, were used, accompanied by different monetary and non-monetary incentives. Descriptive analyses were performed to describe the sample. Results: A total of 5,006 participants (out of 31,213 registered students) viewed the first page of the questionnaire; of whom, 4,714 continued further. After a manual data cleaning according to the predefined criteria, the final sample was 4,351, demonstrating a response rate of 13.9%. Students from different study disciplines participated. However, some study disciplines showed a low participation rate, hence, making the results not free from some bias. Discussion: This survey is exceptional as it integrates a great variety of health aspects. The incentive strategy demonstrated promising results. Future research should try to improve target-group-specific recruitment strategies for the traditionally underrepresented groups, such as males and specific study disciplines. This would not only include advancing marketing strategies, but also refining the incentive strategy.

Social Psychological Predictors of Sleep Hygiene Behaviors in Australian and Hong Kong University Students

BACKGROUND

Sleep hygiene behaviors in undergraduate students are associated with night-time sleep duration and quality, daytime sleepiness, and psychological distress. This study aimed to identify the social psychological factors that impact on university students' sleep hygiene behaviors in samples from two countries.

METHOD

Participants were undergraduate students from Australia (N = 201, M_Age = 22.82, SD_Age = 8.89; 165 female) and Hong Kong (N = 161, M_Age = 20.47, SD_Age = 7.80; 84 female). The study used a correlational-prospective design. Individuals self-reported their intention, attitude, subjective norms, perceived behavioral control, and past behavior with respect to sleep hygiene behaviors. Four weeks later, the students self-reported their action plans and participation in sleep hygiene behaviors.

RESULTS

Analysis indicated acceptable model fit to data for both the Australian and Hong Kong samples. Results showed significant direct effects of attitude, subjective norms, perceived behavioral control, and past behavior on intention, and significant direct effects of action planning and past behavior on prospectively measured sleep hygiene behavior. There were also significant indirect effects of attitude, subjective norms (Hong Kong sample only), and perceived behavioral control on behavior mediated by intention and action planning. Overall, the model predicted a large portion of the variance in sleep hygiene behavior for both the Australian (R² = .524) and Hong Kong (R² = .483) samples. Schenker and Gentleman t tests found no parameters significantly differed between samples.

CONCLUSION

Results indicate that university students' sleep hygiene behaviors are a function of both motivational and volitional processes. This formative data can inform future interventions to improve the sleep hygiene practices of university students.