What impact do questionnaire length and monetary incentives have on mailed health psychology survey response?

Proxy Survey Cost Indicators in Interviewer-Administered Surveys: Are they Actually Correlated with Costs?

Survey design decisions are-by their very nature-tradeoffs between costs and errors. However, measuring costs is often difficult. Furthermore, surveys are growing more complex. Many surveys require that cost information be available to make decisions during data collection. These complexities create new challenges for monitoring and understanding survey costs. Often, survey cost information lags behind reporting of paradata. Furthermore, in some situations, the measurement of costs at the case level is difficult. Given the time lag in reporting cost information and the difficulty of assigning costs directly to cases, survey designers and managers have frequently turned to proxy indicators for cost. These proxy measures are often based upon level-of-effort paradata. An example of such a proxy cost indicator is the number of attempts per interview. Unfortunately, little is known about how accurately these proxy indicators actually mirror the true costs of the survey. In this article, we examine a set of these proxy indicators across several surveys with different designs, including different modes of interview. We examine the strength of correlation between these indicators and two different measures of costs-the total project cost and total interviewer hours. This article provides some initial evidence about the quality of these proxies as surrogates for the true costs using data from several different surveys with interviewer-administered modes (telephone, face to face) across three organizations (University of Michigan's Survey Research Center, Westat, US Census Bureau). We find that some indicators (total attempts, total contacts, total completes, sample size) are correlated (average correlation ∼0.60) with total costs across several surveys. These same indicators are strongly correlated (average correlation ∼0.82) with total interviewer hours. For survey components, three indicators (total attempts, sample size, and total miles) are strongly correlated with both total costs (average correlation ∼0.77) and with total interviewer hours (average correlation ∼0.86).

Prevalence and short-term change in symptoms of anxiety and depression following bariatric surgery: a prospective cohort study

OBJECTIVES

Bariatric surgery is an effective treatment for severe obesity that leads to significant physical health improvements. Few studies have prospectively described the short-term impact of surgery on mental health using standardised case-finding measures for anxiety or depressive disorders. This study describes the prevalence and short-term course of these conditions following surgery.

DESIGN

Prospective observational cohort study.

SETTING

12 National Health Service centres in England.

PARTICIPANTS

Participants studied took part in the By-Band-Sleeve study, a multicentre randomised controlled trial evaluating the surgical management of severe obesity. We included participants who had undergone surgery (gastric bypass, gastric band or sleeve gastrectomy) within 6 months of randomisation.

PRIMARY AND SECONDARY OUTCOME MEASURES

Anxiety and depression were assessed using the Hospital Anxiety and Depression Scale (HADS) at baseline and 12 months post-randomisation. Sociodemographic variables collected at prerandomisation included body mass index, age, sex, ethnicity, marital status, tobacco use, employment status and income band.

RESULTS

In our sample of 758 participants, 94.5% (n 716) and 93.9% (n 712) had completed baseline anxiety (HADS-A) and depression (HADS-D) subscales. At pre-randomisation 46.1% (n 330/716, 95% CI 42.4% to 49.7%) met clinical case criteria for anxiety and 48.2% (n 343/712, 95% CI 44.5% to 51.8%) for depression. Among participants returning completed 12 months post-randomisation questionnaires (HADS-A n 503/716, HADS-D n 498/712), there was a significant reduction in the proportion of clinical cases with anxiety (-9.5%, 95% CI -14.3% to -4.8% p<0.001) and depression (-22.3%, 95% CI -27.0% to -17.6% p<0.001).

CONCLUSIONS

Almost half of people undergoing bariatric surgery had underlying anxiety or depressive symptoms. In the short term, these symptoms appear to substantially improve. Future work must identify whether these effects are sustained beyond the first post-randomisation year.

TRIAL REGISTRATION NUMBER

NCT02841527 and ISRCTN00786323.

Methods to increase response to postal and electronic questionnaires

BACKGROUND

Self-administered questionnaires are widely used to collect data in epidemiological research, but non-response reduces the effective sample size and can introduce bias. Finding ways to increase response to postal and electronic questionnaires would improve the quality of epidemiological research.

OBJECTIVES

To identify effective strategies to increase response to postal and electronic questionnaires.

SEARCH METHODS

We searched 14 electronic databases up to December 2021 and manually searched the reference lists of relevant trials and reviews. We contacted the authors of all trials or reviews to ask about unpublished trials; where necessary, we also contacted authors to confirm the methods of allocation used and to clarify results presented.

SELECTION CRITERIA

Randomised trials of methods to increase response to postal or electronic questionnaires. We assessed the eligibility of each trial using pre-defined criteria.

DATA COLLECTION AND ANALYSIS

We extracted data on the trial participants, the intervention, the number randomised to intervention and comparison groups and allocation concealment. For each strategy, we estimated pooled odds ratios (OR) and 95% confidence intervals (CI) in a random-effects model. We assessed evidence for selection bias using Egger's weighted regression method and Begg's rank correlation test and funnel plot. We assessed heterogeneity amongst trial odds ratios using a Chi2 test and quantified the degree of inconsistency between trial results using the I2 statistic.

MAIN RESULTS

Postal We found 670 eligible trials that evaluated over 100 different strategies of increasing response to postal questionnaires. We found substantial heterogeneity amongst trial results in half of the strategies. The odds of response almost doubled when: using monetary incentives (odds ratio (OR) 1.86; 95% confidence interval (CI) 1.73 to 1.99; heterogeneity I2 = 85%); using a telephone reminder (OR 1.96; 95% CI 1.03 to 3.74); and when clinical outcome questions were placed last (OR 2.05; 95% CI 1.00 to 4.24). The odds of response increased by about half when: using a shorter questionnaire (OR 1.58; 95% CI 1.40 to 1.78); contacting participants before sending questionnaires (OR 1.36; 95% CI 1.23 to 1.51; I2 = 87%); incentives were given with questionnaires (i.e. unconditional) rather than when given only after participants had returned their questionnaire (i.e. conditional on response) (OR 1.53; 95% CI 1.35 to 1.74); using personalised SMS reminders (OR 1.53; 95% CI 0.97 to 2.42); using a special (recorded) delivery service (OR 1.68; 95% CI 1.36 to 2.08; I2 = 87%); using electronic reminders (OR 1.60; 95% CI 1.10 to 2.33); using intensive follow-up (OR 1.69; 95% CI 0.93 to 3.06); using a more interesting/salient questionnaire (OR 1.73; 95% CI 1.12 to 2.66); and when mentioning an obligation to respond (OR 1.61; 95% CI 1.16 to 2.22). The odds of response also increased with: non-monetary incentives (OR 1.16; 95% CI 1.11 to 1.21; I2 = 80%); a larger monetary incentive (OR 1.24; 95% CI 1.15 to 1.33); a larger non-monetary incentive (OR 1.15; 95% CI 1.00 to 1.33); when a pen was included (OR 1.44; 95% CI 1.38 to 1.50); using personalised materials (OR 1.15; 95% CI 1.09 to 1.21; I2 = 57%); using a single-sided rather than a double-sided questionnaire (OR 1.13; 95% CI 1.02 to 1.25); using stamped return envelopes rather than franked return envelopes (OR 1.23; 95% CI 1.13 to 1.33; I2 = 69%), assuring confidentiality (OR 1.33; 95% CI 1.24 to 1.42); using first-class outward mailing (OR 1.11; 95% CI 1.02 to 1.21); and when questionnaires originated from a university (OR 1.32; 95% CI 1.13 to 1.54). The odds of response were reduced when the questionnaire included questions of a sensitive nature (OR 0.94; 95% CI 0.88 to 1.00). Electronic We found 88 eligible trials that evaluated over 30 different ways of increasing response to electronic questionnaires. We found substantial heterogeneity amongst trial results in half of the strategies. The odds of response tripled when: using a brief letter rather than a detailed letter (OR 3.26; 95% CI 1.79 to 5.94); and when a picture was included in an email (OR 3.05; 95% CI 1.84 to 5.06; I2 = 19%). The odds of response almost doubled when: using monetary incentives (OR 1.88; 95% CI 1.31 to 2.71; I2 = 79%); and using a more interesting topic (OR 1.85; 95% CI 1.52 to 2.26). The odds of response increased by half when: using non-monetary incentives (OR 1.60; 95% CI 1.25 to 2.05); using shorter e-questionnaires (OR 1.51; 95% CI 1.06 to 2.16; I2 = 94%); and using a more interesting e-questionnaire (OR 1.85; 95% CI 1.52 to 2.26). The odds of response increased by a third when: offering survey results as an incentive (OR 1.36; 95% CI 1.16 to 1.59); using a white background (OR 1.31; 95% CI 1.10 to 1.56); and when stressing the benefits to society of response (OR 1.38; 95% CI 1.07 to 1.78; I2 = 41%). The odds of response also increased with: personalised e-questionnaires (OR 1.24; 95% CI 1.17 to 1.32; I2 = 41%); using a simple header (OR 1.23; 95% CI 1.03 to 1.48); giving a deadline (OR 1.18; 95% CI 1.03 to 1.34); and by giving a longer time estimate for completion (OR 1.25; 95% CI 0.96 to 1.64). The odds of response were reduced when: "Survey" was mentioned in the e-mail subject (OR 0.81; 95% CI 0.67 to 0.97); when the email or the e-questionnaire was from a male investigator, or it included a male signature (OR 0.55; 95% CI 0.38 to 0.80); and by using university sponsorship (OR 0.84; 95%CI 0.69 to 1.01). The odds of response using a postal questionnaire were over twice those using an e-questionnaire (OR 2.33; 95% CI 2.25 to 2.42; I2 = 98%). Response also increased when: providing a choice of response mode (electronic or postal) rather than electronic only (OR 1.76 95% CI 1.67 to 1.85; I2 = 97%); and when administering the e-questionnaire by computer rather than by smartphone (OR 1.62 95% CI 1.36 to 1.94).

AUTHORS' CONCLUSIONS

Researchers using postal and electronic questionnaires can increase response using the strategies shown to be effective in this Cochrane review.

Methods for improving participation rates in national self-administered web/mail surveys: Evidence from the United States

In the United States, increasing access to the internet, the increasing costs of large-scale face-to-face data collections, and the general reluctance of the public to participate in intrusive in-person data collections all mean that new approaches to nationally representative surveys are urgently needed. The COVID-19 pandemic accelerated the need for faster, higher-quality alternatives to face-to-face data collection. These trends place a high priority on the evaluation of innovative web-based data collection methods that are convenient for the U.S. public and yield scientific information of high quality. The web mode is particularly appealing because it is relatively inexpensive, it is logistically flexible to implement, and it affords a high level of privacy and confidentiality when correctly implemented. With this study, we aimed to conduct a methodological evaluation of a sequential mixed-mode web/mail data collection protocol, including modular survey design concepts, which was implemented on a national probability sample in the U.S. in 2020-2021. We implemented randomized experiments to test theoretically-informed hypotheses that 1) the use of mail and increased incentives to follow up with households that did not respond to an invitation to complete a household screening questionnaire online would help to recruit different types of households; and 2) the use of modular survey design, which involves splitting a lengthy self-administered survey up into multiple parts that can be completed at a respondent's convenience, would improve survey completion rates. We find support for the use of mail and increased incentives to follow up with households that have not responded to a web-based screening questionnaire. We did not find support for the use of modular design in this context. Simple descriptive analyses also suggest that attempted telephone reminders may be helpful for the main survey.

Clinical characteristics and long-term outcomes following pancreatic injury - An international multicenter cohort study

Background

Trauma to the pancreas is rare but associated with significant morbidity. Currently available management guidelines are based on low-quality evidence and data on long-term outcomes is lacking. This study aimed to evaluate clinical characteristics and patient-reported long-term outcomes for pancreatic injury.

Methods

A retrospective cohort study evaluating treatment for pancreatic injury in 11 centers across 5 European nations over >10 years was performed. Data relating to pancreatic injury and treatment were collected from hospital records. Patients reported quality of life (QoL), changes to employment and new or ongoing therapy due to index injury.

Results

In all, 165 patients were included. The majority were male (70.9%), median age was 27 years (range: 6-93) and mechanism of injury predominantly blunt (87.9%). A quarter of cases were treated conservatively; higher injury severity score (ISS) and American Association for the Surgery of Trauma (AAST) pancreatic injury scores increased the likelihood for surgical, endoscopic and/or radiologic intervention. Isolated, blunt pancreatic injury was associated with younger age and pancreatic duct involvement; this cohort appeared to benefit from non-operative management. In the long term (median follow-up 93; range 8-214 months), exocrine and endocrine pancreatic insufficiency were reported by 9.3% of respondents. Long-term analgesic use also affected 9.3% of respondents, with many reported quality of life problems (QoL) potentially attributable to side-effects of opiate therapy. Overall, impaired QoL correlated with higher ISS scores, surgical therapy and opioid analgesia on discharge.

Conclusions

Pancreatic trauma is rare but can lead to substantial short- and long-term morbidity. Near complete recovery of QoL indicators and pancreatic function can occur despite significant injury, especially in isolated, blunt pancreatic injury managed conservatively and when early weaning off opiate analgesia is achieved.

Selection of and Response to Physical Activity-Based Social Comparisons in a Digital Environment: Series of Daily Assessment Studies

BACKGROUND

Innovative approaches are needed to understand barriers to and facilitators of physical activity among insufficiently active adults. Although social comparison processes (ie, self-evaluations relative to others) are often used to motivate physical activity in digital environments, user preferences and responses to comparison information are poorly understood.

OBJECTIVE

We used an iterative approach to better understand users' selection of comparison targets, how they interacted with their selected targets, and how they responded to these targets.

METHODS

Across 3 studies, different samples of insufficiently active college students used the Fitbit system (Fitbit LLC) to track their steps per day as well as a separate, adaptive web platform each day for 7 to 9 days (N=112). The adaptive platform was designed with different layouts for each study; each allowed participants to select their preferred comparison target from various sets of options, view the desired amount of information about their selected target, and rate their physical activity motivation before and after viewing information about their selected target. Targets were presented as achieving physical activity at various levels below and above their own, which were accessed via the Fitbit system each day. We examined the types of comparison target selections, time spent viewing and number of elements viewed for each type of target, and day-level associations between comparison selections and physical activity outcomes (motivation and behavior).

RESULTS

Study 1 (n=5) demonstrated that the new web platform could be used as intended and that participants' interactions with the platform (ie, the type of target selected, the time spent viewing the selected target's profile, and the number of profile elements viewed) varied across the days. Studies 2 (n=53) and 3 (n=54) replicated these findings; in both studies, age was positively associated with time spent viewing the selected target's profile and the number of profile elements viewed. Across all studies, upward targets (who had more steps per day than the participant) were selected more often than downward targets (who had fewer steps per day than the participant), although only a subset of either type of target selection was associated with benefits for physical activity motivation or behavior.

CONCLUSIONS

Capturing physical activity-based social comparison preferences is feasible in an adaptive digital environment, and day-to-day differences in preferences for social comparison targets are associated with day-to-day changes in physical activity motivation and behavior. Findings show that participants only sometimes focus on the comparison opportunities that support their physical activity motivation or behavior, which helps explain previous, equivocal findings regarding the benefits of physical activity-based comparisons. Additional investigation of day-level determinants of comparison selections and responses is needed to fully understand how best to harness comparison processes in digital tools to promote physical activity.

Does usage of monetary incentive impact the involvement in surveys? A systematic review and meta-analysis of 46 randomized controlled trials

BACKGROUND

Surveys are an effective method for collecting a large quantity of data. However, incomplete responses to these surveys can affect the validity of the studies and introduce bias. Recent studies have suggested that monetary incentives may increase survey response rates. We intended to perform a systematic review and meta-analysis of randomized controlled trials (RCTs) to evaluate the effect of monetary incentives on survey participation.

METHODS

A systematic search of electronic databases was conducted to collect studies assessing the impact of monetary incentives on survey participation. The primary outcome of interest was the response rates to incentives: money, lottery, and voucher. We used the Cochrane Collaboration tool to assess the risk of bias in randomized trials. We calculated the rate ratio (RR) with its 95% confidence interval (95% CI) using Review Manager Software (version 5.3). We used random-effects analysis and considered the data statistically significant with a P-value <0.05.

RESULTS

Forty-six RCTs were included. A total of 109,648 participants from 14 countries were involved. The mean age of participants ranged from 15 to more than 60 years, with 27.5% being males, 16.7% being females, and the other 55.8% not reported. Our analysis showed a significant increase in response rate in the incentive group compared to the control group, irrespective of the incentive methods. Money was the most efficient way to increase the response rate (RR: 1.25; 95% CI: 1.16,1.35; P = < 0.00001) compared to voucher (RR: 1.19; 95% CI: 1.08,1.31; P = < 0.0005) and lottery (RR: 1.12; 95% CI: 1.03,1.22; P = < 0.009).

CONCLUSION

Monetary incentives encourage the response rate in surveys. Money was more effective than vouchers or lotteries. Therefore, researchers may include money as an incentive to improve the response rate while conducting surveys.

Possible Measures to Improve Both Participation and Response Quality in Japan’s National Health and Nutrition Survey: Results from a Workshop by Local Government Personnel in Charge of the Survey

Increasing participation rates are crucial to ensure the representativeness of national survey results of the population. This study aimed to identify measures that could be taken by local government personnel in charge of the National Health and Nutrition Survey (NHNS), Japan, to improve participation rates. The subjects were twenty-one health personnel who worked in 19 local governments and participated in the training course at the National Institute of Public Health. Qualitative data were collected through a workshop. They discussed the problems that seem to affect participation rates and identified possible solutions. The contents were coded and grouped to create categories, using the Jiro Kawakita (KJ) method. For data analysis, researchers combined and reviewed all codes and categories. The measures that could improve participation rates were divided into the following 12 categories: 1. standardization of survey methods, 2. investigator skills, 3. survey organization, 4. venue setting, 5. accessing target households, 6. time of survey, 7. responses during the investigation, 8. confirming meal contents reported in the nutritional intake status survey, 9. rewards/incentives, 10. possible rewards, 11. feedback on survey results, and 12. survey practices during the COVID-19 pandemic. These findings represent viable initiatives for local health personnel to increase participation rates for the NHNS.

Development and Evaluation of the Clinical Trial HEalth Knowledge and Beliefs Scale (CHEKS)

Patient health literacy is vital to clinical trial engagement. Knowledge and beliefs about clinical trials may contribute to patient literacy of clinical trials, influencing engagement, enrollment and retention. We developed and assessed a survey that measures clinical trial health knowledge and beliefs, known as the Clinical trial HEalth Knowledge and belief Scale (CHEKS). The 31 survey items in CHEKS represent knowledge and beliefs about clinical trial research (n = 409) in 2017. We examined item-scale correlations for the 31 items, eliminated items with item-scale correlations less than 0.30, and then estimated internal consistency reliability for the remaining 25 items. We used the comparative fit index (CFI) and the root mean squared error of approximation (RMSEA) to evaluate model fit. The average age of the sample was 34 (SD = 15.7) and 48% female. We identified 6 of the 31 items that had item-scale correlations (corrected for overlap) lower than 0.30. Coefficient alpha for the remaining 25 items was 0.93 A one-factor categorical confirmatory factor analytic model with 16 correlated errors was not statistically significant (chi-square = 10011.994, df = 300, p < 0.001) but fit the data well (CFI = 0.95 and RMSEA = 0.07). CHEKS can assess clinical trial knowledge and beliefs.

Latent tuberculosis screening and treatment in HIV: highly acceptable in a prospective cohort study

Background

People living with HIV (PLWH) are at increased risk of re-activation of latent tuberculosis infection (LTBI). Although UK and international guidelines identify this group as a priority for LTBI screening and treatment, data on attitudes of PLWH to this policy recommendation are lacking.

Methods

A five-point, Likert-style questionnaire was administered to PLWH to assess views and intentions towards accepting LTBI screening and treatment. Subsequent interferon-γ release assay (IGRA) testing was offered, and chemoprophylaxis if required. Influencing demographic and psychological associations with planned, and actual, testing and treatment uptake were assessed using multivariable logistic regression.

Results

444 out of 716 (62%) patients responded. 417 out of 437 (95.4%) expressed intention to accept LTBI testing. The only significant association was the perceived importance of testing to the individual (adjusted odds ratio (aOR) 8.98, 95% CI 2.55–31.67). 390 out of 393 (99.2%) accepted appropriate IGRA screening; 41 out of 390 (10.5%) were positive. 397 out of 431 (92.1%) expressed intention to accept chemoprophylaxis, associated with perceived importance of treatment (aOR 3.52, 95% CI 1.46–8.51), a desire to have treatment for LTBI (aOR 1.77, 95% CI 0.99–3.15) and confidence in taking treatment (aOR 3.77, 95% CI 1.84–7.72). Of those offered chemoprophylaxis, 36 out of 37 (97.3%) accepted and 34 out of 36 (94.4%) completed treatment. There were no correlates with actual screening acceptance.

Conclusions

LTBI is common amongst PLWH, highlighting the importance of robust screening and treatment programmes. This study shows that screening and treatment for LTBI is highly acceptable to PLWH and provides strong, objective evidence for policy-makers developing guidelines in this cohort.

This detailed exploration of the views of people living with HIV in the UK through a prospective questionnaire cohort study is the first of its kind in the published literature, and shows that latent TB screening and treatment is overwhelmingly supportedhttps://bit.ly/3HmhmRy

Short Versions of the Arabic Psychosocial Impact of Dental Aesthetics Questionnaire for Yemeni Adolescents: Cross-Sectional Derivation and Validation

Objectives: To shorten the 24-item Arabic Psychosocial Impact of Dental Aesthetics Questionnaire (PIDAQ(A)) for adolescents in Yemen. Material and methods: Two shortening methods derived six-item and nine-item versions: the item impact method selected items with the highest impact scores as rated by 30 participants in each subscale; and the regression method was applied using data of 385 participants from the PIDAQ(A) validity study, with the total PIDAQ(A) score as the dependent variable, and its individual items as the independent variables. The four derived versions were assessed for validity and reliability. Results: The means of the six-item and nine-item short versions of both methods were close. Cronbach’s alpha values extended from 0.90 to 0.92 (intra-class correlations = 0.85−0.88). In criterion validity, strong significant correlations were detected between scores of all short versions and the 24-item PIDAQ(A) score (0.96−0.98; p < 0.001). Construct validity displayed significant associations among all short versions and self-perceived dental appearance rank and self-perceived need for orthodontic braces rank (p < 0.05). Mean scores of all short versions were significantly different between adolescents with severe malocclusion and those with slight malocclusion in discriminant validity tests. In conclusion, all PIDAQ(A) short versions are valid and reliable.

Validity and reliability of the Mini-Osteoarthritis Knee and Hip Quality of Life scale in Turkish population

Objectives

This study aims to investigate the validity and reliability of the Turkish version of the Mini-Osteoarthritis Knee and Hip Quality of Life (Mini-OAKHQoL) scale developed to assess the quality of life (QoL) in patients with knee and/or hip osteoarthritis.

Patients and methods

Between May 2018 and May 2020, a total of 83 patients (11 males, 72 females; mean age: 58.1±10.0 years; range, 39 to 81 years) with knee and/or hip osteoarthritis were included. Demographic, clinical, and survey data (Mini-OAKHQoL, Nottingham Health Profile, Short Form-36, Western Ontario and McMaster Universities Osteoarthritis Index, Lequesne Index, and Visual Analog Scale of pain intensity) were recorded. Missing data, floor effect, and ceiling effect were calculated. For reliability analysis, internal consistency and test-retest reliability were discovered. Face, content, convergent, and divergent validities were applied.

Results

Among the patients, 52 (62.65%) had knee osteoarthritis, 26 (31.32%) had hip osteoarthritis, and five (6.02%) had both. Mini-OAKHQoL had a good face and content validity. The average item completion rate was 96.9%, with the time needed to perform was about 4 min. None of the subscales of Mini-OAKHQoL presented floor or ceiling effect, with a good range of responses. The Cronbach alpha coefficients and intraclass correlation coefficient (ICC) analysis of the subscales ranged from 0.927 to 0.676 and 0.987 to 0.843, respectively. Regarding convergent validity, the physical activities, mental health, and pain subscales of Mini-OAKHQoL had moderate to high correlations with the topic-related subset of the other QoL surveys. There were no or weak correlations between Mini-OAKHQoL and non-QoL parameters, indicating its divergent validity.

Conclusion

The Turkish version of Mini-OAKHQoL is a valid, reliable, simple, practical, accurate, completable, comprehensive, and disease-specific self-report instrument to assess QoL in patients with knee and/or hip osteoarthritis.

Persistence and Attrition among Participants in a Multi-Page Online Survey Recruited via Reddit’s Social Media Network

Participant attrition is a major concern for the validity of longer or complex surveys. Unlike paper-based surveys, which may be discarded even if partially completed, multi-page online surveys capture responses from all completed pages until the time of abandonment. This can result in different item response rates, with pages earlier in the sequence showing more completions than later pages. Using data from a multi-page online survey administered to cohorts recruited on Reddit, this paper analyses the pattern of attrition at various stages of the survey instrument and examines the effects of survey length, time investment, survey format and complexity, and survey delivery on participant attrition. The participant attrition rate (PAR) differed between cohorts, with cohorts drawn from Reddit showing a higher PAR than cohorts targeted by other means. Common to all was that the PAR was higher among younger respondents and among men. Changes in survey question design resulted in the greatest rise in PAR irrespective of age, gender or cohort.

Changes in Digital Media Use and Physical Activity in German Young Adults under the Covid-19 Pandemic - A Cross-Sectional Study

Many studies observed a reduction of physical activity (PA) and an increase in digital media use in young adults during the COVID-19 pandemic. However, few studies have been conducted in Europe or looked at changes in the association between both behaviors. Hence, this study aims at investigating the changes in digital media use/social media use and PA as well as in its association among young adults in Germany. Cross-sectional data of 884 German young adults (mean age 22.36 (±1.99), 76% female) collected via an online questionnaire between August 1 and September 30, 2020 were analyzed. Participants reported on digital media use (smartphone, television, computer, gaming console), social media use (Facebook, Instagram, Snapchat, Twitter, YouTube, TikTok) and PA (days/week of ≥30 min. PA) separately for the period of strict infection control measures in Germany (March - end of May 2020) and for normal times (before March 2020). Descriptive statistics of digital media use, social media use and PA were compared between both periods. Linear regression adjusted for sociodemographic and work-related characteristics were conducted for both periods with total media use, the various media devices and social media use, respectively, as independent and PA as dependent variables. Whereas PA did not differ between both periods, mean total digital media use increased by 1 hour during the period of strict infection control measures. Digital media use and social media use were negatively associated with PA in both time periods. Differences in these associations by sex could be found for some digital media devices. However, 60% of respondents did not comply with the WHO recommendations for PA. Under consideration of possible recall bias, young adults' digital media use, but not PA, seemed to have changed under the strict infection control measures. However, interventions are needed to increase PA and to prevent its reduction in the course of the pandemic.

Childhood Disintegrative Disorder (CDD): Symptomatology of the Norwegian Patient Population and Parents' Experiences of Patient Regression

Childhood Disintegrative Disorder (CDD) is a rare and little researched developmental disorder characterised by regression in language and social skills after a period of seemingly normal development until at least the age of 2 years. The study contacted all parents of CDD patients in Norway to assess patient symptomatology and parents’ experiences of regression via questionnaire or interview. There were 12 participants. Symptomatology was in-line with previous studies, with universal regression in language and social skills and onset predominantly at 2–4 years. Regression was connected to feelings of ‘loss’ and uncertainty over the prognosis for CDD patients. The study supported CDD diagnostic criteria and showed that CDD patient regression has profound implications for parental well-being.

Promoting patient followup treatment with intra-detrusor onabotulinumtoxinA for overactive bladder

INTRODUCTION

We aimed to characterize patient-related factors that promote followup of repeat onabotulinumtoxinA treatments for overactive bladder via a mixed-methods approach.

METHODS

A retrospective chart review was conducted for patients who received intra-detrusor injection of onabotulinumtoxinA at our institution from 2011-2018, who were then surveyed to evaluate their experience, knowledge, and perceptions regarding onabotulinumtoxinA treatment and followup. Patients who received one onabotulinumtoxinA treatment and patients who underwent multiple treatments were compared to assess followup rates following initial treatment, group characteristics, patient comfort, and patient knowledge of needed retreatment.

RESULTS

A total of 29.3% of patients received a single treatment and 70.7% of patients received multiple treatments. There was no difference in clinical, demographic, or intake variables between groups. Patients receiving multiple treatments reported having their first procedure in the operating room and reported greater improvement in symptoms and procedure comfort. This group was also more likely to understand that repeat treatments are necessary than those undergoing one treatment.

CONCLUSIONS

No research to date has systematically explored patient-reported factors that promote retreatment of onabotulinumtoxinA for overactive bladder. This novel, mixed-methods approach indicates that patient comfort and patient knowledge were the strongest predictors of previous retreatment and anticipated retreatment, suggesting concrete avenues for improved periprocedural patient counselling and education.

Investigating Ethnic Disparity in Living-Donor Kidney Transplantation in the UK: Patient-Identified Reasons for Non-Donation among Family Members

There is ethnic inequity in access to living-donor kidney transplants in the UK. This study asked kidney patients from Black, Asian and minority ethnic groups why members of their family were not able to be living kidney donors. Responses were compared with responses from White individuals. This questionnaire-based mixed-methods study included adults transplanted between 1/4/13-31/3/17 at 14 UK hospitals. Participants were asked to indicate why relatives could not donate, selecting all options applicable from: Age; Health; Weight; Location; Financial/Cost; Job; Blood group; No-one to care for them after donation. A box entitled 'Other-please give details' was provided for free-text entries. Multivariable logistic regression was used to analyse the association between the likelihood of selecting each reason for non-donation and the participant's self-reported ethnicity. Qualitative responses were analysed using inductive thematic analysis. In total, 1240 questionnaires were returned (40% response). There was strong evidence that Black, Asian and minority ethnic group individuals were more likely than White people to indicate that family members lived too far away to donate (adjusted odds ratio (aOR) = 3.25, 95% Confidence Interval (CI) 2.30-4.58), were prevented from donating by financial concerns (aOR = 2.95, 95% CI 2.02-4.29), were unable to take time off work (aOR = 1.88, 95% CI 1.18-3.02), were "not the right blood group" (aOR = 1.65, 95% CI 1.35-2.01), or had no-one to care for them post-donation (aOR = 3.73, 95% CI 2.60-5.35). Four qualitative themes were identified from responses from Black, Asian and minority ethnic group participants: 'Burden of disease within the family'; 'Differing religious interpretations'; 'Geographical concerns'; and 'A culture of silence'. Patients perceive barriers to living kidney donation in the UK Black, Asian and minority ethnic population. If confirmed, these could be targeted by interventions to redress the observed ethnic inequity.

Differences in self-perceived general health, pain, and depression 1 to 5 years post-stroke related to work status at 1 year

Stroke is one of the most common diseases and has several potential consequences, such as psychological problems and pain. Return to work (RTW) after stroke in working-age individuals is incomplete. The present study aimed to investigate differences in self-perceived general health, pain, and depression between 1 and 5 years post-stroke related to RTW status. The study was nationwide, registry-based and the study population (n = 398) consisted of working-age people who had a stroke in 2011 and participated in 1-year and 5-year follow-up questionnaire surveys. Shift analyses with the Wilcoxon signed rank test and logistic regression were used. RTW within the first year post-stroke was associated with better self-perceived general health, less pain, and less depression both at 1 and 5 years post-stroke, compared with the no-RTW group. However, the RTW group had significant deterioration in general health and pain between 1 and 5 years, while the no-RTW group had no significant change. RTW was a significant predictor of lower odds of improvement in general health and pain between 1 and 5 years. This emphasizes the need for continued follow-up and support to ensure a balance between work and health for RTW individuals after stroke.

Unconditional and conditional monetary incentives to increase response to mailed questionnaires: A randomized controlled study within a trial (SWAT)

RATIONALE, AIMS, AND OBJECTIVES

High response rates to research questionnaires can help to ensure results are more representative of the population studied and provide increased statistical power, on which the study may have been predicated. Improving speed and quality of response can reduce costs.

METHOD

We conducted a randomized study within a trial (SWAT) to assess questionnaire response rates, reminders sent, and data completeness with unconditional compared with conditional monetary incentives. Eligible individuals were mailed a series of psychological questionnaires as a follow-up to a baseline host trial questionnaire. Half received a £5 gift voucher with questionnaires (unconditional), and half were promised the voucher after returning questionnaires (conditional).

RESULTS

Of 1079 individuals, response rates to the first follow-up questionnaire were 94.2% and 91.7% in the unconditional and conditional monetary incentive groups, respectively (OR 1.78; 95% CI, 0.85-3.72). There were significantly greater odds of returning repeat questionnaires in the unconditional group at 6 months (OR 2.97; 95% CI, 1.01-8.71; .047) but not at 12 months (OR 1.12; 95% CI, 0.44-2.85). Incentive condition had no impact at any time point on the proportion of sent questionnaires that needed reminders. Odds of incomplete questionnaires were significantly greater at 3 months in the unconditional compared with the conditional incentive group (OR 2.45; 95% CI, 1.32-4.55; .004).

CONCLUSIONS

Unconditional monetary incentives can produce a transitory greater likelihood of mailed questionnaire response in a clinical trial participant group, consistent with the direction of effect in other settings. However, this could have been a chance finding. The use of multiple strategies to promote response may have created a ceiling effect. This strategy has potential to reduce administrative and postage costs, weighed against the cost of incentives used, but could risk compromising the completeness of data.

Mediators of Socioeconomic Inequity in Living-donor Kidney Transplantation: Results From a UK Multicenter Case-Control Study

Supplemental Digital Content is available in the text.

There is evidence of socioeconomic inequity in access to living-donor kidney transplantation, but limited evidence as to why. We investigated possible mediators of the inequity.

Links between self-injury and suicidality in autism

BACKGROUND

Autistic individuals without intellectual disability are at heightened risk of self-injury, and appear to engage in it for similar reasons as non-autistic people. A wide divergence of autistic perspectives on self-injury, including those who frame it as a helpful coping mechanism, motivate investigating the link between self-injury, suicide ideation, and attempts which has been reported in typically developing individuals.

METHOD

One hundred three autistic participants completed the Non-Suicidal Self-Injury Assessment Tool (NSSI-AT), the Suicide Behaviors Questionnaire (SBQ-R), and the Interpersonal Social Evaluation List (ISEL-12) across two online studies. Logistic regression was conducted to predict self-harming status via responses to questions on suicidality, and to predict whether certain self-injurious behaviors, including cutting, were especially associated with suicide ideation and attempts. Non-parametric correlation analysis examined relationships between suicide ideation/attempts and other variables that might characterize self-harmers especially at risk of suicidality. These included perceived access to social support, purposes or reasons for self-injury, the number of different self-injurious behaviors engaged in, the duration and lifetime incidence of self-injury, and the individual's feelings about their self-injury.

RESULTS

While self-injuring status was significantly predicted by responses to a question on suicide ideation and attempts, there was no relationship between suicide ideation/attempts and a participant's personal feelings about their self-injury. The method of cutting was also predicted by suicide ideation and attempts, though other methods common in autistic people were at borderline significance. Use of self-injury for the regulation of low-energy emotional states like depression, for self-punishment or deterrence from suicide, and for sensory stimulation, was associated with suicide ideation and attempts, as was the number of self-injurious behaviors engaged in. There was no significant relationship between suicide ideation/attempts and the duration and lifetime incidence of self-injury or social support.

CONCLUSIONS

These preliminary data suggest that while individuals might frame their self-injury as a positive or neutral thing, there remains a concerning relationship between self-injury and suicidality which exists regardless of individual feelings on self-injury. This is consistent with the theoretical perspective that self-injury can be a "gateway" through which individuals acquire capability for lethal suicidal behaviors. The data highlight that particular methods (cutting) and reasons for self-injury may be of significant concern, but this information, which might be of extreme value for clinicians, requires further investigation and validation.

Beliefs of UK Transplant Recipients about Living Kidney Donation and Transplantation: Findings from a Multicentre Questionnaire-Based Case-Control Study

Differing beliefs about the acceptability of living-donor kidney transplants (LDKTs) have been proposed as explaining age, ethnic and socioeconomic disparities in their uptake. We investigated whether certain patient groups hold beliefs incompatible with LDKTs. This questionnaire-based case-control study was based at 14 hospitals in the United Kingdom. Participants were adults transplanted between 1 April 2013 and 31 March 2017. LDKT recipients were compared to deceased-donor kidney transplant (DDKT) recipients. Beliefs were determined by the direction and strength of agreement with ten statements. Multivariable logistic regression was used to investigate the association between beliefs and LDKT versus DDKT. Sex, age, ethnicity, religion, and education were investigated as predictors of beliefs. A total of 1240 questionnaires were returned (40% response). DDKT and LDKT recipients responded in the same direction for 9/10 statements. A greater strength of agreement with statements concerning the 'positive psychosocial effects' of living kidney donation predicted having an LDKT over a DDKT. Older age, Black, Asian and Minority Ethnic (BAME) group ethnicity, and having a religion other than Christianity were associated with greater degree of uncertainty regarding a number of statements, but there was no evidence that individuals in these groups hold strong beliefs against living kidney donation and transplantation. Interventions should address uncertainty, to increase LDKT activity in these groups.

Cancer survivors who fully participate in the PROFILES registry have better health-related quality of life than those who drop out

Purpose

Attrition and subsequent missing data pose a challenge in longitudinal research in oncology. This study examined factors associated with attrition in the PROFILES registry, and its impact on observed health-related quality of life (HRQOL) estimates.

Methods

Sociodemographic, clinical, and HRQOL data were collected annually from a cohort of 2625 colorectal cancer survivors between 2010 and 2015. Participant characteristics according to time of dropout were compared using analysis of variance and chi-square tests. Predictors of attrition were examined in logistic regression analysis. Multilevel linear mixed models were constructed to investigate associations between attrition and HRQOL over time.

Results

Participants who dropped out were more likely to be female (OR = 1.23, CI = 1.02–1.47), older (OR = 1.20, CI = 1.09–1.33), less educated (OR = 1.64, CI = 1.30–2.11), and to have depressive symptoms (OR = 1.84, CI = 1.39–2.44) than full responders, and less likely to have high socioeconomic status (OR = 0.74, CI = 0.61–0.94). Participants who dropped out earlier reported significantly worse HRQOL, functioning, and psychosocial symptoms, which declined at a steeper rate over time, than full responders.

Conclusions

Cancer survivors’ HRQOL may be overestimated in longitudinal research due to attrition of the most unwell participants.

Implications for Cancer Survivors

Cancer survivors with the poorest health are at risk of dropping out of PROFILES and possibly withdrawing from other activities. Optimizing participation in PROFILES—a potential mechanism for providing information and access to support—is an avenue for keeping this group engaged.

Electronic supplementary material

The online version of this article (10.1007/s11764-019-00793-7) contains supplementary material, which is available to authorized users.

Methods to increase response rates to a population-based maternity survey: a comparison of two pilot studies

Background

Surveys are established methods for collecting population data that are unavailable from other sources; however, response rates to surveys are declining. A number of methods have been identified to increase survey returns yet response rates remain low. This paper evaluates the impact of five selected methods on the response rate to pilot surveys, conducted prior to a large-scale National Maternity Survey in England.

Methods

The pilot national maternity surveys were cross-sectional population-based questionnaire surveys of women who were three months postpartum selected at random from birth registrations. Women received a postal questionnaire, which they could complete on paper, online or verbally over the telephone. An initial pilot survey was conducted (pilot 1, n = 1000) to which the response rate was lower than expected. Therefore, a further pilot survey was conducted (pilot 2, n = 2000) using additional selected methods with the specific aim of increasing the response rate. The additional selected methods used for all women in pilot 2 were: pre-notification, a shorter questionnaire, more personable survey materials, an additional reminder, and inclusion of quick response (QR) codes to enable faster access to the online version of the survey. To assess the impact of the selected methods, response rates to pilot surveys 1 and 2 were compared.

Results

The response rate increased significantly from 28.7% in pilot 1 to 33.1% in pilot 2 (+ 4.4%, 95%CI:0.88–7.83, p = 0.02). Analysis of weekly returns according to time from initial and reminder mail-outs suggests that this increase was largely due to the additional reminder. Most respondents completed the paper questionnaire rather than taking part online or over the telephone in both pilot surveys. However, the overall response to the online questionnaire almost doubled from 1.8% in pilot 1 to 3.5% in pilot 2, corresponding to an absolute difference of 1.7% (95%CI:0.45–2.81, p = 0.01), suggesting that QR codes might have facilitated online participation.

Conclusions

Declining survey response rates may be ameliorated with the use of selected methods. Further studies should evaluate the effectiveness of each of these methods using randomised controlled trials and identify novel strategies for engaging populations in survey research.

Electronic supplementary material

The online version of this article (10.1186/s12874-019-0702-3) contains supplementary material, which is available to authorized users.

The effect of a voucher incentive on a survey response rate in the clinical setting: a quasi-randomized controlled trial

Background

Financial rewards have been shown to be an important motivator to include normal healthy volunteers in trials. Less emphasis has been put on non-healthy volunteers. No previous study has investigated the impact of a voucher incentive for participants in a cross-sectional study in a clinical setting. The objective of this study was to examine the impact of a small voucher incentive on a survey response rate in a clinical setting at the point-of-care in a quasi-randomized controlled trial (q-RCT).

Methods

This was an ancillary study to a survey of patients subsequent to their appointment with a physician investigating physician-patient communication. We randomized participants to receive or not receive a voucher for a coffee (costs: 1 €) enclosed in the survey package. Alternation of groups was performed on a weekly basis. The exact Chi-square test was used to compare response rates between study arms.

Results

In total, 472 participants received the survey package. Among them, 249 participants were quasi-randomized to the voucher arm and 223 to the control group. The total response rate was 46%. The response rates were 48% in the voucher arm and 44% in the control group. The corresponding risk ratio was 1.09 (95% CI: 0.89, 1.32).

Conclusions

A small voucher incentive to increase the response rate in a survey investigating physician-patient communication was unlikely to have an impact. It can be speculated whether the magnitude of the voucher was too low to generate an impact. This should be further investigated in future real-world studies.

[High pain expectation and impairment from pre-existing pain are risk factors for severe postoperative pain : Results of a study using the Lübeck Pain Risk Questionnaire]

BACKGROUND

The intensity of postoperative pain is characterized by large interindividual variability. Furthermore, strong postoperative pain is known to influence physical recovery after surgery. High (preoperative) pain expectation and pre-existing pain, which are associated with pain-related disability (impairing pain) are risk factors for strong postoperative pain. They can be determined with the Lübeck Pain Risk Questionnaire used for the first time in this study. The aim of this study was to explore the hypothesis that patients with a combination of the characteristics (1) preoperative impairing pain and (2) high pain expectation are more likely to have strong postoperative pain. Patients with these characteristics represent a unique group of patients and are more likely to develop distinct postoperative pain and can therefore be characterized as a risk group.

MATERIAL AND METHODS

A total of 501 patients at the departments of general surgery, plastic surgery, trauma surgery and orthopedic surgery of the UKSH Campus Lübeck were included in this study. All underwent elective surgery. Study patients were 18 years and older. Those needing postoperative treatment in an intensive care unit were excluded from this study (n = 18). The characteristics "preoperative pain" and "pain expectation" were measured with the Lübeck Pain Risk Questionnaire the day before surgery. The primary outcome variable was the average postoperative pain intensity, which was measured with a numeric rating scale (NRS 0-10) and scores > 4 were defined as severe pain.

RESULTS

The NRS range for "preoperative pain" was subdivided as follows: "no pain" (NRS = 0), "functional pain" (NRS = 1-3), and "impairing pain" (NRS = 4-10); that for "pain expectation" as: "low expectation" (NRS = 0-4) and "high expectation" (NRS = 5-10). To determine these cut-off points, they were varied from > 1 to > 8 and those with highest effect size for strong postoperative pain were chosen. Patients with a high pain expectation had significantly stronger postoperative pain (p < 0.001) and significantly more often higher pain intensity than patients with a low expectation (53.3% vs. 20.6%, respectively, p < 0.001). Patients with pre-existing impairing pain had significantly stronger and more frequently higher postoperative pain than patients with pre-existing functional pain (43.4% vs. 18.4%, p < 0.05). Patients with a combination of the factors "preoperative impairing pain" and "high pain expectation" showed distinct postoperative pain with NRS > 4 significantly more often (59.4%, p < 0.001). These findings could be demonstrated for the departments general surgery, plastic surgery and trauma surgery.

CONCLUSION

The combination of both risk factors results in a unique risk group for the appearance of strong postoperative pain. This group can be economically determined in the daily clinical routine using the Lübeck Pain Risk Questionnaire. Further studies must be carried out to show if additional perioperative procedures can be profitable for the risk group identified with the Lübeck Pain Risk Questionnaire; however, patients falling outside the risk group must not be neglected because they too can develop severe postoperative pain.

Most response-inducing strategies do not increase participation in observational studies: a systematic review and meta-analysis

OBJECTIVES

To evaluate response-inducing strategies for observational studies using health-related questionnaires or interviews.

STUDY DESIGN AND SETTING

We searched PubMed, EMBASE, CINAHL, PsycINFO, and Web of Science up to December 28, 2017. Studies evaluating the effect of a response-inducing strategy on participation rates of observational studies were included. For each strategy, we estimated pooled response ratios with 95% confidence intervals (CIs) in a Hartung-Knapp/Sidik-Jonkman random effects model with the final participation rate as outcome, stratified for type of participants and method of data collection.

RESULTS

The search yielded 168 eligible studies involving 367,616 potential participants and 33 strategies. Among patients, response-inducing strategies for paper-based questionnaires included unconditional monetary incentives (response ratio 1.15; 95% CI 1.09-1.21) and shorter questionnaires (1.04; 1.02-1.06). Among nonpatients, a personalized mode of delivery (1.47; 1.24-1.74), more expensive mailing type (1.25; 1.00-1.56), unconditional monetary incentives (1.24; 1.12-1.38), prenotification (1.12; 1.03-1.22), unconditional scratch lottery tickets (1.09; 1.01-1.18), and shorter questionnaires (1.06; 1.02-1.11) increased response rates to paper-based questionnaires. For Web-based questionnaires and interviews among nonpatients, response rates were increased by conditional lottery tickets (1.17; 1.02-1.34) and conditional monetary incentives (1.39; 1.01-1.91), respectively.

CONCLUSION

Although the majority of strategies evaluated were unsuccessful, some may increase response rates to observational studies, particularly among nonpatients.

Using survey methods in telehealth research: A practical guide

Surveys are a common method for assessing patient and clinician perceptions, attitudes and outcomes of telehealth. However, inadequacies in both the conduct and reporting of survey studies are common in telehealth research. This article provides clinicians and researchers with practical guidance on the appropriate selection, use and reporting of survey tools for telehealth research. We identify common survey outcomes and instruments used in telehealth research, and methods to assess the validity and psychometric properties of survey tools. Enhancing the quality and reporting of telehealth research is important to improve our understanding of which telehealth-supported models of care improve outcomes and for which patient groups.