SMS text pre-notification and delivery of reminder e-mails to increase response rates to postal questionnaires in the SUSPEND trial: a factorial design, randomised controlled trial

The Impact of Text Messaging to Promote Patient Reported Outcome Measures (PROMs) Completion in Orthopedic Practice: Findings From a Randomized Controlled Study

It is difficult to achieve high response rates to Patient Reported Outcome Measures (PROMs) surveys collected as part of clinical care. However, they are operationally and clinically important. To understand the impact of text message reminders on response rates to PROMs collected via email as part of routine care for hip or knee replacement surgery, initial nonresponders were randomized to receive a text reminder or not at 7 and 12 days, if needed. At day 7, the overall survey response rate was 63%. Model-derived estimates for survey return after this point were 51.1% (95% confidence interval [CI], 48.0%-54.2%) in the text arm compared to 34.5% (95% CI, 31.6%-37.6%) in the no text arm. The effect of text messages on response rates did not vary by subpopulations considered nor were there differences in rates of key outcomes between the 2 groups, suggesting that it did not impact any underlying response bias. Given the relative low cost of text messages, they can be an efficient means to increase response rates.

Methods to increase response to postal and electronic questionnaires

BACKGROUND

Self-administered questionnaires are widely used to collect data in epidemiological research, but non-response reduces the effective sample size and can introduce bias. Finding ways to increase response to postal and electronic questionnaires would improve the quality of epidemiological research.

OBJECTIVES

To identify effective strategies to increase response to postal and electronic questionnaires.

SEARCH METHODS

We searched 14 electronic databases up to December 2021 and manually searched the reference lists of relevant trials and reviews. We contacted the authors of all trials or reviews to ask about unpublished trials; where necessary, we also contacted authors to confirm the methods of allocation used and to clarify results presented.

SELECTION CRITERIA

Randomised trials of methods to increase response to postal or electronic questionnaires. We assessed the eligibility of each trial using pre-defined criteria.

DATA COLLECTION AND ANALYSIS

We extracted data on the trial participants, the intervention, the number randomised to intervention and comparison groups and allocation concealment. For each strategy, we estimated pooled odds ratios (OR) and 95% confidence intervals (CI) in a random-effects model. We assessed evidence for selection bias using Egger's weighted regression method and Begg's rank correlation test and funnel plot. We assessed heterogeneity amongst trial odds ratios using a Chi2 test and quantified the degree of inconsistency between trial results using the I2 statistic.

MAIN RESULTS

Postal We found 670 eligible trials that evaluated over 100 different strategies of increasing response to postal questionnaires. We found substantial heterogeneity amongst trial results in half of the strategies. The odds of response almost doubled when: using monetary incentives (odds ratio (OR) 1.86; 95% confidence interval (CI) 1.73 to 1.99; heterogeneity I2 = 85%); using a telephone reminder (OR 1.96; 95% CI 1.03 to 3.74); and when clinical outcome questions were placed last (OR 2.05; 95% CI 1.00 to 4.24). The odds of response increased by about half when: using a shorter questionnaire (OR 1.58; 95% CI 1.40 to 1.78); contacting participants before sending questionnaires (OR 1.36; 95% CI 1.23 to 1.51; I2 = 87%); incentives were given with questionnaires (i.e. unconditional) rather than when given only after participants had returned their questionnaire (i.e. conditional on response) (OR 1.53; 95% CI 1.35 to 1.74); using personalised SMS reminders (OR 1.53; 95% CI 0.97 to 2.42); using a special (recorded) delivery service (OR 1.68; 95% CI 1.36 to 2.08; I2 = 87%); using electronic reminders (OR 1.60; 95% CI 1.10 to 2.33); using intensive follow-up (OR 1.69; 95% CI 0.93 to 3.06); using a more interesting/salient questionnaire (OR 1.73; 95% CI 1.12 to 2.66); and when mentioning an obligation to respond (OR 1.61; 95% CI 1.16 to 2.22). The odds of response also increased with: non-monetary incentives (OR 1.16; 95% CI 1.11 to 1.21; I2 = 80%); a larger monetary incentive (OR 1.24; 95% CI 1.15 to 1.33); a larger non-monetary incentive (OR 1.15; 95% CI 1.00 to 1.33); when a pen was included (OR 1.44; 95% CI 1.38 to 1.50); using personalised materials (OR 1.15; 95% CI 1.09 to 1.21; I2 = 57%); using a single-sided rather than a double-sided questionnaire (OR 1.13; 95% CI 1.02 to 1.25); using stamped return envelopes rather than franked return envelopes (OR 1.23; 95% CI 1.13 to 1.33; I2 = 69%), assuring confidentiality (OR 1.33; 95% CI 1.24 to 1.42); using first-class outward mailing (OR 1.11; 95% CI 1.02 to 1.21); and when questionnaires originated from a university (OR 1.32; 95% CI 1.13 to 1.54). The odds of response were reduced when the questionnaire included questions of a sensitive nature (OR 0.94; 95% CI 0.88 to 1.00). Electronic We found 88 eligible trials that evaluated over 30 different ways of increasing response to electronic questionnaires. We found substantial heterogeneity amongst trial results in half of the strategies. The odds of response tripled when: using a brief letter rather than a detailed letter (OR 3.26; 95% CI 1.79 to 5.94); and when a picture was included in an email (OR 3.05; 95% CI 1.84 to 5.06; I2 = 19%). The odds of response almost doubled when: using monetary incentives (OR 1.88; 95% CI 1.31 to 2.71; I2 = 79%); and using a more interesting topic (OR 1.85; 95% CI 1.52 to 2.26). The odds of response increased by half when: using non-monetary incentives (OR 1.60; 95% CI 1.25 to 2.05); using shorter e-questionnaires (OR 1.51; 95% CI 1.06 to 2.16; I2 = 94%); and using a more interesting e-questionnaire (OR 1.85; 95% CI 1.52 to 2.26). The odds of response increased by a third when: offering survey results as an incentive (OR 1.36; 95% CI 1.16 to 1.59); using a white background (OR 1.31; 95% CI 1.10 to 1.56); and when stressing the benefits to society of response (OR 1.38; 95% CI 1.07 to 1.78; I2 = 41%). The odds of response also increased with: personalised e-questionnaires (OR 1.24; 95% CI 1.17 to 1.32; I2 = 41%); using a simple header (OR 1.23; 95% CI 1.03 to 1.48); giving a deadline (OR 1.18; 95% CI 1.03 to 1.34); and by giving a longer time estimate for completion (OR 1.25; 95% CI 0.96 to 1.64). The odds of response were reduced when: "Survey" was mentioned in the e-mail subject (OR 0.81; 95% CI 0.67 to 0.97); when the email or the e-questionnaire was from a male investigator, or it included a male signature (OR 0.55; 95% CI 0.38 to 0.80); and by using university sponsorship (OR 0.84; 95%CI 0.69 to 1.01). The odds of response using a postal questionnaire were over twice those using an e-questionnaire (OR 2.33; 95% CI 2.25 to 2.42; I2 = 98%). Response also increased when: providing a choice of response mode (electronic or postal) rather than electronic only (OR 1.76 95% CI 1.67 to 1.85; I2 = 97%); and when administering the e-questionnaire by computer rather than by smartphone (OR 1.62 95% CI 1.36 to 1.94).

AUTHORS' CONCLUSIONS

Researchers using postal and electronic questionnaires can increase response using the strategies shown to be effective in this Cochrane review.

Pre-notifications increase retention in a 17-year follow-up of adolescents born very preterm

OBJECTIVE

Retention is essential in follow-up studies to reduce missing data, which can cause bias and limit the generalizability of the results. We investigated whether pre-notification letters would increase the response rates of approval forms and questionnaires and reduce the need for post-notifications in a prospective follow-up study of 17-year-old adolescents.

STUDY DESIGN

and settings This long-term follow-up study included 269 adolescents were randomized (1:1) into a pre-notification group (n = 132) and a no pre-notification group (n = 137). The pre-notification letter was sent prior to the approval form and questionnaires. The outcome measures were the response rates to the approval forms and questionnaires and the rate of post-notifications required.

RESULTS

The adolescents who received the pre-notifications were more likely to return approval forms (n = 88/132, 67%) than the adolescents who did not receive the pre-notifications (n = 79/137, 58%) (OR 1.5, 95% CI 0.9-2.4). The rates of returned questionnaires were higher in the pre-notification group (n = 82/88, 93%) than in the no pre-notification group (n = 68/79, 86%) (OR 2.2, 95% CI 0.8-6.3). The adolescents who did not receive the pre-notifications were more likely to need the post-notifications than the adolescents who received the pre-notifications (OR 3.0, 95% CI 1.4 to 6.5).

CONCLUSIONS

Pre-notifications decreased the need for post-notifications and may increase retention in 17-year-old adolescents. Based on our findings, pre-notification letters are recommended in future follow-up studies in adolescents.

TRIAL REGISTRATION

The Ethics Review Committee of the Hospital District of South-West Finland approved the 17-year PIPARI Study protocol in January 2018 (23.1.2018; 2/180/2012). The study has been registered to the SWAT repository as SWAT 179. Filetoupload,1457904,en.pdf (qub.ac.uk).

An exploratory cross-sectional study of the effects of ongoing relationships with accompanying patients on cancer care experience, self-efficacy, and psychological distress

BACKGROUND

Centre hospitalier de l'Université de Montréal in Canada introduced accompanying patients (APs) into the breast cancer care trajectory. APs are patients who have been treated for breast cancer and have been integrated into the clinical team to expand the services offered to people affected by cancer. This study describes the profiles of the people who received the support and explores whether one-offs vs ongoing encounters with APs influence their experience of care, on self-efficacy in coping with cancer, and on their level of psychological distress.

METHODS

An exploratory cross-sectional study was carried out among patients to compare patients who had one encounter with an AP (G1) with those who had had several encounters (G2). Five questionnaires were administered on socio-demographic characteristics, care pathway, evaluation of the support experience, self-efficacy in coping with cancer, and level of psychological distress. Logbooks, completed by the APs, determined the number of encounters. Linear regression models were used to evaluate the associations between the number of encounters, patient characteristics, care pathway, number of topics discussed, self-efficacy measures in coping with cancer, and level of psychological distress.

RESULTS

Between April 2020 and December 2021, 60% of 535 patients who were offered support from an AP accepted. Of these, one hundred and twenty-four patients participated in the study. The study aimed to recruit a minimum of 70 patients with the expectation of obtaining at least 50 participants, assuming a response rate of 70%. There were no differences between G1 and G2 in terms of sociodemographic data and care pathways. Statistical differences were found between G1 and G2 for impacts on and the return to daily life (p = 0.000), the return to the work and impacts on professional life (p = 0.044), announcement of a diagnosis to family and friends (p = 0.033), and strategies for living with treatment under the best conditions (p = 0.000). Significant differences were found on the topics of cancer (p = 0.000), genetic testing (p = 0.023), therapeutic options (p = 0.000), fatigue following treatment (p = 0.005), pain and discomfort after treatment or surgery (p = 0.000), potential emotions and their management (p = 0.000) and the decision-making processes (p = 0.011). A significant relationship was found between the two groups for patients' ability to cope with cancer (p = 0.038), and their level of psychological distress at different stages of the care pathway (p = 0.024).

CONCLUSIONS

This study shows differences between one-time and ongoing support for cancer patients. It highlights the potential for APs to help patients develop self-efficacy and cope with the challenges of cancer treatment.

Does advance contact with research participants increase response to questionnaires: an updated systematic review and meta-analysis

Background

Questionnaires remain one of the most common forms of data collection in epidemiology, psychology and other human-sciences. However, results can be badly affected by non-response. One way to potentially reduce non-response is by sending potential study participants advance communication. The last systematic review to examine the effect of questionnaire pre-notification on response is 10 years old, and lacked a risk of bias assessment.

Objectives

Update the section of the Cochrane systematic review, Edwards et al. (2009), on pre-notification to include 1) recently published studies, 2) an assessment of risk of bias, 3) Explore if heterogeneity is reduced by: delay between pre-contact and questionnaire delivery, the method of pre-contact, if pre-contact and questionnaire delivery differ, if the pre-contact includes a foot-in-the-door manipulation, and study’s the risk of bias.

Methods

Inclusion criteria: population: any population, intervention: comparison of some type of pre-notification, comparison group: no pre-notification, outcome: response rates. Study design: randomised controlled trails. Exclusion criteria: NA. Data sources: Studies which cited or were included in Edwards et al. (2009); We additionally searched: CINAHL, Web of Science, PsycInfo, MEDLINE, EconLit, EMBASE, Cochrane Central, Cochrane CMR, ERIC, and Sociological Abstracts. The searches were implemented in June 2018 and May 2021. Study screening: a single reviewer screened studies, with a random 10% sample independently screened to ascertain accuracy. Data extraction: data was extracted by a single reviewer twice, with a week between each extraction. Risk of Bias: within studies bias was assessed using the Cochrane Risk of Bias tool (ROB1) by a single unblinded reviewer, across studies bias was assessed using funnel plots. Synthesis Method: study results were meta-analysed with a random effects model using the final response rate as the outcome. Evaluation of Uncertainty: Uncertainty was evaluated using the GRADE approach.

Results

One hundred seven trials were included with 211,802 participants. Over-all pre-notification increased response, OR = 1.33 (95% CI: 1.20–1.47). However, there was a large amount of heterogeneity (I² = 97.1%), which was not explained by the subgroup analyses. In addition, when studies at high or unclear risk of bias were excluded the effect was to reduced OR = 1.09 (95% CI: 0.99–1.20). Because of the large amount of heterogeneity, even after restricting to low risk of bias studies, there is still moderate uncertainty in these results.

Conclusions

Using the GRADE evaluation, this review finds moderate evidence that pre-notification may not have an effect on response rates.

Funding

Economic and Social Research Council.

Preregistration

None.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12874-021-01435-2.

Randomised study within a trial (SWAT) to evaluate personalised versus standard text message prompts for increasing trial participant response to postal questionnaires (PROMPTS)

BACKGROUND

Use of a person's name in a text message has been shown to be effective in instigating behaviour change. We evaluated the effectiveness of a personalised text message (including the recipient's name) versus a standardised text message for prompting a response from trial participants to complete and return postal follow-up questionnaires.

METHODS

Using a randomised study within a trial (SWAT) embedded within the host GRASP (Getting it Right: Addressing Shoulder Pain) trial, participants who provided a mobile telephone number were randomised (1:1) by a central computer system to receive either (1) a personalised text message which included their name or (2) a standard text message. Text messages were sent by the trial office on the same day as the 6-month GRASP follow-up questionnaire. The primary outcome was questionnaire response rate, defined as the proportion of 6-month GRASP follow-up questionnaires returned by participants. Secondary outcomes included time to response, the proportion of participants sent a reminder follow-up questionnaire, and cost.

RESULTS

Between March 2017 and May 2019 (recruitment period for GRASP trial), 618 participants were randomised to a personalised (n = 309) or standard (n = 309) text message and all were included in the analysis. The overall questionnaire response rate was 87% (n = 537/618); 90% (n = 277/309) of participants responded in the personalised text message group compared to 84% (n = 260/309) in the standard text message group (relative risk (RR) 1.07; 95% CI 1.00 to 1.13). Participants randomised to receive the personalised text message were more likely to return their initial postal questionnaire than those who received the standard text message (n = 185/309; 60% vs. n = 160/309; 52%) (RR 1.16; 95% CI 1.00 to 1.33); this represents an absolute percentage difference between intervention groups of 8%. Post hoc subgroup analysis showed that males under 65 years were the group most likely to return their initial questionnaire if they received a personalised text message.

CONCLUSION

Overall, participants who received a personalised text message were more likely to return their questionnaire than those who received the standard text message.

TRIAL REGISTRATION

GRASP Trial ISRCTN16539266 ; SWAT Repository ID 35.

Strategies to improve retention in randomised trials

BACKGROUND

Poor retention of participants in randomised trials can lead to missing outcome data which can introduce bias and reduce study power, affecting the generalisability, validity and reliability of results. Many strategies are used to improve retention but few have been formally evaluated.

OBJECTIVES

To quantify the effect of strategies to improve retention of participants in randomised trials and to investigate if the effect varied by trial setting.

SEARCH METHODS

We searched the Cochrane Central Register of Controlled Trials (CENTRAL), MEDLINE, Scopus, PsycINFO, CINAHL, Web of Science Core Collection (SCI-expanded, SSCI, CPSI-S, CPCI-SSH and ESCI) either directly with a specified search strategy or indirectly through the ORRCA database. We also searched the SWAT repository to identify ongoing or recently completed retention trials. We did our most recent searches in January 2020.

SELECTION CRITERIA

We included eligible randomised or quasi-randomised trials of evaluations of strategies to increase retention that were embedded in 'host' randomised trials from all disease areas and healthcare settings. We excluded studies aiming to increase treatment compliance.

DATA COLLECTION AND ANALYSIS

We extracted data on: the retention strategy being evaluated; location of study; host trial setting; method of randomisation; numbers and proportions in each intervention and comparator group. We used a risk difference (RD) and 95% confidence interval (CI) to estimate the effectiveness of the strategies to improve retention. We assessed heterogeneity between trials. We applied GRADE to determine the certainty of the evidence within each comparison.

MAIN RESULTS

We identified 70 eligible papers that reported data from 81 retention trials. We included 69 studies with more than 100,000 participants in the final meta-analyses, of which 67 studies evaluated interventions aimed at trial participants and two evaluated interventions aimed at trial staff involved in retention. All studies were in health care and most aimed to improve postal questionnaire response. Interventions were categorised into broad comparison groups: Data collection; Participants; Sites and site staff; Central study management; and Study design. These intervention groups consisted of 52 comparisons, none of which were supported by high-certainty evidence as determined by GRADE assessment. There were four comparisons presenting moderate-certainty evidence, three supporting retention (self-sampling kits, monetary reward together with reminder or prenotification and giving a pen at recruitment) and one reducing retention (inclusion of a diary with usual follow-up compared to usual follow-up alone). Of the remaining studies, 20 presented GRADE low-certainty evidence and 28 presented very low-certainty evidence. Our findings do provide a priority list for future replication studies, especially with regard to comparisons that currently rely on a single study.

AUTHORS' CONCLUSIONS

Most of the interventions we identified aimed to improve retention in the form of postal questionnaire response. There were few evaluations of ways to improve participants returning to trial sites for trial follow-up. None of the comparisons are supported by high-certainty evidence. Comparisons in the review where the evidence certainty could be improved with the addition of well-done studies should be the focus for future evaluations.

Two-by-two factorial randomised study within a trial (SWAT) to evaluate strategies for follow-up in a randomised prevention trial

BACKGROUND

Failure to collect outcome data in randomised trials can result in bias and loss of statistical power. Further evaluations of strategies to increase retention are required. We assessed the effectiveness of two strategies for retention in a randomised prevention trial using a two-by-two factorial randomised study within a trial (SWAT).

METHODS

Parents of babies included in the host trial were randomised to (1) short message service (SMS) notification prior to sending questionnaires at 3, 6, 12 and 18 months versus no SMS notification and (2) a £10 voucher sent with the invitation letter for the primary follow-up visit at 24 months or given at the visit. The two co-primary outcomes were collection of host trial (1) questionnaire data at interim follow-up times and (2) primary outcome at 24 months during a home/clinic visit with a research nurse.

RESULTS

Between November 2014 and November 2016, 1394 participants were randomised: 350 to no SMS + voucher at visit, 345 to SMS + voucher at visit, 352 to no SMS + voucher before visit and 347 to SMS + voucher before visit. Overall questionnaire data was collected at interim follow-up times for 75% in both the group allocated to the prior SMS notification and the group allocated to no SMS notification (odds ratio (OR) SMS versus none 1.02, 95% CI 0.83 to 1.25). Host trial primary outcome data was collected at a visit for 557 (80%) allocated to the voucher before the visit in the invitation letter and for 566 (81%) whose parents were allocated to receive the voucher at the visit (OR before versus at visit 0.89, 95% CI 0.69 to 1.17).

CONCLUSION

There was no evidence of a difference in retention according to SMS notification or voucher timing. Future synthesis of SWAT results is required to be able to detect small but important incremental effects of retention strategies.

TRIAL REGISTRATION

ISRCTN registry, ID: ISRCTN21528841. Registered on 25 July 2014. SWAT Repository Store ID 25.

Digital tools for the recruitment and retention of participants in randomised controlled trials: a systematic map

BACKGROUND

Recruiting and retaining participants in randomised controlled trials (RCTs) is challenging. Digital tools, such as social media, data mining, email or text-messaging, could improve recruitment or retention, but an overview of this research area is lacking. We aimed to systematically map the characteristics of digital recruitment and retention tools for RCTs, and the features of the comparative studies that have evaluated the effectiveness of these tools during the past 10 years.

METHODS

We searched Medline, Embase, other databases, the Internet, and relevant web sites in July 2018 to identify comparative studies of digital tools for recruiting and/or retaining participants in health RCTs. Two reviewers independently screened references against protocol-specified eligibility criteria. Included studies were coded by one reviewer with 20% checked by a second reviewer, using pre-defined keywords to describe characteristics of the studies, populations and digital tools evaluated.

RESULTS

We identified 9163 potentially relevant references, of which 104 articles reporting 105 comparative studies were included in the systematic map. The number of published studies on digital tools has doubled in the past decade, but most studies evaluated digital tools for recruitment rather than retention. The key health areas investigated were health promotion, cancers, circulatory system diseases and mental health. Few studies focussed on minority or under-served populations, and most studies were observational. The most frequently-studied digital tools were social media, Internet sites, email and tv/radio for recruitment; and email and text-messaging for retention. One quarter of the studies measured efficiency (cost per recruited or retained participant) but few studies have evaluated people's attitudes towards the use of digital tools.

CONCLUSIONS

This systematic map highlights a number of evidence gaps and may help stakeholders to identify and prioritise further research needs. In particular, there is a need for rigorous research on the efficiency of the digital tools and their impact on RCT participants and investigators, perhaps as studies-within-a-trial (SWAT) research. There is also a need for research into how digital tools may improve participant retention in RCTs which is currently underrepresented relative to recruitment research.

REGISTRATION

Not registered; based on a pre-specified protocol, peer-reviewed by the project's Advisory Board.

Timing of electronic reminders did not improve trial participant questionnaire response: a randomized trial and meta-analyses

OBJECTIVES

The objective of this study was to assess whether timing of short messaging service (SMS) reminders improved postal questionnaire return rates from participants in a randomized controlled trial (RCT).

STUDY DESIGN AND SETTING

A Study Within A Trial (SWAT) embedded in a multicenter RCT evaluating three treatments for the frozen shoulder. Participants who provided a mobile telephone number were randomized to either prenotification SMS on the day of the questionnaire mail-out or postnotification SMS 4 days after questionnaire mail-out for the 3-month follow-up. The primary outcome was the proportion of participants who returned a valid questionnaire. A systematic review was undertaken to identify other embedded trials to perform a meta-analysis.

RESULTS

Of the 269 participants, 122/135 (90.4%) returned a valid questionnaire in the prenotification arm and 119/134 (88.8%) in the postnotification arm (difference of -1.6%; 95% CI of difference: -8.9%, 5.7%). There was no difference in time to response (HR = 1.04; 95% CI: 0.80 to 1.34) or need for additional reminders (OR = 0.71; 95% CI: 0.43 to 1.17). Meta-analysis of two RCTs showed no difference in response rates between prenotification and postnotification reminders (OR = 0.78 95% CI: 0.42 to 1.45).

CONCLUSION

Timing of SMS reminders did not improve response rates and time to response or affect the need for additional reminders.

Randomized controlled comparison of cross-sectional survey approaches to optimize follow-up completeness in clinical studies

Introduction

In outcome research, incomplete follow-up is a major, yet potentially correctable source of bias. Cross-sectional surveys may theoretically increase completeness of follow-up, but low response rates are reported typically. We investigated whether a pre-notification letter improved patient availability for follow-up phone interviews and thereby improved cross-sectional survey yield.

Methods

A consecutive series of vascular patients was randomly divided into a trial and a validation population. The trial population was then randomized 1:1 to one of two cross-sectional contact strategies: Strategy 1 consisted of direct contact attempts by up to 12 systematically timed phone calls, whereas Strategy 2 used a personalized pre-notification letter to arrange for scheduled phone call interviews. Response rates, average time and efforts needed per patient and overall survey duration were compared. Subsequently, trial findings were externally validated in the validation population.

Results

Of 728 consecutive patients, 370 were allocated to the trial population. Trial patients contacted by strategy 1 (n = 183) had a similar profile when compared to trial patients contacted by strategy 2 (n = 187). Follow-up periods following surgery (54.3 versus 53.6 months) and all-cause mortality rates (21.3% versus 18.7%) were comparable between the trial groups. Cross-sectional information on survival outcomes was almost complete after both contact strategies (99.5% versus 98.9%, P = 1.0). In 144/187 strategy 2 patients (77%) interviews were scheduled successfully necessitating significantly less contact attempts (median of 1.3 versus 2.3 per patient, P<0.0001). However, invested time per patient was similar between the groups (median of 10.1 versus 9.6 minutes), and survey strategy 1 completed earlier (median time to contact 4 versus 11 days, P<0.0001). Therefore, strategy 1 was validated in the validation population (n = 358): a low lost to follow-up rate below 1% (P = 1.0) was reconfirmed necessitating an average of 2.3 contact attempts per patient.

Conclusions

Both contact strategies were equally successful in contacting almost all patients cross-sectionally. If systematically timed, direct phone calls were less complicated to organize and faster completed. Given the low time and effort per patient, outcome studies should invest in systematic follow-up surveys to minimize attrition bias.

Better Ask Than Tell: Responses to mHealth Interrogative Reminders and Associations With Colorectal Cancer Screening Subsequent Uptake in a Prospective Cohort Intervention

BACKGROUND

Text message (short message service, SMS) interrogative reminders were adopted in population screening for the early detection of colorectal cancer (CRC).

OBJECTIVE

This study aims to examine responses to text message (SMS) reminders and associate responses with senders' characteristics, message type (interrogative/declarative), and subsequent screening uptake.

METHODS

We conducted a prospective cohort intervention. Text message (SMS) reminders to undergo CRC screening, randomized into interrogative and declarative phrasing, were sent to nonadherent 40,000 women and men (age 50-74 years) at CRC average risk. We analyzed recipient responses by message phrasing, recipient characteristics, and for content, the latter predicting subsequent CRC screening per program database.

RESULTS

While interrogative text message (SMS) reminders elicited 7.67% (1475/19,227) responses, declarative ones elicited 0.76% (146/19,262) responses. Text message (SMS) responses were content analyzed and grouped into attitudes toward CRC screening (1237/1512, 81.8% positive) and intention to screen (1004/1512, 62.6%). Text message (SMS) respondents screened significantly more than nonrespondents after 6 months (415/1621, 25.6% vs 3322/36,868, 9.0%; χ12=487.5, P<.001); 1 year (340/1621, 21.0% vs 4711/36,868; χ12=91.5, P<.001); and 2 years (225/1621, 13.9% vs 3924/36,868; χ12=16.9, P<.001) following the reminders. In a multivariable logistic regression among text message (SMS) respondents, screening after 6 months was significantly predicted by older age, past sporadic screening, attitudes, and intentions.

CONCLUSIONS

Interrogative text message (SMS) reminders reached previously uninvolved sectors in the CRC target population-men, sporadic-screenees, and the "never-tested" before. This novel application resulted in a population-level, incrementally enhanced screening. Asking patients about their future health behavior may be relevant for enhancing other health behaviors in preventive medicine and clinical settings.

QUALITY OF LIFE AFTER LAPAROSCOPIC SLEEVE GASTRECTOMY USİNG BAROS SYSTEM

BACKGROUND

Laparoscopic sleeve gastrectomy (LSG) is currently the most frequently performed bariatric procedure in Turkey. The goal of weight reduction surgery is not only to decrease excess weight, but also to improve obesity related comorbidities and quality of life (QoL).

AIM

To evaluate the impact of LSG on patient quality of life, weight loss, and comorbidities associated with morbid obesity according to the updated BAROS criteria.

METHODS

Eleven hundred thirty-eight adult patients were undergone to LSG by our bariatric surgery team between January 2013 and January 2016. A questionnaire (The Bariatric Analysis and Reporting Outcome System - BAROS) was published on social media. The data on postoperative complications were collected from hospital database.

RESULTS

Number of respondants was 562 (49.4%). Six of 1138 patients(0.5%) had leakage. All patients who had leakage were respondants. The overall complication rate was 7.7%. After a mean period of 7.4±5.3 months(1-30), mean excess weight loss was 71.3±27.1% (10.2-155.4). The respondants reported 772 comorbidities. Of these, 162 (30%) were improved, and 420 (54.4%) were resolved. The mean scores for QoL were significantly increased after LSG (range, p<0.05 to <0.001). Of the 562 patients, 26 (4.6%) were classified as failures; 86 (15.3%) fair; 196 (34.9%) good; 144 (25.6%) very good, and 110 (19.6%) excellent results according to the updated BAROS scoring system.

CONCLUSION

LSG is a highly effective bariatric procedure in the manner of weight control, improvement in comorbidities and increasing of QoL in short- and mid-term.

Most response-inducing strategies do not increase participation in observational studies: a systematic review and meta-analysis

OBJECTIVES

To evaluate response-inducing strategies for observational studies using health-related questionnaires or interviews.

STUDY DESIGN AND SETTING

We searched PubMed, EMBASE, CINAHL, PsycINFO, and Web of Science up to December 28, 2017. Studies evaluating the effect of a response-inducing strategy on participation rates of observational studies were included. For each strategy, we estimated pooled response ratios with 95% confidence intervals (CIs) in a Hartung-Knapp/Sidik-Jonkman random effects model with the final participation rate as outcome, stratified for type of participants and method of data collection.

RESULTS

The search yielded 168 eligible studies involving 367,616 potential participants and 33 strategies. Among patients, response-inducing strategies for paper-based questionnaires included unconditional monetary incentives (response ratio 1.15; 95% CI 1.09-1.21) and shorter questionnaires (1.04; 1.02-1.06). Among nonpatients, a personalized mode of delivery (1.47; 1.24-1.74), more expensive mailing type (1.25; 1.00-1.56), unconditional monetary incentives (1.24; 1.12-1.38), prenotification (1.12; 1.03-1.22), unconditional scratch lottery tickets (1.09; 1.01-1.18), and shorter questionnaires (1.06; 1.02-1.11) increased response rates to paper-based questionnaires. For Web-based questionnaires and interviews among nonpatients, response rates were increased by conditional lottery tickets (1.17; 1.02-1.34) and conditional monetary incentives (1.39; 1.01-1.91), respectively.

CONCLUSION

Although the majority of strategies evaluated were unsuccessful, some may increase response rates to observational studies, particularly among nonpatients.

Patient-reported outcomes in acute myeloid leukemia: Where are we now?

Outcomes for acute myeloid leukemia remain poor, and treatment decisions must consider not just quantity, but also quality of life (QOL). We conducted a systematic review of studies in patients with acute myeloid leukemia or high-risk myelodysplastic syndrome that incorporated patient-reported outcome (PRO) measures. PubMed and PsycINFO were searched for articles published from January 2000 through June 2016. Forty-one were relevant for our review with more published in recent years. There was considerable inter-study heterogeneity in which instruments were used, and many studies employed multiple (often overlapping) instruments. Longitudinal studies in particular suffered from both high attrition rates due to disease-related mortality as well as waning compliance with questionnaire completion. There remain significant challenges to incorporation of PROs into leukemia trials. Despite these limitations, however, well-implemented PROs can provide important information beyond objective response outcomes and highlight areas of focus for clinicians caring for patients and for future research endeavors.

Best practice guidance for the use of strategies to improve retention in randomized trials developed from two consensus workshops

Objectives

To develop best practice guidance for the use of retention strategies in randomized clinical trials (RCTs).

Study Design and Setting

Consensus development workshops conducted at two UK Clinical Trials Units. Sixty-six statisticians, clinicians, RCT coordinators, research scientists, research assistants, and data managers associated with RCTs participated. The consensus development workshops were based on the consensus development conference method used to develop best practice for treatment of medical conditions. Workshops commenced with a presentation of the evidence for incentives, communication, questionnaire format, behavioral, case management, and methodological retention strategies identified by a Cochrane review and associated qualitative study. Three simultaneous group discussions followed focused on (1) how convinced the workshop participants were by the evidence for retention strategies, (2) barriers to the use of effective retention strategies, (3) types of RCT follow-up that retention strategies could be used for, and (4) strategies for future research. Summaries of each group discussion were fed back to the workshop. Coded content for both workshops was compared for agreement and disagreement. Agreed consensus on best practice guidance for retention was identified.

Results

Workshop participants agreed best practice guidance for the use of small financial incentives to improve response to postal questionnaires in RCTs. Use of second-class post was thought to be adequate for postal communication with RCT participants. The most relevant validated questionnaire was considered best practice for collecting RCT data. Barriers identified for the use of effective retention strategies were: the small improvements seen in questionnaire response for the addition of monetary incentives, and perceptions among trialists that some communication strategies are outdated. Furthermore, there was resistance to change existing retention practices thought to be effective. Face-to-face and electronic follow-up technologies were identified as retention strategies for further research.

Conclusions

We developed best practice guidance for the use of retention strategies in RCTs and identified potential barriers to the use of effective strategies. The extent of agreement on best practice is limited by the variability in the currently available evidence. This guidance will need updating as new retention strategies are developed and evaluated.

Text messaging research participants as a follow-up strategy to decrease emergency department study attrition

OBJECTIVE

Collecting patient-reported follow-up data for prospective studies in the emergency department (ED) is challenging in this minimal continuity setting. The objective of this study was to determine whether text messaging study participants involved in an ongoing randomized trial resulted in a lower rate of attrition as compared to conventional telephone follow-up.

METHODS

This was a nested cohort analysis of research participants enrolled in a randomized controlled trial assessing head injury discharge instructions. During the first 4 months of study follow-up, participants were contacted by a conventional telephone call. For the final 3 months, participants were contacted by text messaging following the first failed telephone attempt.

RESULTS

A total of 118 patients were enrolled in the study (78 underwent conventional follow-up, and 40 received text messages). During the period of conventional follow-up, 3 participants withdrew from the study. Of the remaining 75 participants, 24 (32.0%) at 2 weeks and 32 (42.7%) at 4 weeks were unable to be contacted. Of the 40 participants receiving a reminder text message, 4 (10.0%) at 2 weeks and 10 (25.0%) at 4 weeks were unable to be contacted. Overall, text messaging study participants decreased attrition by 22% (95% CI: 5.9%, 34.7%) and 17.7% (95% CI: -0.8%, 33.3%) at 2- and 4-week follow-ups, respectively.

CONCLUSIONS

In this ED cohort participating in a randomized trial, text message reminders of upcoming telephone follow-up interviews decreased the rate of attrition. Text messaging is a viable, low-cost communication strategy that can improve follow-up participation in prospective research studies.

Cloud Based Surveys to Assess Patient Perceptions of Health Care: 1000 Respondents in 3 days for US $300

BACKGROUND

There are many challenges in conducting surveys of study participants, including cost, time, and ability to obtain quality and reproducible work. Cloudsourcing (an arrangement where a cloud provider is paid to carry out services that could be provided in-house) has the potential to provide vastly larger, less expensive, and more generalizable survey pools.

OBJECTIVE

The objective of this study is to evaluate, using Amazon's Mechanical Turk (MTurk), a cloud-based workforce to assess patients' perspectives of health care.

METHODS

A national online survey posted to Amazon's MTurk consisted of 33 multiple choice and open-ended questions. Continuous attributes were compared using t tests.

RESULTS

We obtained 1084 responses for a total cost of US $298.10 in less than 3 days with 300 responses in under 6 hours. Of those, 44.74% (485/1084) were male and 54.80% (594/1084) female, representing 49 out of 50 states and aged 18 to 69 years.

CONCLUSIONS

Amazon's MTurk is a potentially useful survey method for attaining information regarding public opinions and/or knowledge with the distinct advantage of cost, speed, and a wide and relatively good representation of the general population, in a confidential setting for respondents.