Does length of questionnaire matter? A randomised trial of response rates to a mailed questionnaire

The identification and treatment of alcohol problems in primary care (iTAPP) study: protocol for a stepped wedge cluster randomized control trial testing the 15-method in a primary care setting

BACKGROUND

The 15-method is a targeted screening and treatment approach for alcohol problems in primary care. The 15-method used in primary care has proven as effective as specialized treatment for mild to moderate alcohol dependence in Sweden. A feasibility study of the 15-method in Danish primary care found the method acceptable and feasible.

AIMS

To evaluate the effectiveness of the 15-method in a Danish primary care setting in (1) lowering the proportion of patients exceeding the Danish low-risk alcohol consumption limit of ten standard units per week and a maximum of four standard units on a single day for men and women, and (2) increasing the likelihood of alcohol use being addressed during a consultation in general practice. Further, the rate of prescribed pharmacological treatment for alcohol problems (Disulfiram, Naltrexone, Acamprosate, and Nalmefene) will be measured along with the use of the biomarkers Alanine Transaminase and Gamma-Glutamyl Transferase.

METHODS

Stepped wedge cluster randomized controlled trial in sixteen general practices in the Region of Southern Denmark. Following a three-month baseline, the practices are randomly assigned to launch dates in one of four clusters. General practitioners and nurses receive three hours of training in the 15-method before launch. Patient questionnaires will collect data on alcohol consumption levels among patients affiliated with the practices. The healthcare professionals will register consultations in which alcohol is addressed in their patient filing system. Pharmacological treatment rates and the use of biomarkers will be collected through Danish national registries. The study follows the Medical Research Council's guidelines for developing and evaluating complex interventions.

DISCUSSION

From the patient's perspective, the 15-method may help identify alcohol-related problems at an earlier stage with flexible treatment offers in a familiar setting. For healthcare professionals, it addresses a traditionally challenging topic by equipping them with concrete tools, communication training, and clear treatment directives. From a societal perspective, primary care holds a unique position to identify hazardous and harmful alcohol use across different age groups, with potential public health and economic benefits through early identification and intervention.

TRIAL REGISTRATION

Clinicaltrials.gov NCT05916027. Retrospectively registered 22 June 2023.

The Development and Validation of a Questionnaire to Investigate the Association Between Maternal Food Insecurity and Fetal Structural Anomalies: Delphi Procedure and Pilot Study

INTRODUCTION

Food insecurity represents a public health issue that has been associated with poor birth outcomes. We describe the methodological steps followed to structure and validate a questionnaire, which has the potential to contribute to the planning and conduction of future studies investigating the possible association between maternal food insecurity and fetal structural anomalies.

METHODS

We first conducted a literature review to structure and validate the questionnaire. Subsequently, we drafted the questionnaire based on the results of this review, further refined through two focus groups. Afterward, the questionnaire was submitted using the Delphi Method to a panel of experts for validation. We conducted a pilot study prior to recruiting the final sample.

RESULTS

The questionnaire consisted of sections covering information about socio-demographic characteristics, women's health and lifestyle, pregnancy, and food security status. After the first Delphi round, the Content Validity Index (CVI) for each section ranged 0.81-0.85, while after the second round all items had a CVI of 1. The final version of the questionnaire, consisting of 87 items, was pilot tested among 20 participants. Cronbach's Alpha for each section resulted in values higher than 0.6. The response rate ranged from 78 to 100%. A situation of food security was present in 85% of the participants, while 5% were in a situation of mild food insecurity and 10% of moderate food insecurity.

CONCLUSION

The questionnaire has appropriate measurement properties, and is an adequate instrument to evaluate the association between maternal food insecurity and fetal structural anomalies.

Oral-Functioning Questionnaires in Patients with Head and Neck Cancer: A Scoping Review

Background: Oral-functioning impairment can negatively affect the quality of life (QoL) of head and neck cancer (HNC) patients after receiving radiotherapy (RT). Assessment of patient-reported oral functioning throughout treatment can improve patient care. This scoping review aims to propose a definition for oral functioning for HNC patients and to map out the available questionnaires measuring patient-reported oral functioning in RT-treated HNC patients. Methods: A literature search in relevant databases was performed. Each questionnaire was scored on the domains validity, reliability, and responsiveness. Furthermore, the items from the questionnaires were analyzed to define the common denominators for oral functioning in HNC patients. Results: Of the 6434 articles assessed, 16 met the inclusion criteria and employed 16 distinct instruments to evaluate QoL. No questionnaire covered all oral-health-related QoL items nor assessed all aspects of validity, reliability, and responsiveness. Chewing, speaking, and swallowing were the common denominators for oral functioning. Conclusions: Based on the included studies, we suggest using the VHNSS 2.0 questionnaire to assess oral functioning in HNC patients. Furthermore, we suggest to more clearly define oral functioning in HNC patients by focusing on masticatory function (chewing and grinding), mouth opening, swallowing, speaking, and salivation.

Patient expectations and satisfaction in hand surgery: A new assessment approach through a valid and reliable survey questionnaire

INTRODUCTION

Assessing patient expectations in orthopaedic surgery has gained significant importance over time. However, there have been only a few studies on how to measure such expectations in hand surgery. Against the backdrop, the study was designed to develop a valid and reliable expectations survey for patients undergoing hand surgery and to identify the correlations between preoperative expectations and postoperative satisfaction.

MATERIALS AND METHODS

This is a three-phase prospective cohort study. In the first phase of the study (146 patients), patient expectations were assessed while developing a draft questionnaire based on frequency and clinical relevance. In the second phase (154 patients newly included), test-retest reliability was measured to ensure test consistency. The Intraclass Correlation Coefficient (ICC) served as a basis for developing the final survey questionnaire. In the third phase, we followed up with patients, who completed the preoperative expectations survey, 3 months after surgery to assess the fulfillment of their expectations. The Pearson correlation method was used to measure the association between preoperative expectations and postoperative satisfaction.

RESULTS

In the first phase, 146 patients shared 406 different expectations, which were grouped into nine categories. Then, in the second phase, the final survey was populated by questionnaire items under respective category that have revealed strong test-retest reliability (ICC of 0.91). A significant positive correlation between patient expectations and satisfaction was observed (R = 0.181, p = 0.034).

CONCLUSION

The survey was designed to offer a valid and reliable approach for the comprehensive assessment of patient expectations in hand surgery. The survey results show that patients with high expectations tend to be more satisfied with surgical outcomes. It is strongly believed that this approach would serve as a useful tool at a time when patient perspective is taken into account increasingly more in the clinical practice.

A Systematic Review of Strategies to Enhance Response Rates and Representativeness of Patient Experience Surveys

BACKGROUND

Data from surveys of patient care experiences are a cornerstone of public reporting and pay-for-performance initiatives. Recently, increasing concerns have been raised about survey response rates and how to promote equity by ensuring that responses represent the perspectives of all patients.

OBJECTIVE

Review evidence on survey administration strategies to improve response rates and representativeness of patient surveys.

RESEARCH DESIGN

Systematic review adhering to the Preferred Reporting Items for Systematic reviews and Meta-Analyses guidelines.

STUDY SELECTION

Forty peer-reviewed randomized experiments of administration protocols for patient experience surveys.

RESULTS

Mail administration with telephone follow-up provides a median response rate benefit of 13% compared with mail-only or telephone-only. While surveys administered only by web typically result in lower response rates than those administered by mail or telephone (median difference in response rate: -21%, range: -44%, 0%), the limited evidence for a sequential web-mail-telephone mode suggests a potential response rate benefit over sequential mail-telephone (median: 4%, range: 2%, 5%). Telephone-only and sequential mixed modes including telephone may yield better representation across patient subgroups by age, insurance type, and race/ethnicity. Monetary incentives are associated with large increases in response rates (median increase: 12%, range: 7%, 20%).

CONCLUSIONS

Sequential mixed-mode administration yields higher patient survey response rates than a single mode. Including telephone in sequential mixed-mode administration improves response among those with historically lower response rates; including web in mixed-mode administration may increase response at lower cost. Other promising strategies to improve response rates include in-person survey administration during hospital discharge, incentives, minimizing survey language complexity, and prenotification before survey administration.

Is student mentoring career-defining in surgical disciplines? A comparative survey among medical schools and medical students for mentoring programs

Objective

Facing a shortage of young surgeons, this study aimed to examine the availability of mentoring programs and if this can counteract this lack.

Summary background data

Medical mentoring programs have proven to be decisive to influence students' later career decisions. Since their structure may depend on the medical school and the effort of single disciplines, the offers are often very heterogeneous.

Methods

Anonymous online-questionnaires were developed and distributed among medical students in Germany and the dean for teaching of the medical schools from July 2019 to January 2020 in Germany. Data of the availability of mentoring programs, their structure and the impact of surgery were collected.

Results

Forty three medical schools participated, with 65% offering mentoring programs. 18 of medical schools had no additional funding available for this. Surgical subjects participated in these programs in only 30%. Additionally, 1,516 medical students participated in the second survey. A total of 70% had already participated in a mentoring program with a significantly higher proportion of men. Of these, 94% stated that this was helpful and had an impact on their career planning, without any gender differences. 95% would participate in structured surgical mentoring programs and 95% agreed that this could have an impact on their career planning.

Conclusion

Mentoring programs may be able to influence career planning, nevertheless participation by surgical specialties has been low. Becoming more active in providing mentoring programs with a special focus on women and offering more surgical content can be a way to counteract the lack of surgical trainees.

Development and Validation of the Italian "Brief Five-Item Chronic Pain Questionnaire" for Epidemiological Studies

Background

Chronic pain (CP) prevalence estimates addressing a wide phenotype are still quite fragmented and may vary widely due to the lack of standardized tools of investigation. There is an urgent need to update general population CP estimates.

Methods

For this purpose, the Brief Five-item Chronic Pain Questionnaire was developed through experts’ consultations for design and content validity assessment; literature analysis of measures used to investigate CP for general population surveys; understandability evaluation through a survey on a convenience sample of affected and non-affected individuals; reliability assessment by means of two double-wave online surveys carried out by the Italian Twin Registry; criterion and construct validity assessment through the third wave of the 2019 European Health Interview Survey (Ehis).

Results

Key dimensions were defined to describe CP main aspects from a public health perspective. Literature analysis showed that validated questionnaires were rarely used to address important public health CP aspects. Understandability of the measure was good. Test-retest analyses showed adequate reliability of the measure: k values were at least “moderate” with highest values regarding CP “occurrence” and “intensity”. Correlations of CP with well-known comorbidities (cancer, depression), and specific traits (age, education) as well as of CP and its intensity with “physical pain occurrence and intensity” detected in the Ehis 2019, confirmed, respectively, a good construct and criterion validity. Construct validity was also evaluated through the correlation between “perceived treatment effectiveness” and “interference of pain in daily life activities” as recorded in the Ehis 2019.

Conclusion

The designed questionnaire is a brief self-administered measure, particularly suitable to detect persistent states of pain and related intensity in large-scale general population surveys by means of a first filtering item followed by four further items. It is, in fact, designed to detect CP possible underlying causes/triggers, drugs/treatments taking and frequency, and self-perceived effectiveness among CP sufferers. Further validation of the measure in different social and cultural contexts is desirable.

Digital teaching tools in sports medicine: A randomized control trial comparing the effectiveness of virtual seminar and virtual fishbowl teaching method in medical students

Background

Since the COVID-19 pandemic, the demand for online courses has increased enormously. Therefore, finding new methods to improve medical education is imperative.

Objective

The aim of this study was to compare the self-reports of the individual student-centered virtual teaching techniques (seminar versus fishbowl) in a group of medical students.

Methods

During the second semester of 2020, students in the clinical phase of the study (n = 144) participated in the optional subject of Sports Medicine. The students were divided into 2 groups. One group (n = 72) received the knowledge transfer in the form of a virtual seminar, the other group (n = 72) in the form of a virtual fishbowl.

Results

Virtual seminar and virtual fishbowl students gave insights into these teaching techniques. Most of the students from the virtual fishbowl group believed that the virtual fishbowl format allowed them to be more actively involved in learning. The mean quiz scores were statistically higher for students in the virtual fishbowl group than students in the virtual seminar group (p < 0. 001).

Conclusion

This study concluded that virtual seminars and virtual fishbowl formats could be served as structured learning and teaching formats. At the same time, the virtual fishbowl format can promote an active exchange of knowledge from students’ perspectives.

How far has the digitization of medical teaching progressed in times of COVID-19? A multinational survey among medical students and lecturers in German-speaking central Europe

BACKGROUND

To ensure successful medical education despite the COVID-19 pandemic, the demand for online instruction has substantially increased. Fast and efficient teaching in a digital format poses a great challenge for medical students and lecturers as well as the universities.

OBJECTIVE

The aim of this study is to capture the readiness of medical students and faculty members to participate in rapidly- evolving online education.

METHODS

This cross-sectional study is based on two questionnaires distributed among medical students and associate deans for education in Germany, Austria and Switzerland. Questions included decision- making questions, categorical questions, and open-ended questions, all addressing the frequency and format of the digital education offered, the perceived quality of digital education, and medical student satisfaction with digital education. Questions about missing content and areas for improvement from the perspectives of medical students were included. The associate deans were asked for their opinions about the impact of the pandemic on teaching, the organizational setup and implementation of digital education by universities, and plans for future initiatives.

RESULTS

Three thousand and thirty medical students (m = 752 and f = 2245) from 53 universities participated in the study. The study showed that 92% of students were affected by the pandemic, and 19% of the students viewed the changes as entirely negative. 97% of the medical students were able to participate in digital courses, but only 4% were able to learn exclusively online. For 77% of the medical students, digital offerings accounted for over 80% of the education offered. In terms of content, medical students complained about a lack of practical teaching, such as contact with patients, lecturers, fellow medical students, and a poor perceived quality of teaching due to dubbing, frequent changeover of seminars, problem-oriented learning groups and in-person teaching, a lack of interaction possibilities and a lack of technical equipment, such as lecturers' knowledge and server capacities, at the universities. Overall, almost half of the medical students (42%) rated the implementation of digital teaching at their universities as good or very good. Forty-one of the 53 associate deans responded to the questionnaire, and 35 felt medical education was influenced by the pandemic. The associate deans (80%; 33/41) felt that the digitalization of medical education was negatively influenced by the pandemic. Only 44% (18/41) felt that their universities were well or very well positioned for digital teaching. All the associate deans believe that digital teaching in medicine will continue after the pandemic.

CONCLUSIONS

In the German-speaking world, the rapid conversion of medical teaching to a digital format has been well implemented in many cases. The perceived quality of the implementation of digital education still lacks practical relevance and the use of new digital media, such as learning games, VR, and online question time. The digital format of medical education will likely continue beyond the COVID-19 pandemic.

Feasibility and acceptability of a mixed model digital study to explore the effect of a daily collagen peptide supplement on digestive symptoms in healthy females: findings from a pilot study. (Preprint)

Background

Objective

Methods

Results

Conclusions

Trial Registration

How short or long should be a questionnaire for any research? Researchers dilemma in deciding the appropriate questionnaire length

A questionnaire plays a pivotal role in various surveys. Within the realm of biomedical research, questionnaires serve a role in epidemiological surveys and mental health surveys and to obtain information about knowledge, attitude, and practice (KAP) on various topics of interest. Questionnaire in border perspective can be of different types like self-administered or professionally administered and according to the mode of delivery paper-based or electronic media–based. Various studies have been conducted to assess the appropriateness of a questionnaire in a particular field and methods to translate and validate them. But very little is known regarding the appropriate length and number of questions in a questionnaire and what role it has in data quality, reliability, and response rates. Hence, this narrative review is to explore the critical issue of appropriate length and number of questions in a questionnaire while questionnaire designing.

Lack of residents due to COVID-19 pandemic. Can a mentor–mentee program during medical studies have a positive influence on the choice for specialist training in gynecology and obstetrics? A review of current literature and results of a national wide survey of medical students

Objective

The COVID-19 pandemic restricting clinical practice and exacerbating the lack of medical staff. There is currently a lack of young residents who are deciding on further training in gynecology and obstetrics. Design: review and prospective, cross-sectional study. Setting: the aim of this study was to investigate if structured mentoring programs can counteract this deficiency. Population: medical students took part from Germany in the clinical phase.

Methods

An anonymous questionnaire was developed and distributed to students from January to October 2020. Epidemiological data, questions about mentoring experiences, necessity and their expected influence on career planning were collected and statistically evaluated. Main outcome measures: structured mentoring-programs can influence the choice of subject. In particular, men are still underrepresented. Research on the topic of mentoring during in the field of gynaecology and obstetrics is completely lacking.

Results

A representative number of 927 medical students took part in the survey. 22% (170/906) of the students had already participated in a mentoring program with a significantly higher proportion of men (69%; 117/170; p < 0.001). Of these, 94% (453/170) said this was helpful. 6% (55/906) wanted to pursue a career in gynecology and obstetrics. When asked about their appreciation for structured mentoring programs in gynecology and obstetrics, 95% (880/906) would participate and 94% agreed (871/906) that this could have an impact on their choice of specialist and career planning.

Conclusions

An active provision of mentoring programs and more content can be a way of counteracting the shortage of residents in gynecology and obstetrics.

Perceptions and knowledge of telemedicine in Ecuadorian practicing physicians: an instrument adaptation, validation and translation from English to Spanish

BACKGROUND

During the COVID-19 pandemic, multiple countries have taken measures, such as isolation and quarantine, to prevent person-to-person spread of disease. These actions forced many physicians to adopt new techniques, such as telemedicine, to continue patient care, which has proven to be useful in continued care for those with non-COVID-19 pathologies. Various factors, such as security, confidentiality, cost-effectiveness, comfort, and the risk of malpractice, influence the perception of telemedicine among medical practitioners. The aim of this study was to adapt an existing instrument and validate it into a new Spanish version. The instrument is about the perceptions and knowledge of telemedicine in healthcare professionals.

METHODS

The original questionnaire surveyed 6 domains with 40 questions, and each question was measured with a five-point Likert scale ranging from very high [5] to very low [1]. The survey was translated to Spanish using machine translation. The translation was reviewed independently, and then, a consensus was achieved regarding minor changes in the syntax of the survey to facilitate understanding. After expert feedback and questionnaire review, the research team members proposed reducing the instrument to 13 items in 4 domains due to the similarity of some questions. The sample was divided into 2randomly selected groups. Eligibility criteria included physicians providing private or public services with active medical/clinical practice.

RESULTS

In total, 382 surveys were collected and separated into two random samples, S1 and S2 (198 and 184, respectively). In exploratory factor analysis (EFA), the 13 items were grouped into four theoretical domains, and item 7 presented cross loading between factors and was removed. Confirmatory factor analysis was performed to assess the scale reliability and interscale associations; three models were tested. Global Cronbach's alpha for internal consistency was 0.76 for the EFA. The goodness of fit measures root mean square error of approximation and comparative fit index were 0.009 and 0.999, respectively, for the best model.

CONCLUSIONS

The translated instrument was clear, with adequate internal consistency, readability, and appropriate for application in the physician setting. This validated questionnaire made it possible to evaluate physicians' knowledge of telemedicine to increase its use, especially during the COVID-19 pandemic.

Acceptance, Use and Barriers of Telemedicine in times of SARS-CoV-2 in Transgender Health Care: Results of a nationwide cross-sectional survey

Background

The global incidence in the treatment of transgender people is increasing. During the COVID-19 pandemic, many consultations had to be cancelled, postponed, or converted to a virtual format. Telemedicine in the management of transgender health care could support physicians.

Objective

The aim of this study was to analyze the acceptance, use, and barriers of telemedicine in transgender health care in times of SARS-CoV-2 in Germany.

Methods

This prospective cross-sectional study was based on a survey of gynecological endocrinologists and transgender patients undergoing gender-affirming hormone treatment in Germany during the COVID-19 pandemic. Descriptive statistics were calculated, and regression analyses were performed to show correlations.

Results

We analyzed responses of 269 transgender patients and 202 gynecological endocrinologists treating transgender patients. Most believed that telemedicine was useful. Physicians and patients rated their knowledge of telemedicine as unsatisfactory. The majority of respondents said they did not currently use telemedicine, although they would like to do so. Patients and physicians reported that their attitudes toward telemedicine had changed positively and that their use of telemedicine had increased due to COVID-19. The majority in both groups agreed on the implementation of virtual visits in the context of stable disease conditions. In the treatment phases, 74.3% (150/202) of the physicians said they would use telemedicine during follow-ups. Half of the physicians said they would choose tele-counseling as a specific approach to improving care (128/202, 63.4%). Obstacles to the introduction of telemedicine among physicians included the purchase of technical equipment (132/202, 65.3%), administration (124/202, 61.4%), and poor reimbursement (106/202, 52.5%).

Conclusions

Telemedicine in transgender health care found limited use but high acceptance among doctors and patients alike. The absence of a structured framework is an obstacle for effective implementation. Training courses should be introduced to improve the limited knowledge of physicians in the use of telemedicine. More research in tele-endogynecology is needed. Future studies should include large-scale randomized controlled trials, economic analyses, and the exploration of user preferences.

From first to second wave: follow-up of the prospective COVID-19 cohort (KoCo19) in Munich (Germany)

BACKGROUND

In the 2nd year of the COVID-19 pandemic, knowledge about the dynamics of the infection in the general population is still limited. Such information is essential for health planners, as many of those infected show no or only mild symptoms and thus, escape the surveillance system. We therefore aimed to describe the course of the pandemic in the Munich general population living in private households from April 2020 to January 2021.

METHODS

The KoCo19 baseline study took place from April to June 2020 including 5313 participants (age 14 years and above). From November 2020 to January 2021, we could again measure SARS-CoV-2 antibody status in 4433 of the baseline participants (response 83%). Participants were offered a self-sampling kit to take a capillary blood sample (dry blood spot; DBS). Blood was analysed using the Elecsys® Anti-SARS-CoV-2 assay (Roche). Questionnaire information on socio-demographics and potential risk factors assessed at baseline was available for all participants. In addition, follow-up information on health-risk taking behaviour and number of personal contacts outside the household (N = 2768) as well as leisure time activities (N = 1263) were collected in summer 2020.

RESULTS

Weighted and adjusted (for specificity and sensitivity) SARS-CoV-2 sero-prevalence at follow-up was 3.6% (95% CI 2.9-4.3%) as compared to 1.8% (95% CI 1.3-3.4%) at baseline. 91% of those tested positive at baseline were also antibody-positive at follow-up. While sero-prevalence increased from early November 2020 to January 2021, no indication of geospatial clustering across the city of Munich was found, although cases clustered within households. Taking baseline result and time to follow-up into account, men and participants in the age group 20-34 years were at the highest risk of sero-positivity. In the sensitivity analyses, differences in health-risk taking behaviour, number of personal contacts and leisure time activities partly explained these differences.

CONCLUSION

The number of citizens in Munich with SARS-CoV-2 antibodies was still below 5% during the 2nd wave of the pandemic. Antibodies remained present in the majority of SARS-CoV-2 sero-positive baseline participants. Besides age and sex, potentially confounded by differences in behaviour, no major risk factors could be identified. Non-pharmaceutical public health measures are thus still important.

Telemedicine as a Therapeutic Option in Sports Medicine: Results of a Nationwide Cross-Sectional Study among Physicians and Patients in Germany

Background: Worldwide, the number of treatments in the field of sports medicine is increasing. However, the COVID-19 pandemic has changed everyday life. Many consultations had to be cancelled, postponed, or converted to a virtual format. Telemedicine in sports medicine could support physicians. This study analyzes the use and perception of telemedicine applications among physicians and patients in the field of sports medicine in Germany. Methods: This prospective cross-sectional study was based on a survey of sports medicine physicians and patients in Germany during the COVID-19 pandemic. Descriptive statistics were calculated. Results: We analyzed the responses of 729 patients and 702 sports medicine physicians. Most believed that telemedicine is useful. Both physicians and patients rated their knowledge of telemedicine as unsatisfactory. The majority of respondents said they do not currently use telemedicine but would like to do so. Patients and physicians reported that their attitude had changed positively towards telemedicine and that their usage had increased due to COVID-19. The majority in both groups agreed on implementing virtual visits in stable disease conditions. Telemedicine was considered helpful for follow-up monitoring and prevention by both groups. Conclusion: Telemedicine in sports medicine has seen limited use but is highly accepted among physicians and patients alike. The absence of a structured framework is an obstacle to effective implementation. Training courses should be introduced to improve the limited knowledge regarding the use of telemedicine. More research in telemedicine in sports medicine is needed. This includes large-scale randomized controlled trials, economic analyses and explorations of user preferences.

A comparison of faecal incontinence scoring systems

AIM

Questionnaires designed to score the severity of faecal incontinence (FI) are widely used to provide an evaluation of symptoms across settings, studies and time. The Pelvic Floor Disorders Consortium have recommended the use of multiple questionnaires despite some overlap of questions. This study aimed to evaluate whether patient responses to these questionnaires are consistent.

METHOD

A retrospective analysis was undertaken of patients with FI who attended a dedicated pelvic floor unit between January 2018 and December 2019 and completed the Fecal Incontinence Severity Index, Cleveland Clinic Florida Incontinence Score and St Mark's Incontinence Score simultaneously. For each questionnaire the frequency of incontinence episodes to solid stool, liquid stool and gas was divided into five categories to allow direct comparison. Answers were deemed equivalent if the allocated response was identical, slightly different if the response was in an adjacent category or very different if the response differed to a greater extent.

RESULTS

There were 193 patients who simultaneously completed all three FI questionnaires. There were statistically significant differences between the responses regarding frequency of solid stool, liquid stool and gas incontinence on all three questionnaires (p < 0.005). Across all domains, between 58.0% and 69.9% of responses were equivalent, 14.1%-34.0% of answers were slightly different and 8.0%-18.8% were very different.

CONCLUSION

Even when completed at the same time, and by the same person, similar questions are answered differently a significant proportion of the time. The utility of using multiple questionnaires simultaneously in the clinical setting to assess FI symptoms should be questioned.

A decade of service development: audit of service users' experience of a rural Psychiatry of Later Life (POLL) service

INTRODUCTION

The HSE "Vision for change", national service plan and other policies emphasise the importance of incorporating the views of service users and carers in the design and delivery of mental health services.

AIMS

To obtain the views of service users in relation to a rural POLL service. Compare our service to best practice and address issues identified. Repeat the audit cycle based on recommendations.

METHODOLOGY

New referrals to the POLL service were identified, and a pseudo-anonymised audit tool questionnaire was posted to these patients after initially making a telephone contact and obtaining informed consent. Results were compared to standards set by our team based on local and national policies. We used Microsoft Excel and performed a thematic analysis of qualitative data in the fourth cycle. This audit has been repeated on four occasions: 2012, 2013, 2016 and 2019.

RESULTS

More than 90% of patients marked as being benefited by the POLL team. Overall, most positive responses pertained to supportive and professional staff, resolution of disease symptoms, psycho-education and attentive follow-up whereas negative responses were in relation to limited access to disabled parking spaces, perceived inadequate discharge planning and non-resolution of disease symptoms in few patients.

CONCLUSION

Involving POLL patients in audit provided useful insights to improve the quality of service. We resolved the issue of disabled parking access and have developed a service information leaflet and a discharge leaflet. We intend to focus more on psychoeducation and discharge planning based on the results of the current cycle.

Strategies to improve retention in randomised trials

BACKGROUND

Poor retention of participants in randomised trials can lead to missing outcome data which can introduce bias and reduce study power, affecting the generalisability, validity and reliability of results. Many strategies are used to improve retention but few have been formally evaluated.

OBJECTIVES

To quantify the effect of strategies to improve retention of participants in randomised trials and to investigate if the effect varied by trial setting.

SEARCH METHODS

We searched the Cochrane Central Register of Controlled Trials (CENTRAL), MEDLINE, Scopus, PsycINFO, CINAHL, Web of Science Core Collection (SCI-expanded, SSCI, CPSI-S, CPCI-SSH and ESCI) either directly with a specified search strategy or indirectly through the ORRCA database. We also searched the SWAT repository to identify ongoing or recently completed retention trials. We did our most recent searches in January 2020.

SELECTION CRITERIA

We included eligible randomised or quasi-randomised trials of evaluations of strategies to increase retention that were embedded in 'host' randomised trials from all disease areas and healthcare settings. We excluded studies aiming to increase treatment compliance.

DATA COLLECTION AND ANALYSIS

We extracted data on: the retention strategy being evaluated; location of study; host trial setting; method of randomisation; numbers and proportions in each intervention and comparator group. We used a risk difference (RD) and 95% confidence interval (CI) to estimate the effectiveness of the strategies to improve retention. We assessed heterogeneity between trials. We applied GRADE to determine the certainty of the evidence within each comparison.

MAIN RESULTS

We identified 70 eligible papers that reported data from 81 retention trials. We included 69 studies with more than 100,000 participants in the final meta-analyses, of which 67 studies evaluated interventions aimed at trial participants and two evaluated interventions aimed at trial staff involved in retention. All studies were in health care and most aimed to improve postal questionnaire response. Interventions were categorised into broad comparison groups: Data collection; Participants; Sites and site staff; Central study management; and Study design. These intervention groups consisted of 52 comparisons, none of which were supported by high-certainty evidence as determined by GRADE assessment. There were four comparisons presenting moderate-certainty evidence, three supporting retention (self-sampling kits, monetary reward together with reminder or prenotification and giving a pen at recruitment) and one reducing retention (inclusion of a diary with usual follow-up compared to usual follow-up alone). Of the remaining studies, 20 presented GRADE low-certainty evidence and 28 presented very low-certainty evidence. Our findings do provide a priority list for future replication studies, especially with regard to comparisons that currently rely on a single study.

AUTHORS' CONCLUSIONS

Most of the interventions we identified aimed to improve retention in the form of postal questionnaire response. There were few evaluations of ways to improve participants returning to trial sites for trial follow-up. None of the comparisons are supported by high-certainty evidence. Comparisons in the review where the evidence certainty could be improved with the addition of well-done studies should be the focus for future evaluations.

Patient-Reported Outcomes Measurement Information System Validation in Hip Arthroscopy: A Shift Towards Reducing Survey Burden

Background The Patient-Reported Outcomes Measurement Information System (PROMIS) was developed to provide measures of patient-reported symptoms and healthcare outcomes across a variety of conditions in an easily accessible manner. The purpose of this study was to validate PROMIS against traditional legacy measures in patients undergoing hip arthroscopy for femoral acetabular impingement (FAI). Methodology Outcome measures collected pre- and post-operatively included PROMIS Pain Interference (PI) and Physical Function (PF), modified Harris Hip Score (mHHS), Hip Outcome Score-Activities of Daily Living and Sport (HOS-ADL and HOS-Sport), Nonarthritic Hip Score (NAHS), and Visual Analog Scale (VAS). Pearson's correlation coefficients were calculated between each outcome measure. Results Strong correlations were observed between the PROMIS PF T-Score and the mHHS (r = 0.64-0.83, p < 0.0001), HOS-ADL (r = 0.54-0.81, p < 0.0001), HOS-Sport (r = 0.55-0.74, p < 0.0001), and NAHS (r = 0.61-0.78, p < 0.0001) measurement tools. PROMIS Computer Adaptive Testing PI T-Score and VAS also demonstrated a strong correlation (r = 0.64-0.80, p < 0.0001). Conclusions PROMIS PF scores correlate strongly with mHHS, HOS-ADL, HOS-Sport, and NAHS scores at all time points. Likewise, PROMIS PI scores correlate strongly with VAS pain scores. On average, patients completing PROMIS need to fill out only four or five questions. This study supports the use of PROMIS as an efficient, valid outcome tool for patients with FAI undergoing hip arthroscopy.

Developing a Short Multidimensional Measure of Pain Self-efficacy: The Chronic Pain Self-efficacy Scale-Short Form

BACKGROUND AND OBJECTIVES

The 22-item Chronic Pain Self-efficacy Scale (CPSS) measures three domains of pain self-efficacy: pain management, physical functioning, and coping with symptoms. This study aims to develop a short form (CPSS-SF) that retains the multidimensional structure of the instrument.

RESEARCH DESIGN AND METHODS

Six hundred sixty-four community-dwelling Chinese older adults aged 60-95 years with chronic pain completed a survey. Confirmatory factor analysis (CFA) was conducted on the 22-item CPSS. Regression analyses were performed to examine the items' correlations with criterion variables. After CPSS-SF items were selected, the performance of CPSS-SF subscales in terms of accounting for pain-related outcomes was compared with the full version.

RESULTS

CFA supported a modified 3-factor model of the CPSS. On the basis of factor loadings on the 3 dimensions and the items' correlations with pain intensity and pain disability, 11 items were selected for the CPSS-SF, which correlated at .97 with the full version. Regression analyses showed that the associations of the CPSS-SF subscales with pain intensity, pain disability, depressive symptoms, instrumental activities of daily living, and physical and mental health-related quality of life, were indistinguishable from their full-version counterparts.

DISCUSSION AND IMPLICATIONS

The CPSS-SF is a valid instrument that can be used in lieu of the full scale. Its availability will facilitate the assessment of pain self-efficacy in research and clinical settings due to its brevity but strong psychometric properties. However, the current evidence is limited to Chinese older adults; more research is needed to ascertain its validity in other age and cultural groups.

Tools to measure health literacy among Chinese speakers: A systematic review

OBJECTIVE

Health literacy measurement can identify healthcare consumers' needs and help inform healthcare service delivery. The objective of this review is to identify and evaluate tools to measure health literacy among Chinese speakers.

METHODS

A systematic literature search was undertaken in nine databases, both English and Chinese, on articles published from the databases' inception to May 2018, addressing health literacy among Chinese speakers.

RESULTS

Ten health literacy instruments in the Chinese language were reported in 17 studies, of which ten were published in English and seven in Chinese. Of the 17 studies, six reported on a new instrument, while the remainder reported on derivative instruments. All, except for one, are self-administered. These studies applied various implicit or explicit conceptual or operational health literacy definitions. The psychometric strength varied across the instruments.

CONCLUSIONS

A number of instruments are available for assessing health literacy among Chinese speakers. Careful selection is recommended, given the variation in components and psychometric properties assessed.

PRACTICE IMPLICATIONS

This review can be used by healthcare providers and researchers to select effective health literacy tools to examine patients' ability to understand and apply health information so that services can be more appropriately tailored to Chinese speaking patients.

How do the particular characteristics of less-educated employees with disabilities impact survey implementation?

BACKGROUND

Employees with disabilities make up a significant share of the working population. The group of employees covered by this study is hard to include in research and yet must be researched due to the vulnerable position it holds in the labour market. The topic is quite complex.

OBJECTIVE

The article's main goal is to demonstrate how to implement a survey and adapt a questionnaire for assessing competencies and motivation for training and career changes among older and less-educated employees who have disabilities.

METHODS

In the paper, we discuss the approach to adapting a questionnaire and a survey by undertaking an extensive process of different testing and adaptation stages that is presented in the article.

RESULTS

We highlight some obstacles that employees with disabilities face when participating in surveys due to their low literacy skills, as well as low self-esteem, accessibility issues and other general methodological issues in the context of our population. Potential solutions gathered from all phases of the adaptation process are discussed.

CONCLUSIONS

Proper survey implementation and questionnaire modification must be ensured if researchers aim to increase the willingness of individuals with disabilities to participate in the survey and to gather quality results.

An exploration of pre-operative fasting practices in adult patients having elective surgery

Background:

Patients fast routinely before elective surgery in order to reduce gastric volume and acidity. The standard fasting time is ‘nil by mouth’ from midnight before surgery. In recent years, new guidelines have recommended that patients remain nil by mouth from clear fluids for 2 hours and from solids for 6 hours. This literature review explored preoperative fasting practices in adult patients from an international perspective.

Methods:

A literature search was undertaken of databases, including CINAHL Plus, PubMed, Medline, the Cochrane Central Register of Controlled Trials, Science Direct, Sage Journals and Embase.

Results:

Anaesthetists were found to possess greater knowledge of reduced preoperative fasting than other health professionals including nurses.

Conclusion:

Actual fasting time was found to be relatively longer than prescribed fasting times.

Assessment of the Quality of Life in Patients before and after Coronary Artery Bypass Grafting (CABG): A Prospective Study

The aim of this study was to examine the quality of life and to report on the utility and QALY measures in patients before and after coronary artery bypass grafting (CABG); to investigate whether the SF-12 is comparable with the SF-36 for measuring health-related quality of life of patients with CABG; and to determine the impact of individual predictors on poor quality of life assessment after rehabilitation. This prospective study was conducted between January 2017 and December 2018 at the University Hospital Center Osijek, at three time points: pre-operation, 1 month after surgery, and after rehabilitation. The study was conducted with the SF-36 and SF-12 health questionnaires on 47 participants. After rehabilitation, there was a significant improvement in all domains of quality of life. The highest score was given to the change in pain (BP); mean scores were 63.8 (95% CI 56.9 to 70.6) (p = 0.001). The lowest grade (the lowest quality) after rehabilitation was in the domain of limitations due to physical difficulties (RP); arithmetic mean was 48.5 (95% CI 41 to 55.9) (p < 0.001). Quality-adjusted life-year was 0.41 (95% CI 0.38–0.44) after the CABG. The results of this study show that patients with coronary heart disease have poor quality of life before surgery. One month after the surgery, the quality of life improved, but was still inadequate. One year after surgery, satisfactory results were obtained in almost all subscales. The SF-36, SF-12, and its components, can be used effectively in patients with CABG. Age, gender, lifestyle, and risk factors in our sample of participants are not predictors of poor quality of life assessment after rehabilitation.

The Relational Aspects of Care Questionnaire: item reduction and scoring using inpatient and accident and emergency data in England

PURPOSE

The Relational Aspects of Care Questionnaire (RAC-Q) is an electronic instrument which has been developed to assess staff's interactions with patients when delivering relational care to inpatients and those accessing accident and emergency (A&E) services. The aim of this study was to reduce the number of questionnaire items and explore scoring methods for "not applicable" response options.

PATIENTS AND METHODS

Participants (n=3928) were inpatients or A&E attendees across six participating hospital trusts in England during 2015-2016. The instrument, consisting of 20 questionnaire items, was administered by trained hospital volunteers over a period of 10 months. Items were subjected to exploratory factor analysis to confirm unidimensionality, and the number of items was reduced using a range of a priori psychometric criteria. Two alternative approaches to scoring were undertaken, one treated "not applicable" responses as missing data, while the second adopted a problem score approach where "not applicable" was considered "no problem with care."

RESULTS

Two short-form RAC-Qs with alternative scoring options were identified. The first (the RAC-Q-12) contained 12 items, while the second scoring option (the RAC-Q-14) contained 14 items. Scores from both short forms correlated highly with the full 20-item parent form score (RAC-Q-12, r=0.93 and RAC-Q-14, f=0.92), displayed high internal consistency (Cronbach's α: RAC-Q-12=0.92 and RAC-Q-14=0.89) and had high levels of agreement (intraclass correlation coefficient [ICC]=0.97 for both scales).

CONCLUSION

The RAC-Q is designed to offer near-real-time feedback on staff's interactions with patients when delivering relational care. The new short-form RAC-Qs and their respective method of scoring are reflective of scores derived using the full 20-item parent form. The new short-form RAC-Qs may be incorporated into inpatient surveys to enable the comparison of ward or hospital performance. Using either the RAC-Q-12 or the RAC-Q-14 offers a method to reduce missing data and response fatigue.

Comparison of Completion Rates for SF-36 Compared With SF-12 Quality of Life Surveys at a Tertiary Urban Wound Center

Patient-reported outcome measures derived from quality of life instruments are an important tool in monitoring disease progression and treatment response. Although a number of validated instruments are available, the Short Form-36 (SF-36) quality of life survey is the most widely used. It is imperative that the patients answer all the questions in this instrument for appropriate analysis and interpretation. It has been hypothesized that fewer questions (i.e., the Short Form-12 [SF-12]), will result in greater survey completion rates. The present study was a randomized prospective study comparing the completion rates for the SF-36 and SF-12 quality of life surveys. Patients presenting with a chronic wound were asked to complete the SF-36 or SF-12 survey. After an a priori power analysis was performed, the completion rates, patterns of skipped questions, and demographic information were analyzed using t tests for continuous variables or Fisher's exact test for categorical variables and both multivariate linear regression and logistic regression. A total of 59 subjects (30 completed the SF-12 and 29 completed the SF-36) participated in the present study. The SF-12 group had an 80% (24 of 30) completion rate compared with a 55% (16 of 29) completion rate for the SF-36 group (p < .05). However, the length of the survey did not affect the completion rate nor was a statistically detectable pattern of skipped questions found. College graduates were more likely to complete both surveys compared with high school graduates (p < .07). Although it is unclear why, our study results indicate that the SF-12 yields a higher total survey completion rate. However, completion appears independent of the shorter survey length.

Utilizing the Total Design Method in medicine: maximizing response rates in long, non-incentivized, personal questionnaire postal surveys

INTRODUCTION

Maximizing response rates in questionnaires can improve their validity and quality by reducing non-response bias. A comprehensive analysis is essential for producing reasonable conclusions in patient-reported outcome research particularly for topics of a sensitive nature. This often makes long (≥7 pages) questionnaires necessary but these have been shown to reduce response rates in mail surveys. Our work adapted the "Total Design Method," initially produced for commercial markets, to raise response rates in a long (total: 11 pages, 116 questions), non-incentivized, very personal postal survey sent to almost 350 women.

PATIENTS AND METHODS

A total of 346 women who had undergone mastectomy and immediate breast reconstruction from 2008-2014 (inclusive) at Addenbrooke's University Hospital were sent our study pack (Breast-Q satisfaction questionnaire and support documents) using our modified "Total Design Method." Participants were sent packs and reminders according to our designed schedule.

RESULTS

Of the 346 participants, we received 258 responses, an overall response rate of 74.5% with a useable response rate of 72.3%. One hundred and six responses were received before the week 1 reminder (30.6%), 120 before week 3 (34.6%), 225 before the week 7 reminder (64.6%) and the remainder within 3 weeks of the final pack being sent. The median age of patients that the survey was sent to, and the median age of the respondents, was 54 years.

CONCLUSION

In this study, we have demonstrated the successful implementation of a novel approach to postal surveys. Despite the length of the questionnaire (nine pages, 116 questions) and limitations of expenses to mail a survey to ~350 women, we were able to attain a response rate of 74.6%.

A survey of pharmacists' perception of foundation level competencies in African countries

BACKGROUND

Evidence from published literature in pharmacy practice research demonstrate that the use of competency frameworks alongside standards of practice facilitate improvement in professional performance and aid expertise development. The aim of this study was to evaluate pharmacists' perception of relevance to practice of the competencies and behaviours contained in the FIP Global Competency Framework (GbCF v1). The overall objective of the study was to assess the validity of the GbCF v1 framework in selected countries in Africa.

METHODS

A cross-sectional survey of pharmacists practicing in 14 countries in Africa was conducted between November 2012 and December 2014. A combination of purposive and snowball sampling method was used. Data was analysed using SPSS v22.

RESULTS

A total of 469 pharmacists completed the survey questionnaire. The majority (91%) of the respondents were from four countries: Ghana, Kenya, Nigeria and South Africa. The study results showed broad agreement on relevance to practice for 90% of the behaviours contained in the GbCF v1 framework. Observed disagreement was associated with area of pharmacy practice and the corresponding patient facing involvement (p ≤ 0.05). In general, the competencies within the 'pharmaceutical care' and 'pharmaceutical public health' clusters received higher weighting on relevance compared to the research-related competencies which had the lowest. Specific inter-country variability on weighting of relevance was observed in five behaviours in the framework although, this was due to disparity in 'degree of relevance' that was related to sample composition in the respective countries.

CONCLUSION

The competencies contained in the GbCF v1 are relevant to pharmacy practice in the study population; however, there are some emergent differences between the African countries surveyed. Overall, the findings provide preliminary evidence that was previously lacking on the relevance of the GbCF v1 competencies to pharmacy practice in the countries surveyed.

Most response-inducing strategies do not increase participation in observational studies: a systematic review and meta-analysis

OBJECTIVES

To evaluate response-inducing strategies for observational studies using health-related questionnaires or interviews.

STUDY DESIGN AND SETTING

We searched PubMed, EMBASE, CINAHL, PsycINFO, and Web of Science up to December 28, 2017. Studies evaluating the effect of a response-inducing strategy on participation rates of observational studies were included. For each strategy, we estimated pooled response ratios with 95% confidence intervals (CIs) in a Hartung-Knapp/Sidik-Jonkman random effects model with the final participation rate as outcome, stratified for type of participants and method of data collection.

RESULTS

The search yielded 168 eligible studies involving 367,616 potential participants and 33 strategies. Among patients, response-inducing strategies for paper-based questionnaires included unconditional monetary incentives (response ratio 1.15; 95% CI 1.09-1.21) and shorter questionnaires (1.04; 1.02-1.06). Among nonpatients, a personalized mode of delivery (1.47; 1.24-1.74), more expensive mailing type (1.25; 1.00-1.56), unconditional monetary incentives (1.24; 1.12-1.38), prenotification (1.12; 1.03-1.22), unconditional scratch lottery tickets (1.09; 1.01-1.18), and shorter questionnaires (1.06; 1.02-1.11) increased response rates to paper-based questionnaires. For Web-based questionnaires and interviews among nonpatients, response rates were increased by conditional lottery tickets (1.17; 1.02-1.34) and conditional monetary incentives (1.39; 1.01-1.91), respectively.

CONCLUSION

Although the majority of strategies evaluated were unsuccessful, some may increase response rates to observational studies, particularly among nonpatients.

Validation of the Mini-OAKHQOL for use in patients with osteoarthritis in Spain

The Mini-Osteoarthritis Knee and Hip Quality of Life (Mini-OAKHQOL) questionnaire osteoarthritis is specific to individuals with knee or hip osteoarthritis. The objective of this study was to perform a validation of the Mini-OAKHQOL for use in Spain in terms of its psychometric properties of reliability, validity and responsiveness. Patients with osteoarthritis from the waiting list for a joint replacement completed the OAKHQOL, Short Form 36 Health Survey and Western Ontario and McMaster Universities Osteoarthritis Index. Reliability was assessed in terms of internal consistency and test-retest data, and convergent validity using Spearman's correlation coefficient. Structural validity was investigated by confirmatory factor analysis, and Rasch analysis was used to examine the unidimensionality of the scales. Responsiveness was assessed by calculating effect sizes. Confirmatory factor analysis confirmed the five-factor model, and the results of the Rasch analyses supported the unidimensionality assumption, with infit and outfit statistics. Cronbach's alpha ranged from 0.76 to 0.89 for all except the social dimensions. Statistically significant differences were observed between patients with different degrees of disease severity on all dimensions. There was convergent validity among dimensions expected to be correlated. The OAKHQOL questionnaire showed good responsiveness, with large changes for all dimensions apart from the two social dimensions, which had small effect sizes. Results of the study support the view that the Spanish version of the Mini-OAKHQOL questionnaire is a valid instrument to measure health-related quality of life in patients with osteoarthritis of the lower limb.

The impact of a dedicated physiotherapist clinic for children with dysfunctional breathing

Dysfunctional breathing is a significant cause of morbidity, adversely affecting an individual's quality of life. There is currently no data from paediatric centres on the impact of breathing retraining for dysfunctional breathing. Symptoms and quality of life were measured in 34 subjects referred sequentially for breathing retraining to the first dedicated paediatric dysfunctional breathing clinic in the UK. Data were obtained prior to the first intervention (time point 1), at discharge (time point 2) and by post 6 months later (time point 3). The mean (interquartile range) age of participants was 13.3 (9.1-16.3) years, with 52% female. Data were obtained at time points 2 and 3 in 23 and 13 subjects, respectively. Statistically significant improvements were observed in symptom scores, child quality of life and parental proxy quality of life between time points 1 and 2 (p<0.0001), while there was no significant difference in the data at time point 3 as compared with time point 2. This study suggests that physiotherapist-led breathing retraining offers significant benefit to young people with dysfunctional breathing which is maintained for at least 6 months after treatment is completed. Future studies will provide more information on the long-term effects of interventions for dysfunctional breathing.

Instruments for assessing the burden of informal caregiving for stroke patients in clinical practice: a comparison of CSI, CRA, SCQ and self-rated burden

Objective: To compare the feasibility, convergent and clinical validity of three commonly used burden scales: Caregiver Strain Index (CSI), Caregiver Reaction Assessment (CRA) and Sense of Competence Questionnaire (SCQ), with a self-developed single question on self-rated burden (SRB).

Subjects: Stroke patients receiving support from an informal caregiver ( n=148) and their caregivers were followed up to six months after stroke.

Intervention: Feasibility was assessed with several measures of missing values. Convergent validity was assessed on the basis of the correlation patterns between the burden scales, and clinical validity through evaluation of expected associations between levels of burden and explanatory patients' and caregivers' characteristics.

Results: Missing values were less often observed on CSI and SRB than SCQ and CRA. Significant correlation coefficients ( p<0.05) could be demonstrated between all burden scales, except for one subscale of CRA. Evidence for clinical validity was strongest for CSI and SRB, based on associations between higher burden scores and patients' disability, and patients' and caregivers' poor level of health-related quality of life (all p<0.05).

Conclusions: A concise and simple measure would facilitate early detection of caregivers at risk in clinical practice and research. CSI and SRB are more feasible and at least as valid instruments for assessment of caregiver burden in stroke than the longer and more complex SCQ and CRA. SRB could be used for quick screening of caregivers at risk. CSI is indicated for further diagnosis of the burden of informal caregivers.

Cancer patients' acceptability of incorporating an epidemiology questionnaire within a clinical trial

BACKGROUND/AIMS

Understanding the influence or impact of epidemiological factors on cancer outcomes in clinical trials can broaden our knowledge of disease, trial populations and therapeutic effects thus leading to improved patient care. However, there is a lack of data on cancer patients' compliance with an epidemiology questionnaire in the context of a clinical trial.

PATIENTS AND METHODS

Cancer patients were provided with a hypothetical scenario and surveyed regarding their willingness and preferences to complete an epidemiology questionnaire if incorporated into a cancer therapy trial. Patient compliance with completing a voluntary epidemiology questionnaire and trial coordinators perceptions therein were separately determined in the NCIC Clinical Trials Group HN.6 clinical trial, an ongoing randomized phase III trial comparing two first-line treatment regimens in patients with locoregionally advanced head and neck cancer.

RESULTS

Of 617 cancer patients from community, academic and tertiary cancer centres, the majority were willing to complete an epidemiology questionnaire either unconditionally (45%), or provided it did not inconvenience them (31%); 4% would refuse. Patients preferred shorter questionnaires of 30-50 questions requiring 10-20 min to complete, administered over 1-3 sessions. Patients were less willing, but still compliant, to answer questions relating to sexual history (71%) and annual household income (66%) relative to other questions (>90%). Eighteen percent thought that the questionnaire should be mandatory, with 31% believing that they may benefit personally from such research. In the HN.6 trial, compliance averaged 94.8% per question.

CONCLUSIONS

Cancer patients are very willing to complete epidemiology questions in clinical trials.

Well-being in amyotrophic lateral sclerosis: a pilot experience sampling study

Objective: The aim of this longitudinal study was to identify predictors of instantaneous well-being in patients with amyotrophic lateral sclerosis (ALS). Based on flow theory well-being was expected to be highest when perceived demands and perceived control were in balance, and that thinking about the past would be a risk factor for rumination which would in turn reduce well-being.

Methods: Using the experience sampling method, data on current activities, associated aspects of perceived demands, control, and well-being were collected from 10 patients with ALS three times a day for two weeks.

Results: Results show that perceived control was uniformly and positively associated with well-being, but that demands were only positively associated with well-being when they were perceived as controllable. Mediation analysis confirmed thinking about the past, but not thinking about the future, to be a risk factor for rumination and reduced well-being.

Discussion: Findings extend our knowledge of factors contributing to well-being in ALS as not only perceived control but also perceived demands can contribute to well-being. They further show that a focus on present experiences might contribute to increased well-being.

Strategies to improve retention in randomised trials

BACKGROUND

Loss to follow-up from randomised trials can introduce bias and reduce study power, affecting the generalisability, validity and reliability of results. Many strategies are used to reduce loss to follow-up and improve retention but few have been formally evaluated.

OBJECTIVES

To quantify the effect of strategies to improve retention on the proportion of participants retained in randomised trials and to investigate if the effect varied by trial strategy and trial setting.

SEARCH METHODS

We searched the Cochrane Central Register of Controlled Trials (CENTRAL), MEDLINE, PreMEDLINE, EMBASE, PsycINFO, DARE, CINAHL, Campbell Collaboration's Social, Psychological, Educational and Criminological Trials Register, and ERIC. We handsearched conference proceedings and publication reference lists for eligible retention trials. We also surveyed all UK Clinical Trials Units to identify further studies.

SELECTION CRITERIA

We included eligible retention trials of randomised or quasi-randomised evaluations of strategies to increase retention that were embedded in 'host' randomised trials from all disease areas and healthcare settings. We excluded studies aiming to increase treatment compliance.

DATA COLLECTION AND ANALYSIS

We contacted authors to supplement or confirm data that we had extracted. For retention trials, we recorded data on the method of randomisation, type of strategy evaluated, comparator, primary outcome, planned sample size, numbers randomised and numbers retained. We used risk ratios (RR) to evaluate the effectiveness of the addition of strategies to improve retention. We assessed heterogeneity between trials using the Chi(2) and I(2) statistics. For main trials that hosted retention trials, we extracted data on disease area, intervention, population, healthcare setting, sequence generation and allocation concealment.

MAIN RESULTS

We identified 38 eligible retention trials. Included trials evaluated six broad types of strategies to improve retention. These were incentives, communication strategies, new questionnaire format, participant case management, behavioural and methodological interventions. For 34 of the included trials, retention was response to postal and electronic questionnaires with or without medical test kits. For four trials, retention was the number of participants remaining in the trial. Included trials were conducted across a spectrum of disease areas, countries, healthcare and community settings. Strategies that improved trial retention were addition of monetary incentives compared with no incentive for return of trial-related postal questionnaires (RR 1.18; 95% CI 1.09 to 1.28, P value < 0.0001), addition of an offer of monetary incentive compared with no offer for return of electronic questionnaires (RR 1.25; 95% CI 1.14 to 1.38, P value < 0.00001) and an offer of a GBP20 voucher compared with GBP10 for return of postal questionnaires and biomedical test kits (RR 1.12; 95% CI 1.04 to 1.22, P value < 0.005). The evidence that shorter questionnaires are better than longer questionnaires was unclear (RR 1.04; 95% CI 1.00 to 1.08, P value = 0.07) and the evidence for questionnaires relevant to the disease/condition was also unclear (RR 1.07; 95% CI 1.01 to 1.14). Although each was based on the results of a single trial, recorded delivery of questionnaires seemed to be more effective than telephone reminders (RR 2.08; 95% CI 1.11 to 3.87, P value = 0.02) and a 'package' of postal communication strategies with reminder letters appeared to be better than standard procedures (RR 1.43; 95% CI 1.22 to 1.67, P value < 0.0001). An open trial design also appeared more effective than a blind trial design for return of questionnaires in one fracture prevention trial (RR 1.37; 95% CI 1.16 to 1.63, P value = 0.0003).There was no good evidence that the addition of a non-monetary incentive, an offer of a non-monetary incentive, 'enhanced' letters, letters delivered by priority post, additional reminders, or questionnaire question order either increased or decreased trial questionnaire response/retention. There was also no evidence that a telephone survey was either more or less effective than a monetary incentive and a questionnaire. As our analyses are based on single trials, the effect on questionnaire response of using offers of charity donations, sending reminders to trial sites and when a questionnaire is sent, may need further evaluation. Case management and behavioural strategies used for trial retention may also warrant further evaluation.

AUTHORS' CONCLUSIONS

Most of the retention trials that we identified evaluated questionnaire response. There were few evaluations of ways to improve participants returning to trial sites for trial follow-up. Monetary incentives and offers of monetary incentives increased postal and electronic questionnaire response. Some other strategies evaluated in single trials looked promising but need further evaluation. Application of the findings of this review would depend on trial setting, population, disease area, data collection and follow-up procedures.

Development of a short form and scoring algorithm from the validated actionable bladder symptom screening tool

Background

The majority of multiple sclerosis (MS) patients develop some form of lower urinary tract dysfunction, usually as a result of neurogenic detrusor overactivity (NDO). Patients identify urinary incontinence as one of the worst aspects of this disease. Despite the high prevalence of NDO, urological evaluation and treatment are significantly under-accessed in this population. The objectives of this study were: 1) to adapt the previously validated Actionable Bladder Symptom Screening Tool (ABSST) to a short form for ease and brevity of application in a clinical setting that is clinically meaningful; and 2) to develop a scoring algorithm that would be interpretable in terms of referring/considering precise diagnosis and treatment.

Methods

A US-based, non-randomized, multi-center, stand-alone observational study was conducted to assess the psychometric properties of the ABSST among patients who have MS with and without NDO. Mixed psychometric methods (e.g., classical statistics (Psychometric theory (3rd ed.). New York: McGraw-Hill; 1994) and item response methods (Applying the Rasch Model: Fundamental Measurement in the Human Sciences. New Jersey: Lawrence Earlbaum Associates; 2001)) were used to evaluate the predictive and clinical validity of the shortened form. The latter included clinicians flagging clinically meaningful items and associated response options which would indicate the need for further evaluation or treatment.

Results

A total of 151 patients, all with MS and with and without NDO, were recruited by 28 clinicians in various US geographical locations. Approximately 41% of patients reported a history of or currently having urinary incontinence and/or urinary urgency. The prediction model across the entire range of classification thresholds was evaluated, plotting the true positive identification rate against the false positive rate (1-Specificity) for various cut scores. In this study, the cut-point or total score of greater than or equal to 6 had a sensitivity of approximately 85%, and specificity of approximately 93% (i.e., 85% patients would warrant being referred to a urologist and 93% of the patients whose symptoms would not warrant urologist referral).

Conclusions

Overall the short form ABSST demonstrated sensitivity and specificity as it maintained the integrity of the longer form tool. Concurrent validity for each subscale as well as predictive and concurrent validity of the total shortened instrument was demonstrated. This instrument provides a new method for assessing bladder problems among MS patients, and may facilitate earlier and more precise diagnosis, treatment, and/or referral to a specialist.

Evaluation and feedback for effective clinical teaching in postgraduate medical education: validation of an assessment instrument incorporating the CanMEDS roles

BACKGROUND

Providing clinical teachers in postgraduate medical education with feedback about their teaching skills is a powerful tool to improve clinical teaching. A systematic review showed that available instruments do not comprehensively cover all domains of clinical teaching. We developed and empirically test a comprehensive instrument for assessing clinical teachers in the setting of workplace learning and linked to the CanMEDS roles.

METHODS

In a Delphi study, the content validity of a preliminary instrument with 88 items was studied, leading to the construction of the EFFECT (evaluation and feedback for effective clinical teaching) instrument. The response process was explored in a pilot test and focus group research with 18 residents of 6 different disciplines. A confirmatory factor analyses (CFA) and reliability analyses were performed on 407 evaluations of 117 supervisors, collected in 3 medical disciplines (paediatrics, pulmonary diseases and surgery) of 6 departments in 4 different hospitals.

RESULTS

CFA yielded an 11 factor model with a good to excellent fit and internal consistencies ranged from 0.740 to 0.940 per domain; 7 items could be deleted.

CONCLUSION

The model of workplace learning showed to be a useful framework for developing EFFECT, which incorporates the CanMEDS competencies and proved to be valid and reliable.

Response burden and questionnaire length: is shorter better? A review and meta-analysis

BACKGROUND

Response burden is often defined as the effort required by the patient to answer a questionnaire. A factor that has been proposed to affect the response burden is questionnaire length, and this burden is manifested in, for example, response rate. Even though response burden is frequently mentioned as a reason for abridging questionnaires, evidence to support the notion that shorter instruments are preferable is limited.

OBJECTIVES

This study aimed to accumulate, analyze, and discuss evidence regarding the association between response burden, as measured by response rate, and questionnaire length.

METHODS

A systematic literature review and meta-analysis of studies reporting response rates in relation to questionnaire length was performed. A Cochran-Mantel-Haenszel test stratified by study using the Breslow-Day test was undertaken to investigate homogeneity of the odds ratios.

RESULTS

Thirty-two reports were identified, of which 20 were eligible for inclusion in the meta-analysis. Three studies used patient input as main outcome when evaluating response burden. In the meta-analysis, a general association between response rate and questionnaire length was found (P ≤ 0.0001). Response rates were lower for longer questionnaires, but because the P value for test of homogeneity was P = 0.03, this association should be interpreted with caution because it is impossible to separate the impact of content from length of the questionnaires.

CONCLUSION

Given the inherently problematic nature of comparing questionnaires of various lengths, it is preferable to base decisions on use of instruments on the content rather than the length per se.

Oral contraceptive use in women at increased risk of breast/ovarian cancer: knowledge and attitudes

BACKGROUND

Several of the health benefits and risks associated with the combined oral contraceptive pill (COCP) are particularly relevant to women at risk of hereditary breast and/or ovarian cancer.

METHODS

Eighty-three past female patients of an Australian hereditary cancer clinic aged 18-50 years completed a self-report questionnaire to assess their contraceptive practices, knowledge and information needs (44% response rate).

RESULTS

Ninety-two percent of participants had previously used the COCP, with a mean knowledge score of 3.63 out of 8. Nearly 40% reported that their family history of cancer was one reason they discontinued/avoided using the COCP. Women reported receiving insufficient COCP information and preferred a targeted information leaflet to answer their questions.

CONCLUSIONS

Although recall bias may have affected some women, there is a clear need to improve the consistency of information delivered to women at risk of hereditary breast and/or ovarian cancer, to ensure informed contraceptive choices are made.

Evaluation and equity audit of the domestic radon programme in England

The U.K. has a radon programme to limit the radon risk to health. This involves advice on protective measures in new buildings, technical guidance on their installation, encouragement of radon measurements and remediation in existing dwellings in high radon areas. We have audited the radon programme at the level of individual homes to identify factors that influence the likelihood of remediation. 49% of the householders responded to our survey and 30% of the respondents stated that they had done some remediation to reduce the indoor radon levels. We found that householders with higher incomes and higher socio-economic status are more likely than others to remediate. Householders are less likely to remediate if they have one of the following: living in a property with a high radon concentration, current smokers in the dwelling, being unemployed or an unskilled worker, long length of time living in that property or elderly (65+ years) living by themselves. Householders appeared to be more likely to remediate if they considered the information on radon and its risk to be very clear and useful. This emphasises the importance of communication with householders.

Thicker paper and larger font increased response and completeness in a postal survey

OBJECTIVE

To investigate the effect of font size and paper thickness on the response to, and completion of, a self-completion postal questionnaire among older people with joint pain.

STUDY DESIGN AND SETTING

Randomized trial. People aged 50 years and older with joint pain who consulted a general practitioner at one of five general practices in Central Cheshire were sent a postal questionnaire. Questionnaire format (large or small font size, thick or thin paper) was randomly allocated using a 2 x 2 factorial design.

RESULTS

Questionnaires were received from 502 out of 650 participants (crude response 77%). Response was significantly higher for participants receiving questionnaires with a larger font size (79.3% vs. 75.2%; hazard ratio 1.26, 95% confidence interval: 1.02, 1.56). Paper thickness had no significant effect on response. Completion (measure by assessing double-page turnover error) was increased in participants receiving questionnaires printed on thicker paper (3.2% vs. 7.1%; P=0.049) but was not affected by font size.

CONCLUSION

This study demonstrates that questionnaires in larger font and on thicker paper may produce higher and more complete responses than surveys using standard size font and standard thickness paper, and should therefore be considered in studies among older people.

Sacral nerve stimulation for voiding dysfunction: One institution's 11-year experience

AIM

The purpose of this study was to review our institution's 11-year experience with SNS for the treatment of refractory voiding dysfunction. Dating back to 1993, it covers a span of time which describes the evolution of SNS as it includes PNE trials, non-tined (bone-anchored or fascial-anchored) leads, percutaneous tined leads with two-staged procedures, and even percutaneous pudendal trials.

METHODS

A retrospective review was performed on SNS patients who received an implantable pulse generator (IPG) in our practice from 12/1993 to 12/2004. After Institutional Review Board approval, consents for chart review were obtained from 104 patients, representing 44% of this neuromodulatory patient population.

RESULTS

Of our population, 87% were female and 13% were male. Average age at implant was 50 years +/- 13.4 years. Duration of symptoms before implantation was 116 months (range 9-600 months). Eighty percent were implanted for a predominant complaint of urinary urgency and frequency (U/F). Overall, 22% had U/F only, 38% had concomitant urge incontinence (UI), and 20% had concomitant mixed incontinence (MI). Twenty percent were treated for non-obstructive urinary retention (UR), with half of these associated with a neurogenic etiology. Additionally, 46.2% had pelvic pain, 58.6% had bowel complaints, and 51% reported sexual dysfunction. In patients with U/F, mean voiding parameters as described by pre-implant voiding diaries revealed the following: 12.4 (+/-5.1) voids per 24 hr; 2.3 (+/-1.8) voids per night; 5.0 (+/-4.7) leaks per 24 hr; and 2.3 (+/-2.6) pads per 24 hr. Statistically significant improvements post-implantation were noted with mean decreases in the following: 4.3 voids per 24 hr; 1.0 void per night; 4.4 leaks per 24 hr; and 2.3 pads per 24 hr (all P < 0.05). In the UR group a statistically significant improvement post-implantation was noted only in voids per night, with a mean decrease of 0.8 (P < 0.05). With a mean follow up of 22 months (range 3-162 months), sustained subjective improvement was >50%, >80%, and >90% in 69%, 50%, and 35% of patients, respectively. By quality of life survey, 60.5% of patients were satisfied and 16.1% were dissatisfied with current urinary symptoms. Only 13% (14 patients) abandoned therapy, making up a significant portion of those dissatisfied with current urinary symptoms. Good overall lead durability was seen (mean 22 months, range 1-121 months), with the first successful lead proving to be the most durable (mean 28 months, range 1.4-120 months). Lead durability decreased progressively with subsequent trials. Overall, 53% of patients experienced at least one reportable event (RE) attributable to either lead or IPG. A total of 126 REs were noted, with 97% mild-to-moderate in severity. REs included lack of efficacy, loss of efficacy, infection, hematoma/seroma, migration, pain, undesirable change in sensation, and device malfunction. In this population, 47.1% of leads were tined while 52.9% were non-tined. Tined leads had an overall lower RE rate as compared to non-tined leads: 28% and 73%, respectively.

CONCLUSIONS

SNS is an effective method for treating certain types of voiding dysfunction. Although 53% of patients experienced at least one RE, 97% were mild-to-moderate and did not appear to affect the continued use of this therapy. With improved technology, such as percutaneous tined leads, the RE rate is decreasing. Further analyses of subsets of this population are currently underway.

Maximising response to postal questionnaires--a systematic review of randomised trials in health research

Background

Postal self-completion questionnaires offer one of the least expensive modes of collecting patient based outcomes in health care research. The purpose of this review is to assess the efficacy of methods of increasing response to postal questionnaires in health care studies on patient populations.

Methods

The following databases were searched: Medline, Embase, CENTRAL, CDSR, PsycINFO, NRR and ZETOC. Reference lists of relevant reviews and relevant journals were hand searched. Inclusion criteria were randomised trials of strategies to improve questionnaire response in health care research on patient populations. Response rate was defined as the percentage of questionnaires returned after all follow-up efforts. Study quality was assessed by two independent reviewers. The Mantel-Haenszel method was used to calculate the pooled odds ratios.

Results

Thirteen studies reporting fifteen trials were included. Implementation of reminder letters and telephone contact had the most significant effect on response rates (odds ratio 3.7, 95% confidence interval 2.30 to 5.97 p = <0.00001). Shorter questionnaires also improved response rates to a lesser degree (odds ratio 1.4, 95% confidence interval 1.19 to 1.54). No evidence was found that incentives, re-ordering of questions or including an information brochure with the questionnaire confer any additional advantage.

Conclusion

Implementing repeat mailing strategies and/or telephone reminders may improve response to postal questionnaires in health care research. Making the questionnaire shorter may also improve response rates. There is a lack of evidence to suggest that incentives are useful. In the context of health care research all strategies to improve response to postal questionnaires require further evaluation.

The needs of families of children with heart disease

The aim of the study was to assess the perceived needs of children with heart disease of their parents and siblings and to determine the support and services that the families were currently receiving. A mailed survey of 447 families of children with congenital or acquired heart disease was conducted. Completed questionnaires were received from 209 (46.8%) families, 124 (59%) of whom had unmet needs in one or more areas. Information was the area in which there was the greatest degree of expressed need. While the majority of families received support from family and friends, community-based statutory services and support were less adequate. However, a number of families who were not receiving support from community professionals did not want any intervention. It is concluded that interventions need to be targeted so that those families needing additional services and support receive them. Implications for the development of an evidence-based children's cardiac liaison nursing service are discussed.

In a randomized trial, outcomes were not affected by intensive follow-up over 1 year

OBJECTIVE

This study tested the impact on response and psychological measures of different follow-up schedules for participants in a study screening for type 2 diabetes risk.

STUDY DESIGN AND SETTING

Participants were randomly allocated either to limited follow-up (n=213), with a single questionnaire at 1 year, or to intensive follow-up (n=218), with questionnaires sent 1, 6, and 12 months after screening.

RESULTS

There were no statistically significant differences between the groups at 1 year in either response rate (P=.08) or change from baseline to 1-year follow-up in scores on the short form of the Spielberger State Anxiety Inventory (SSAI-SF; P=.13), although there was a statistically significant but small difference between the groups in the change score of the 12-item Well-Being Questionnaire (WBQ-12; P=.003). The proportion of participants completing a WBQ-12 measure at 1 year was significantly greater in the intensive follow-up group (P=.03).

CONCLUSION

This study shows no important adverse effect of repeated questionnaire use on response rates or psychological outcomes and suggests that some measures may be more fully completed with intensive follow-up.

Quality of life of people with venous leg ulcers: A comparison of the discriminative and responsive characteristics of two generic and a disease specific instruments

BACKGROUND

Venous leg ulcers are an important source of morbidity in society. Measuring the impact of leg ulcers on quality of life is important within clinical and economic evaluations. In this study we report a validation study of the leg ulcer disease specific Hyland questionnaire and compare its discriminative and responsive characteristics to general health quality of life measures: the SF-12 and EQ-5D.

METHODS

HRQoL of venous leg ulcer patients from 9 UK regions was measured using SF-12, EQ-5D and Hyland, at baseline and every three months for 1 year. Psychometric analysis was used to confirm the validity of the Hyland questionnaire. Quarterly scores for all instruments were calculated. Effect size and standardised mean difference were used to investigate the responsiveness to ulcer healing and discriminative abilities of the instruments.

RESULTS

Three hundred and eighty seven individuals were recruited into the VenUS I study. Baseline health related quality of life data from the study participants suggested a two factor solution for the Hyland. This questionnaire was associated with small and moderate ability to discriminate individuals according to age, mobility, initial ulcer size and ulcer duration. SF-12 and EQ-5D had good evaluative properties; both instruments were responsive to changes in HRQoL after ulcer healing. High levels of bodily pain were reported in the SF-12 questionnaire, whilst only minor ulcer related discomfort was reported in the Hyland.

DISCUSSION

SF-12 and EQ-5D are suitable for exploring dimensions of health related quality of life in people with chronic venous leg ulceration. The responsiveness to healing of the Hyland questionnaire is unclear. We would recommend the use of generic instruments for the measurement of HRQoL in patients with venous leg ulcers.

Female specialists were more likely to respond to a postal questionnaire about drug treatments for Alzheimer disease

OBJECTIVE

To assess demographic predictors of response for specialists who were mailed a postal questionnaire on drug treatments for Alzheimer disease.

STUDY DESIGN AND SETTING

The questionnaire was sent to 317 specialists in Quebec, Canada. Demographic variables included specialty, urban/rural practice, language, sex, and 'number of years since receiving a medical license.' The specialists were stratified according to responder status (i.e., respondent/nonrespondent), and respondents were further stratified as early or late responders. Variables differing between these strata were entered into logistic regression models to see if they predicted response.

RESULTS

Only 'female sex' was a predictor of response in the respondent/nonrespondent analysis (OR 2.03; 95% CI 1.17, 3.53). No demographic variables predicted early or late response.

CONCLUSION

Researchers planning postal questionnaires should target male specialists with modified or additional mailings to increase response and reduce the potential for nonresponse bias. Caution should be exercised when comparing early vs. late responders as a means of assessing nonresponse bias.