Assessing and Improving Data Integrity in Web-Based Surveys: Comparison of Fraud Detection Systems in a COVID-19 Study

BACKGROUND

Web-based surveys increase access to study participation and improve opportunities to reach diverse populations. However, web-based surveys are vulnerable to data quality threats, including fraudulent entries from automated bots and duplicative submissions. Widely used proprietary tools to identify fraud offer little transparency about the methods used, effectiveness, or representativeness of resulting data sets. Robust, reproducible, and context-specific methods of accurately detecting fraudulent responses are needed to ensure integrity and maximize the value of web-based survey research.

OBJECTIVE

This study aims to describe a multilayered fraud detection system implemented in a large web-based survey about COVID-19 attitudes, beliefs, and behaviors; examine the agreement between this fraud detection system and a proprietary fraud detection system; and compare the resulting study samples from each of the 2 fraud detection methods.

METHODS

The PhillyCEAL Common Survey is a cross-sectional web-based survey that remotely enrolled residents ages 13 years and older to assess how the COVID-19 pandemic impacted individuals, neighborhoods, and communities in Philadelphia, Pennsylvania. Two fraud detection methods are described and compared: (1) a multilayer fraud detection strategy developed by the research team that combined automated validation of response data and real-time verification of study entries by study personnel and (2) the proprietary fraud detection system used by the Qualtrics (Qualtrics) survey platform. Descriptive statistics were computed for the full sample and for responses classified as valid by 2 different fraud detection methods, and classification tables were created to assess agreement between the methods. The impact of fraud detection methods on the distribution of vaccine confidence by racial or ethnic group was assessed.

RESULTS

Of 7950 completed surveys, our multilayer fraud detection system identified 3228 (40.60%) cases as valid, while the Qualtrics fraud detection system identified 4389 (55.21%) cases as valid. The 2 methods showed only "fair" or "minimal" agreement in their classifications (κ=0.25; 95% CI 0.23-0.27). The choice of fraud detection method impacted the distribution of vaccine confidence by racial or ethnic group.

CONCLUSIONS

The selection of a fraud detection method can affect the study's sample composition. The findings of this study, while not conclusive, suggest that a multilayered approach to fraud detection that includes conservative use of automated fraud detection and integration of human review of entries tailored to the study's specific context and its participants may be warranted for future survey research.

"Are You a Boy or a Girl?"-A Missing Response Analysis

Many adolescent health surveys ask if respondents are male or female. Non-response may be due to fear of de-anonymisation or being a gender-nonconforming youth. The present study investigates the frequency of non-response and its potential reasons. To this end, data from 54,833 adolescents aged 11-18 from six countries, participating in the 2018 Health Behaviour in School-aged Children (HBSC) study, were analysed. Respondents were divided into three groups: (1) "Responders" who answered both questions on age and gender, (2) "Age non-responders" who did not answer the question on age, and (3) "Gender non-responders" who answered the question on age but not the one on gender. These groups were compared regarding their non-response to other questions and regarding their health. Overall, 98.0% were responders, 1.6% were age non-responders and 0.4% were gender non-responders. On average, age non-responders skipped more questions (4.2 out or 64) than gender non-responders (3.2) and responders (2.1). Gender non-responders reported more psychosomatic complaints, more frequent substance use and lower family support than responders. This study shows that age and gender non-responders differ in their response styles, suggesting different reasons for skipping the gender question. The health disparities found between the groups suggest that further research should use a more nuanced approach, informed by LGBT+ youth's insights, to measure sex assigned at birth and gender identity.

Health Care Provider Stigma Toward Patients With Substance Use Disorders: Protocol for a Nationally Representative Survey

BACKGROUND

The US overdose epidemic is an escalating public health emergency, accounting for over 100,000 deaths annually. Despite the availability of medications for opioid use disorders, provider-level barriers, such as negative attitudes, exacerbate the treatment gap in clinical care settings. Assessing the prevalence and intensity of provider stigma, defined as the negative perceptions and behaviors that providers embody and enact toward patients with substance use disorders, across providers with different specialties, is critical to expanding the delivery of substance use treatment.

OBJECTIVE

To thoroughly understand provider stigma toward patients with substance use disorders, we conducted a nationwide survey of emergency medicine and primary care physicians and dentists using a questionnaire designed to reveal how widely and intensely provider attitudes and stigma can impact these providers' clinical practices in caring for their patients. The survey also queried providers' stigma and clinical practices toward other chronic conditions, which can then be compared with their stigma and practices related to substance use disorders.

METHODS

Our cross-sectional survey was mailed to a nationally representative sample of primary care physicians, emergency medicine physicians, and dentists (N=3011), obtained by American Medical Association and American Dental Association licensees based on specified selection criteria. We oversampled nonmetropolitan practice areas, given the potential differences in provider stigma and available resources in these regions compared with metropolitan areas. Data collection followed a recommended series of contacts with participants per the Dillman Total Design Method, with mixed-modality options offered (email, mail, fax, and phone). A gradually increasing compensation scale (maximum US$250) was implemented to recruit chronic nonresponders and assess the association between requiring higher incentives to participate and providers stigma. The primary outcome, provider stigma, was measured using the Medical Condition Regard Scale, which inquired about participants' views on substance use and other chronic conditions. Additional survey measures included familiarity and social engagement with people with substance use disorders; clinical practices (screening, treating, and referring for a range of chronic conditions); subjective norms and social desirability; knowledge and prior education; and descriptions of their patient populations.

RESULTS

Data collection was facilitated through collaboration with the National Opinion Research Center between October 2020 and October 2022. The overall Council of American Survey Research Organizations completion rate was 53.62% (1240/2312.7; physicians overall: 855/1681.9, 50.83% [primary care physicians: 506/1081.3, 46.79%; emergency medicine physicians: 349/599.8, 58.2%]; dentists: 385/627.1, 61.4%). The ineligibility rate among those screened is applied to those not screened, causing denominators to include fractional numbers.

CONCLUSIONS

Using systematically quantified data on the prevalence and intensity of provider stigma toward substance use disorders in health care, we can provide evidence-based improvement strategies and policies to inform the development and implementation of stigma-reduction interventions for providers to address their perceptions and treatment of substance use.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/47548.

Surveys on migration aspirations, plans and intentions: a comprehensive overview

Survey data on migration aspirations, plans and intentions is important for understanding the drivers and dynamics of migration. Such data has been collected since the 1960s but has expanded massively in recent decades. This paper provides the first comprehensive overview of existing survey data in an inventory of 212 surveys with recorded metadata on geographic and temporal coverage, survey population, sample size, and other characteristics. 'A survey' is not always a clear-cut unit of analysis, but we adopted procedures that enable systematic comparisons, and identified surveys through systematic searches and follow-up investigation. The paper has three objectives. First, it facilitates reuse of survey data and secondary analysis, albeit with limitations in data access, which we document. Second, it helps consolidate a sprawling field and thereby contribute to methodological and theoretical strengthening. Third, it informs debates on the ethics, politics and biases of data collection by documenting broad patterns in the body of knowledge. The inventory of survey data on migration aspirations and related concepts gives migration researchers a new tool for locating existing data and strengthening the foundations for collecting new data.

Development of a tool to assess bladder health knowledge, attitudes, and beliefs (BH-KAB)

INTRODUCTION

Few instruments measure knowledge, attitudes, and beliefs (KAB) related to bladder health. Existing questionnaires have predominantly focused on KAB related to specific conditions such as urinary incontinence, overactive bladder, and other pelvic floor disorders. To address this literature gap, the Prevention of Lower Urinary Tract Symptoms (PLUS) research consortium developed an instrument that is being administered in the baseline assessment of the PLUS RISE FOR HEALTH longitudinal study.

METHODS

The bladder health knowledge, attitudes, and beliefs (BH-KAB) instrument development process consisted of two phases, item development and evaluation. Item development was guided by a conceptual framework, review of existing KAB instruments, and a review of qualitative data from the PLUS consortium Study of Habits, Attitudes, Realities, and Experiences (SHARE). Evaluation comprised three methods to assess content validity and reduce and refine items: q-sort, e-panel survey, and cognitive interviews.

RESULTS

The final 18-item BH-KAB instrument assesses self-reported bladder knowledge; perceptions of bladder function, anatomy, and related medical conditions; attitudes toward different patterns of fluid intake, voiding, and nocturia; the potential to prevent or treat urinary tract infections and incontinence; and the impact of pregnancy and pelvic muscle exercises on bladder health.

CONCLUSION

The PLUS BH-KAB instrument may be used independently or in conjunction with other KAB instruments for a more comprehensive assessment of women's KAB related to bladder health. The BH-KAB instrument can inform clinical conversations, health education programming, and research examining potential determinants of bladder health, LUTS, and related behavioral habits (e.g., toileting, fluid intake, pelvic muscle exercises).

Development of a candidate item bank for measuring mobility of lower limb orthosis users

BACKGROUND

Orthoses are often prescribed to improve mobility of people with chronic health conditions that affect lower limb function. Patient-reported survey instruments can be used to measure aspects of mobility that cannot be easily assessed in clinical or research settings. A population-specific item bank could be designed to measure aspects of mobility that are most important to lower limb orthosis users and used to evaluate the effects of orthoses.

OBJECTIVE

To develop items for a new survey instrument to measure mobility of lower limb orthosis users.

DESIGN

Survey items were developed using a qualitative item review process.

SETTING

Focus groups were held by video conferencing. Cognitive interviews were conducted by telephone.

PARTICIPANTS

Focus group and cognitive interview participants were adults with at least 6 months of experience using a lower limb orthosis that extended from the foot to a level above the ankle.

METHODS

Research methods included focus groups with lower limb orthosis users, an item generation and reduction process that involved a stakeholder advisory panel, and cognitive interviews with target respondents.

RESULTS

A total of 1180 extant items were identified in a literature review. Focus group participants (n = 29) provided feedback that informed the suitability of a construct definition and conceptual model. An advisory panel contributed to the selection of 118 candidate items for measuring orthotic mobility. Feedback from cognitive interview participants (n = 30) informed removal or revision of problematic items, resulting in a candidate bank of 100 mobility items.

CONCLUSIONS

The rigorous qualitative methods applied here resulted in a large set of candidate items that spanned a range of situations relevant to moving with a lower limb orthosis. Next steps include administration of the candidate items to a large sample of lower limb orthosis users and calibration of the item bank.

The Netherlands Mental Health Survey and Incidence Study-3 (NEMESIS-3): Objectives, methods and baseline characteristics of the sample

OBJECTIVES

NEMESIS-3 (Netherlands Mental Health Survey and Incidence Study-3) is a psychiatric epidemiological cohort study of the Dutch general population that replicates and expands on two previous NEMESIS-studies conducted in 1996-1999 and 2007-2018 respectively. The main aims of NEMESIS-3 are to provide up-to-date information on the prevalence, incidence, course and consequences of mental disorders, their risk indicators, and to study the relevant time trends. This paper gives an overview of the objectives and methods of NEMESIS-3, especially of the recently completed first wave, and describes the sample characteristics.

METHODS

NEMESIS-3 is based on a multistage, stratified random sampling of individuals aged 18-75 years. Face-to-face interviews were laptop computer-assisted and held at the respondent's home. A slightly modified Composite International Diagnostic Interview (CIDI) version 3.0 was used to assess both Diagnostic and Statistical Manual of Mental Disorders-IV (DSM-IV) and DSM-5 mental disorders. Two follow-up waves are planned three and six years after baseline.

RESULTS

In the first wave, performed from November 2019 to March 2022, 6194 individuals were interviewed: 1576 respondents before and 4618 respondents during the COVID-19 pandemic. The average interview duration was 91 min and the response rate was 54.6%. The sample consisted of 50.4% women and had a mean age of 47.9 years. The sample was reasonable nationally representative, although some sociodemographic groups were somewhat underrepresented.

CONCLUSIONS

Despite the COVID-19 restrictions, we were able to build a large and comprehensive dataset of good quality, permitting us to investigate the latest trends in mental health status, various new topics related to mental health, and the extent to which the pandemic has had an effect on the population's mental health.

Comparison of self-reported lifetime concussions and mild traumatic brain injuries among adults

INTRODUCTION

The reliability of self-reported brain injury data relies on how well people interpret the questions.

OBJECTIVE

This study examines how different yet commonly used questions may impact traumatic brain injury (TBI) estimates.

METHODS

Self-report data were collected from 4,053 respondents in the summer wave of Porter Novelli's 2020 ConsumerStyles survey. Respondents were randomized to be asked about lifetime experience of either concussion or mild TBI (mTBI) and then asked follow-up questions.

RESULTS

Approximately 25.5% of respondents reported sustaining a concussion in their lifetime while 17.2% reported an mTBI. The circumstances of the injuries, such as location and mechanism of injury, were similar. A greater percentage of individuals who were asked about concussions (91.1%) reported receiving a diagnosis for their most serious injury compared to those who were asked about diagnosis of an mTBI (69.9%).

DISCUSSION

A greater percentage of respondents reported a lifetime history of concussion than mTBI. More respondents with a lifetime history of concussion reported receiving a diagnosis. These results suggest that the terminology used can impact reporting. These findings suggest that there is a meaningful difference in the understanding of the terms 'concussion' and 'mild TBI,' with people perceiving mTBI as a more serious injury.

Dealing with Careless Responding in Survey Data: Prevention, Identification, and Recommended Best Practices

Surveys administered online have several benefits, but they are particularly prone to careless responding, which occurs when respondents fail to read item content or give sufficient attention, resulting in raw data that may not accurately reflect respondents' true levels of the constructs being measured. Careless responding can lead to various psychometric issues, potentially impacting any area of psychology that uses self-reported surveys and assessments. This review synthesizes the careless responding literature to provide a comprehensive understanding of careless responding and ways to prevent, identify, report, and clean careless responding from data sets. Further, we include recommendations for different levels of screening for careless responses. Finally, we highlight some of the most promising areas for future work on careless responding.

Anthropometric dataset for the German working-age population using 3D body scans from a regional epidemiological health study and a weighting algorithm

For the ergonomic design of workplaces and products, a representative anthropometric dataset of the working-age population is needed. As body proportions are constantly changing and the latest publicly available dataset for Germany was published in 2004 (data collection period 1999-2002), the aim of this study was to create and publish an updated anthropometric dataset of the German working-age population. Within a regional epidemiological health study, 3D body scan data from 2313 subjects were collected and used to create an anthropometric dataset with a total of 39 ISO 7250-1 measures. To approximate the goal of generating representative values for Germany, the collected regional dataset was weighted with an algorithm, using values from a known nationally representative survey. Based on the weighted dataset, a gender stratified percentile table with values for the 5th, 50th, and 95th percentile was calculated. Practitioner summary: Body proportions are constantly changing and the latest publicly available anthropometric dataset for Germany was published in 2004. A new dataset was created, using 3D body scans from an epidemiological health study and a weighting algorithm. Ultimately, percentile tables with values for the 5th, 50th, and 95th percentile are published.

Attitudes and access to resources and strategies to improve quality of radiotherapy among US radiation oncologists: A mixed methods study

INTRODUCTION

We aimed to assess contouring-related practices among US radiation oncologists and explore how access to and use of resources and quality improvement strategies vary based on individual- and organization-level factors.

METHODS

We conducted a mixed methods study with a sequential explanatory design. Surveys were emailed to a random 10% sample of practicing US radiation oncologists. Participating physicians were invited to a semi-structured interview. Kruskal-Wallis and Wilcoxon rank-sum tests and a multivariable regression model were used to evaluate associations. Interview data were coded using thematic content analysis.

RESULTS

Survey overall response rate was 24%, and subsequent completion rate was 97%. Contouring-related questions arise in ≥50% of clinical cases among 73% of respondents. Resources accessed first include published atlases (75%) followed by consulting another radiation oncologist (60%). Generalists access consensus guidelines more often than disease-site specialists (P = 0.04), while eContour.org is more often used by generalists (OR 4.3, 95% CI 1.2-14.8) and younger physicians (OR 1.33 for each 5-year increase, 95% CI 1.08-1.67). Common physician-reported barriers to optimizing contour quality are time constraints (58%) and lack of access to disease-site specialists (21%). Forty percent (40%, n = 14) of physicians without access to disease-site specialists indicated it could facilitate the adoption of new treatments. Almost all (97%) respondents have formal peer review, but only 43% have contour-specific review, which is more common in academic centres (P = 0.02).

CONCLUSION

Potential opportunities to improve radiation contour quality include improved access to disease-site specialists and contour-specific peer review. Physician time must be considered when designing new strategies.

Aggressive incidents in home care services and organizational support: A cross-sectional survey in Switzerland

AIMS

To explore the available organizational structures addressing aggressive incidents towards home care services staff.

BACKGROUND

Organizational structures how professional caregivers deal with care recipients' aggressive incidents.

METHODS

An explorative cross-sectional survey using the Violence Experienced by Staff (German version revised) and the Impact of Patient Aggression on Carers Scale was conducted. Data from 852 health care professionals in the German-speaking part of Switzerland were collected between July and October 2019. Multiple logistic regression models were used to investigate associations. The STROBE-Checklist was used as the reporting guideline.

RESULTS

Organizational support and management support in home care services were generally rated high and found to cause a significant decrease in negative feelings. Some self-rated skills regarding aggression management were linked to a decrease in perceived burden after aggressive incidents, whereas others increased the perceived burden.

CONCLUSION

Organizational structures including official procedures for affected professional caregivers should be established in home care services. This should contain efficient reporting systems and aggression management training for the specific setting.

IMPLICATIONS FOR NURSING MANAGEMENT

The study highlights the importance of organizational support regarding aggressive incidents in the home care setting as well as of aggression management training.

A Procedure for Eliciting Women's Preferences for Breast Cancer Screening Frequency

BACKGROUND

We evaluate the construct validity of a proposed procedure for eliciting lay preferences among health care policy options, suited for structured surveys. It is illustrated with breast cancer screening, a domain in which people may have heterogeneous preferences.

METHODS

Our procedure applies behavioral decision research principles to eliciting preferences among policy options expressed in quantitative terms. Three-hundred women older than 18 y without a history of breast cancer were recruited through Amazon MTurk. Participants evaluated 4 screening options for each of 4 groups of women, with varying risk of breast cancer. Each option was characterized by estimates of 3 primary outcomes: breast cancer deaths, false alarms, and overdiagnosis resulting in unnecessary treatment of cancers that would not progress. These estimates were based on those currently being developed by the Breast Cancer Surveillance Consortium. For each risk group, participants stated how frequently they would wish to receive screening, if the predicted outcomes applied to them.

RESULTS

A preregistered test found that preferences were robust enough to be unaffected by the order of introducing and displaying the outcomes. Other tests of construct validity also suggested that respondents generally understood the task and expressed consistent preferences. Those preferences were related to participants' age and mammography history but not to measures of their numeracy, subjective numeracy, or demographics. There was considerable heterogeneity in their preferences.

CONCLUSIONS

Members of the public can be engaged more fully in informing future screening guidelines if they evaluate the screening options characterized by the expected health outcomes expressed in quantitative terms. We offer and evaluate such a procedure, in terms of its construct validity with a diverse sample of women.

HIGHLIGHTS

A novel survey method for eliciting lay preferences for breast cancer screening is proposed and evaluated in terms of its construct validity.Participants were generally insensitive to irrelevant task features (e.g., order of presentation) and sensitive to relevant ones (e.g., quantitative estimates of breast cancer risk, harms from screening).The proposed method elicits lay preferences in terms that can inform future screening guidelines, potentially improving communication between the public and policy makers.

Development and Validation of the Young Adult Nutrition Literacy Tool

OBJECTIVE

To create a tool to measure college students' functional, interactive, and critical nutrition literacy.

DESIGN

(1) Focus group: item generation, (2) expert review, (3) exploratory factor structure analysis, (4) item refinement and modification, (5) factor structure validation, and (6) criterion validation.

SETTING

Two land-grant college campuses.

PARTICIPANTS

College students aged between 18 and 24 years.

MAIN OUTCOME MEASURES

Survey data was used to assess nutrition literacy.

ANALYSIS

Exploratory factor analysis, confirmatory factor analysis (CFA), item response theory (IRT) analyses, and correlations.

RESULTS

One-hundred and twenty-three items were generated and tested in an online survey format. Items were eliminated on the basis of face validity, expert feedback, exploratory factor analysis, and CFA/IRT. The 3 measures (functional, interactive, and critical) were analyzed separately. All 3 measures showed reasonable model fit in the CFA/IRT models. Criterion validity showed small to medium effect sizes between measures and fruit/vegetable intake. Reliability estimates met reasonable standards for each measure.

CONCLUSIONS AND IMPLICATIONS

The Young Adult Nutrition Literacy Tool is a novel instrument that measures all 3 domains of nutrition literacy. Strengths include a rigorous 6-step development process, reasonable psychometric properties, and a large breadth of items.

Examining Anxiety Treatment Information Needs: Web-Based Survey Study

BACKGROUND

Several treatments for anxiety are available, which can make treatment decisions difficult. Resources are often produced with limited knowledge of what information is of interest to consumers. This is a problem because there is limited understanding of what people want to know when considering help for anxiety.

OBJECTIVE

This study aimed to examine the information needs and preferences concerning treatment options for anxiety by assessing the following: what information people consider to be important when they are considering treatment options for anxiety, what information people have received on psychological and medication treatment in the past, how they received this information in the past, and whether there are any differences in information needs between specific samples and demographic groups.

METHODS

Using a web-based survey, we recruited participants from a peer-support association website (n=288) and clinic samples (psychology, n=113; psychiatry, n=64).

RESULTS

Participants in all samples wanted information on a broad range of topics pertaining to anxiety treatment. However, they reported that they did not receive the desired amount of information. Participants in the clinic samples rated the importance of information topics higher than did those in the self-help sample. When considering the anxiety treatment information received in the past, most respondents indicated receiving information from informational websites, family doctors, and mental health practitioners. In terms of what respondents want to learn about, high ratings of importance were given to topics concerning treatment effectiveness, how it works, advantages and disadvantages, what happens when it stops, and common side effects.

CONCLUSIONS

It is challenging for individuals to obtain anxiety-related information on the range of topics they desire through currently available information sources. It is also difficult to provide comprehensive information during typical clinical visits. Providing evidence-based information on the web and in a brochure format may help consumers make informed choices and support the advice provided by health professionals.

Special education staff well-being and the effectiveness of remote services during the COVID-19 pandemic

Since March 2020, many school districts across the country have employed remote learning procedures in response to the COVID-19 pandemic. During the pandemic, schools continued to provide special education services, yet little is known about how services were adapted for remote or hybrid learning during the height of the pandemic in the United States. In the current study, 332 respondents completed a web-based survey that asked what special education services were provided remotely, whether services were deemed effective, and how remote learning has influenced their well-being. Most respondents identified as White (79.5%), females (92.4%), and worked as special education teachers (52.9%) and school psychologists (35.4%). In compliance with federal guidelines, most respondents continued to hold individualized education plan meetings, conduct assessments, and provide interventions and related services. There was a significant decrease in respondents' reports of efficacy and sense of school connectedness during remote and hybrid learning. Respondents' identification as a person of color, along with reports of higher school connectedness and self-efficacy were positive predictors of their perceived effectiveness of remote special education service delivery. Recommendations are made for school districts to inform decisions regarding their approach to special education services and staff support during remote or hybrid learning.

Design, content, and fieldwork procedures of the COVID-19 Psychological Research Consortium (C19PRC) Study - Wave 4

OBJECTIVES

This paper outlines fieldwork procedures for Wave 4 of the COVID-19 Psychological Research Consortium (C19PRC) Study in the UK during November-December 2020.

METHODS

Respondents provided data on socio-political attitudes, beliefs, and behaviours, and mental health disorders (anxiety, depression, and posttraumatic stress). In Phase 1, adults (N = 2878) were reinvited to participate. At Phase 2, new recruitment: (i) replenished the longitudinal strand to account for attrition; and (ii) oversampled from the devolved UK nations to facilitate robust between-country analyses for core study outcomes. Weights were calculated using a survey raking algorithm to ensure the longitudinal panel was representative of the baseline sample characteristics.

RESULTS

In Phase 1, 1796 adults were successfully recontacted and provided full interviews at Wave 4 (62.4% retention rate). In Phase 2, 292 new respondents were recruited to replenish the panel, as well as 1779 adults from Wales, Scotland, and Northern Ireland, who were representative of the socio-political composition of the adult populations in these nations. The raking procedure successfully re-balanced the longitudinal panel to within 1% of population estimates for selected socio-demographic characteristics.

CONCLUSION

The C19PRC Study offers a unique opportunity to facilitate and stimulate interdisciplinary research addressing important public health questions relating to the COVID-19 pandemic.

Psychometric properties of the perinatal missed care survey and missed care during labor and birth

Aim:

To evaluate the psychometric characteristics of the Perinatal Missed Care Survey and assess the prevalence of nurse-reported missed care during labor and birth.

Background:

Nursing care during labor and birth differs from other nursing care. Empirical evidence is scant regarding nursing quality and missed nursing care during labor and birth, which are important aspects of quality in maternity care.

Methods:

We conducted exploratory and confirmatory factor analysis on a previously developed perinatal missed nursing care instrument using data from 3,466 registered nurses. Measures included missed nursing care, reasons for missed nursing care, and demographic characteristics. All birth hospitals in each of 37 states were invited to distribute surveys electronically via email to their labor and delivery RN staff. The overall response rate from 277 hospitals that facilitated the survey was 35%.

Results:

Some missed care was reported for each of 25 missed care items. Labor support, intake and output, patient teaching, timely documentation, timely medication administration, and thorough review of prenatal records were missed at least occasionally by >50% respondents. Labor resources (83%), material resources (77%), and communication (60%) were reported reasons for missed nursing care. Exploratory factor analysis aligned with previous testing. Confirmatory factor analysis demonstrated good model fit.

Conclusions:

The Perinatal Missed Care Survey demonstrates good validity and reliability as a measure of missed nursing care during labor and birth. Our findings suggest missed nursing care during labor and birth is prevalent and occurs in aspects of care that could contribute to patient harm when missed.

Gender-Inclusive and Gender-Specific Approaches in Trans Health Research

The recent proliferation of trans health literature for the past 20 years has prompted a need to examine two contested approaches used in designing study protocols and analyses in trans health research, as either specific to only one gender group (gender-specific approach) or across gender groups (i.e., gender-inclusive approach). In this critique, we aim to explicate and provide guidance for when the application of each approach is methodologically appropriate.

The Use of Multimode Data Collection in Random Digit Dialing Cell Phone Surveys for Young Adults: Feasibility Study

Background

Young adults’ early adoption of new cell phone technologies have created challenges to survey recruitment but offer opportunities to combine random digit dialing (RDD) sampling with web mode data collection. The National Young Adult Health Survey was designed to test the feasibility of this methodology.

Objective

In this study, we compared response rates across the telephone mode and web mode, assessed sample representativeness, examined design effects (DEFFs), and compared cigarette smoking prevalence to a gold standard national survey.

Methods

We conducted a survey experiment where the sampling frame was randomized to single-mode telephone interviews, telephone-to-web sequential mixed mode, and single-mode web survey. A total of 831 respondents aged 18 to 34 years were recruited via RDD at baseline. A soft launch was conducted prior to main launch. We compared the web mode to the telephone modes (ie, single-mode and mixed mode) at wave 1 based on the American Association for Public Opinion Research response rate 3 for screening and extended surveys. Base-weighted demographic distributions were compared to the American Community Survey. The sample was calibrated to the US Census Bureau's American Community Survey to calculate DEFFs and to compare cigarette smoking prevalence to the National Health Interview Survey. Prevalence estimates are estimated with sampling weights and are presented with unweighted sample sizes. Consistency of estimates was judged by 95% CI.

Results

The American Association for Public Opinion Research response rate 3 was higher in the telephone mode than in the web mode (24% and 30% vs 6.1% and 12.5%, for soft launch and main launch, respectively), which was reflected in response rate 3 for screening and extended surveys. During the soft launch, the extended survey and eligibility rate were low for respondents pushed to the web mode. To boost productivity and survey completes for the web condition, the main launch used cell phone numbers from the sampling frame where the sample vendor matched the number to auxiliary data, which suggested that the number likely belonged to an adult in the target age range. This increased the eligibility rate, but the screener response rate was lower. Compared to population distribution from the US Census Bureau, the telephone mode overrepresented men (57.1% [unweighted n=412] vs 50.9%) and those enrolled in college (40.3% [unweighted n=269] vs 23.8%); it also underrepresented those with a Bachelor of Arts or Science (34.4% [unweighted n=239] vs 55%). The web mode overrepresented White, non-Latinos (70.7% [unweighted n=90] vs 54.4%) and those with some college education (30.4% [unweighted n=40] vs 7.6%); it also underrepresented Latinos (13.6% [unweighted n=20] vs 20.7%) and those with a high school or General Education Development diploma (15.3% [unweighted n=20] vs 29.3%). The DEFF measure was 1.28 (subpopulation range 0.96-1.93). The National Young Adult Health Survey cigarette smoking prevalence was consistent with the National Health Interview Survey overall (15%, CI 12.4%-18% [unweighted 149/831] vs 13.5%, CI 12.3%-14.7% [unweighted 823/5552]), with notable deviation among 18- to 24-year-olds (15.6%, CI 11.3%-22.2% [unweighted 51/337] vs 8.7%, CI 7.1%-10.6% [unweighted 167/1647]), and those with education levels lower than Bachelor of Arts or Science (24%, CI 19.3%-29.4% [unweighted 123/524] vs 17.1%, CI 15.6%-18.7% [unweighted 690/3493]).

Conclusions

RDD sampling for a web survey is not feasible for young adults due to its low response rate. However, combining this methodology with RDD telephone surveys may have a great potential for including media and collecting autophotographic data in population surveys.

Willingness to Share Data From Wearable Health and Activity Trackers: Analysis of the 2019 Health Information National Trends Survey Data

BACKGROUND

Sharing data from wearable health and activity trackers (wearables) with others may improve the health and behavioral outcomes of wearable users by generating social support and improving their ability to manage their health. Investigating individual factors that influence US adults' willingness to share wearable data with different types of individuals may provide insights about the population subgroups that are most or least likely to benefit from wearable interventions. Specifically, it is necessary to identify digital health behaviors potentially associated with willingness to share wearable data given that the use of and engagement with various technologies may broadly influence web-based health information-sharing behaviors.

OBJECTIVE

This study aims to identify sociodemographic, health, and digital health behavior correlates of US adults' willingness to share wearable data with health care providers and family or friends.

METHODS

Data for the analytic sample (N=1300) were obtained from the 2019 Health Information National Trends Survey of the National Cancer Institute. Digital health behavior measures included frequency of wearable device use, use of smartphones or tablets to help communicate with providers, use of social networking sites to share health information, and participation in a web-based health community. Multivariable logistic regression analysis of weighted data examined the associations between digital health behaviors and willingness to share wearable device data, controlling for sociodemographics and health-related characteristics.

RESULTS

Most US adults reported willingness to share wearable data with providers (81.86%) and with family or friends (69.51%). Those who reported higher health self-efficacy (odds ratio [OR] 1.97, 95% CI 1.11-3.51), higher level of trust in providers as a source of health information (OR 1.98, 95% CI 1.12-3.49), and higher level of physical activity (OR 2.00, 95% CI 1.21-3.31) had greater odds of willingness to share data with providers. In addition, those with a higher frequency of wearable use (OR 2.15, 95% CI 1.35-3.43) and those who reported use of smartphones or tablets to help communicate with providers (OR 1.99, 95% CI 1.09-3.63) had greater odds of willingness to share data with providers. Only higher level of physical activity was associated with greater odds of willingness to share wearable data with family or friends (OR 1.70, 95% CI 1.02-2.84). Sociodemographic factors were not significantly associated with willingness to share wearable data.

CONCLUSIONS

The findings of this study suggest that, among US adult wearable users, behavior-related factors, rather than sociodemographic characteristics, are key drivers of willingness to share health information obtained from wearables with others. Moreover, behavioral correlates of willingness to share wearable data are unique to the type of recipient (ie, providers vs family or friends). Future studies could use these findings to inform the development of interventions that aim to improve the use of patient-generated data from wearable devices in health care settings.

Anxiety treatment preferences among veteran primary care patients: Demographic, mental health, and treatment-related correlates

INTRODUCTION

Anxiety symptoms are common, yet undertreated, among primary care patients. Accommodating patient treatment preferences improves engagement and retention. In contrast to depression, little is known about primary care patients' preferences for anxiety treatment.

METHOD

Participants were 144 veterans experiencing anxiety symptoms but not receiving psychotherapy who were recruited from primary care. Preferences for 11 anxiety treatment attributes (method; location; type; format; provider; frequency, length, and number of appointments; psychotherapy orientation; symptom focus; and topic/skill) and demographic, mental health (e.g., anxiety symptom severity), and treatment-related (e.g., psychotherapy history) variables were assessed via mailed survey. We used chi-square goodness of fit tests to identify patient preferences for each attribute and multivariate multinomial logistic regression models to explore demographic, mental health, and treatment-related correlates of treatment preferences.

RESULTS

Patient preferences were largely consistent with integrated primary care models, particularly Primary Care Behavioral Health, with a few exceptions. Patients preferred longer appointments (e.g., 45-60 minutes) and a longer duration of treatment (e.g., ≥13 appointments) than is typically offered in primary care. Several variables, particularly education level, perceived need for help, anxiety symptom severity, and attitudes toward psychotherapy, were repeatedly associated with preferences for various anxiety treatment attributes.

DISCUSSION

Results from this study suggest that patients tend to have distinct preferences for anxiety treatment in primary care that are largely consistent with common integrated primary care models. Results also identify several variables that may be associated with specific preferences, which may help match patients to their preferred type of care. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Population Health Surveillance Using Mobile Phone Surveys in Low- and Middle-Income Countries: Methodology and Sample Representativeness of a Cross-sectional Survey of Live Poultry Exposure in Bangladesh

Background

Population-based health surveys are typically conducted using face-to-face household interviews in low- and middle-income countries (LMICs). However, telephone-based surveys are cheaper, faster, and can provide greater access to hard-to-reach or remote populations. The rapid growth in mobile phone ownership in LMICs provides a unique opportunity to implement novel data collection methods for population health surveys.

Objective

This study aims to describe the development and population representativeness of a mobile phone survey measuring live poultry exposure in urban Bangladesh.

Methods

A population-based, cross-sectional, mobile phone survey was conducted between September and November 2019 in North and South Dhaka City Corporations (DCC), Bangladesh, to measure live poultry exposure using a stratified probability sampling design. Data were collected using a computer-assisted telephone interview platform. The call operational data were summarized, and the participant data were weighted by age, sex, and education to the 2011 census. The demographic distribution of the weighted sample was compared with external sources to assess population representativeness.

Results

A total of 5486 unique mobile phone numbers were dialed, with 1047 respondents completing the survey. The survey had an overall response rate of 52.2% (1047/2006) and a co-operation rate of 89.0% (1047/1176). Initial results comparing the sociodemographic profile of the survey sample to the census population showed that mobile phone sampling slightly underrepresented older individuals and overrepresented those with higher secondary education. After weighting, the demographic profile of the sample population matched well with the latest DCC census population profile.

Conclusions

Probability-based mobile phone survey sampling and data collection methods produced a population-representative sample with minimal adjustment in DCC, Bangladesh. Mobile phone–based surveys can offer an efficient, economic, and robust way to conduct surveillance for population health outcomes, which has important implications for improving population health surveillance in LMICs.

Symptom profile of affirmative responses to a self-report concussion question, United States 2019

Information is limited about signs and symptoms experienced by individuals who self-report a concussion within surveys. The objective of this study was to assess the number and types of signs/symptoms adults experienced and whether or not medical attention was reported after sustaining a self-reported concussion in the past year. A sample of 3,624 adults responded to the web-based 2019 FallStyles survey. Respondents were asked if they had sustained a concussion in the past 12 months and if so, which (if any) signs/symptoms they experienced following the injury. The frequency and percentages of symptoms were calculated. Approximately 2.9% of respondents reported a concussion in the past year. Approximately two-thirds of respondents who reported sustaining a recent concussion stated that they experienced two or more signs/symptoms; the remaining one-third reported zero or one symptom. The findings suggest self-report concussion questions need additional improvement, particularly those that capture concussion using a single question, to improve the validity of self-reports.

Context, design and conduct of the longitudinal COVID-19 psychological research consortium study-wave 3

OBJECTIVES

The COVID-19 Psychological Research Consortium (C19PRC) Study aims to assess the impact of the COVID-19 pandemic in the adult population in multiple countries. This paper describes the third wave of the UK survey (the 'parent' strand of the Consortium) during July-August 2020.

METHODS

Adults (N = 2025) who participated in the baseline and/or first follow-up surveys were reinvited to participate in this survey, which assessed: (1) COVID-19 related knowledge, attitudes, and behaviours; (2) the occurrence of common mental disorders; as well as the role of (3) psychological factors and (4) social and political attitudes, in influencing the public's response to the pandemic. Weights were calculated using a survey raking algorithm to ensure that the cross-sectional sample is nationally representative in terms of gender, age, and household income, and representative of the baseline sample characteristics for household composition, ethnicity, urbanicity and born/raised in UK.

RESULTS

1166 adults (57.6% of baseline participants) provided full interviews at Wave 3. The raking procedure successfully re-balanced the cross-sectional sample to within 1% of population estimates across selected socio-demographic characteristics.

CONCLUSION

This paper demonstrates the strength of the C19PRC Study data to facilitate and stimulate interdisciplinary research addressing important public health questions relating to the COVID-19 pandemic.

Design-Based Approach for Analysing Survey Data in Veterinary Research

Sample surveys are an essential approach used in veterinary research and investigation. A sample obtained from a well-designed sampling process along with robust data analysis can provide valuable insight into the attributes of the target population. Two approaches, design-based or model-based, can be used as inferential frameworks for analysing survey data. Compared to the model-based approach, the design-based approach is usually more straightforward and directly makes inferences about the finite target population (such as the dairy cows in a herd or dogs in a region) rather than an infinite superpopulation. In this paper, the concept of probability sampling and the design-based approach is briefly reviewed, followed by a discussion of the estimations and their justifications in the context of several different elementary sampling methods, including simple random sampling, stratified random sampling, and one-stage cluster sampling. Finally, a concrete example of a complex survey design (involving multistage sampling and stratification) is demonstrated, illustrating how finding unbiased estimators and their corresponding variance formulas for a complex survey builds on the techniques used in elementary sampling methods.

Relying on an "Other" Category Leads to Significant Misclassification of Sexual Minority Participants

Purpose: This study assessed which sexual minority participants selected "Other" if their identity was absent. Methods: This was an online survey; 905 participants saw a limited set of sexual orientation options (bisexual, gay/lesbian, heterosexual, other), and later in the same survey, saw an expanded list. Results: Twenty-one percent of participants chose different orientation labels across questions. When not presented with a "mostly heterosexual" option, 78% of mostly heterosexual participants chose "heterosexual"; 3% chose "other." However, when not presented with an "asexual" label, 100% of asexual participants chose "other." Conclusion: These findings suggest that "other" categories could misclassify a substantial proportion of sexual minority participants.

How to ask: Surveying nursing directors of nursing homes

BACKGROUND AND AIMS

Nursing home research may involve eliciting information from managers, yet response rates for Directors of Nursing have not been recently studied. As a part of a more extensive study, we surveyed all nursing homes in three states in 2018 and 2019, updating how to survey these leaders effectively. We focus on response rates as a measure of non-response error and comparison of nursing home's characteristics to their population values as a measure of representation error.

METHODS

We surveyed Directors of Nursing or their designees in nursing homes serving adult residents with at least 30 beds in California, Massachusetts, and Ohio (N = 2389). We collected contact information for respondents and then emailed survey invitations and links, followed by three email reminders and a paper version. Nursing home associations in two of the states contacted their members on our behalf. We compared the response rates across waves and states. We also compared the characteristics of nursing homes based on whether the response was via email or paper. In a multivariable logit regression, we used characteristics of the survey and the nursing homes to predict whether their DON responded to the survey using adjustments for multiple comparisons.

RESULTS

The response rate was higher for the first wave than for the second (30% vs 20.5%). The highest response rate was in Massachusetts (31.8%), followed by Ohio (25.8%) and California (19.5%). Nursing home characteristics did not vary by response mode. Additionally, we did not find any statistically significant predictors of whether a nursing home responded.

CONCLUSION

A single-mode survey may provide a reasonably representative sample at the cost of sample size. With that said, however, switching modes can increase sample size without potentially biasing the sample.

What Does the Public Prefer Versus What Is the Public Ready to Forgo?

The present study uses a novel approach to assess the publics' ability to cope with priority setting and rationing in health care by asking what the public is willing to forego. Items for disinvestment were presented in three separated dimensions: Categories of medical care, quality of service, and items representing social values. A telephone survey was conducted among a representative sample of the Israeli public (N = 609). The response rate was 51%. We identify a few items that a high proportion of the population express readiness to forgo: a drug for smoking cessation, budgets for improving appearance and comfort in medical facilities, and a product for preventing surgical scars. Furthermore, over a quarter of the public was ready to forgo many other items. We found that less than 10% justified their selection in terms of "personally not important to me," while most respondents evaluated the items they chose to forgo as "less effective or less essential in comparison to others." The study found that most respondents, when exposed to a range of health system components, were able to identify at least one item that they will be willing to forgo in a time of economic crisis.

Culture in the spotlight-cultural adaptation and content validity of the integrated palliative care outcome scale for dementia: A cognitive interview study

BACKGROUND

Dementia is a life-limiting disease with high symptom burden. The Integrated Palliative Care Outcome Scale for Dementia (IPOS-Dem) is the first comprehensive person-centered measure to identify and measure palliative care needs of people with dementia. However, such a measure is missing in the German health care system.

AIM

To develop a culturally adapted German version of the IPOS-Dem and determine its content validity as a foundation for comprehensive psychometric testing.

DESIGN

Cognitive interview study with intermittent analysis and questionnaire adaptation. Interview guide and coding frame followed thematic analysis according to Willis complemented by Tourangeau's model of cognitive aspects of survey methodology: comprehension, retrieval, judgment, response.

PARTICIPANTS

Purposive sample with professionals (n = 29) and family carers (n = 6) of people with advanced dementia in seven nursing homes and person's own home care in four interview rounds (n = 11; 10; 7; 7).

RESULTS

IPOS-Dem was regarded as comprehensive and accessible. Cultural adaption pertained to issues of comprehension and judgment. Comprehension challenges referred to the person-centered concept of "being affected by" used in the POS-measures. Judgment problems related to persons with limited communication causing challenges in assessment.

CONCLUSION

Most issues of cultural adaptation could be addressed by questionnaire modifications. However, interviews unveiled fundamental challenges for using proxy reported person-centered assessments. Continuous training on how to use the instrument is imperative to integrate the person-centered approach of palliative care into nursing homes as a key provider of generalist palliative care for people with dementia. The refined version is ready for psychometric testing.

Validation of the Implementation Climate Scale in Nursing

BACKGROUND

One critical factor in effective implementation of evidence-based practices (EBPs) in nursing is an organizational context that facilitates and supports implementation efforts. Measuring implementation climate can add useful insights on the extent to which the organizational context supports EBP implementation.

AIMS

This study cross-validates and examines the psychometric properties of the Implementation Climate Scale (ICS), which measures nurses' perceptions of their unit's climate for EBP implementation.

METHODS

This study analyzed ICS data from two cross-sectional studies, including 203 nurses from California and 301 nurses from Florida. Analyses included evaluation of internal consistency, multilevel aggregation statistics, and confirmatory factor analyses.

RESULTS

The 18-item ICS demonstrated comparable psychometric properties to the original measure development paper in both samples. Confirmatory factor analyses provided support for the scale's factor structure in both samples.

LINKING EVIDENCE TO PRACTICE

The ICS is a pragmatic measure that can be used to assess unit implementation climate in nursing contexts. Results from the ICS from nurses and nurse leaders can provide insights into implementation-specific barriers and facilitators within the organizational context.

The Survey Measurement of Sexual Orientation: Configurations of Sexual Identity and Attraction and Associations with Mental Health

Purpose: This study aimed to examine how configurations of sexual identity and attraction are associated with mental health outcomes. Methods: Data came from the 2015, 2016, and 2017 waves of the National Survey on Drug Use and Health, one of the few nationally representative surveys to ask about sexual attraction. Sexual identity and attraction were combined into groups that are coincident (heterosexual-opposite gender attraction, gay/lesbian-same gender attraction, or bisexual-any multiple gender attraction) or branched (heterosexual-any same gender attraction, gay/lesbian-any opposite gender attraction, bisexual-only same or opposite gender attraction). The association between these configurations and various measures of mental health and well-being-severe psychological distress, major depressive episode, suicidal ideation, and suicide plan or attempt-was examined. Results: Heterosexual coincidence-being heterosexual and only attracted to the opposite gender-was associated with lower mental health risks than all other configurations of sexual identity and attraction. In addition, bisexual with coincident attraction was often associated with worse mental health outcomes than other configurations of identity and attraction, whereas bisexual with branched attraction did not necessarily follow this pattern. Finally, heterosexual with branched attraction was associated with worse mental health outcomes than heterosexual with coincident attraction, but better mental health outcomes than some of the other sexual identity and attraction configurations. Conclusion: Including one question on sexual attraction and its intersection with sexual identity adds nuance to our understanding of disparities in mental health and well-being among previously identified sexual minority and majority groups.

Monitoring the psychological, social, and economic impact of the COVID-19 pandemic in the population: Context, design and conduct of the longitudinal COVID-19 psychological research consortium (C19PRC) study

OBJECTIVES

The C19PRC study aims to assess the impact of the COVID-19 pandemic in the adult population of the UK, Republic of Ireland, and Spain. This paper describes the conduct of the first two waves of the UK survey (the "parent" strand of the Consortium) during March-April 2020.

METHODS

A longitudinal, internet panel survey was designed to assess: (1) COVID-19 related knowledge, attitudes, and behaviors; (2) the occurrence of common mental health disorders as well as the role of (3) psychological factors and (4) social and political attitudes, in influencing the public's response to the pandemic. Quota sampling (age, sex, and household income) was used to recruit a nationally representative sample of adults.

RESULTS

Two thousand and twenty five adults were recruited at baseline, and 1406 were followed-up one-month later (69.4% retention rate). The baseline sample was representative of the UK population in relation to economic activity, ethnicity, and household composition. Attrition was predicted by key socio-demographic characteristics, and an inverse probability weighting procedure was employed to ensure the follow-up sample was representative of the baseline sample.

CONCLUSION

The C19PRC study data has strong generalizability to facilitate and stimulate interdisciplinary research on important public health questions relating to the COVID-19 pandemic.

The effect of a web-push survey on physician survey responses rates: a randomized experiment

Background

Achieving a high response rate for physicians has been challenging, and with response rates declining in recent years, innovative methods are needed to increase rates. An emerging concept in survey methodology has been web-push survey delivery. With this delivery method, contact is made by mail to request a response by web. This study explored the feasibility of a web-push survey on a national sample of physicians.

Methods

A total of 1,000 physicians across six specialties were randomly assigned to a mail-only or web-push survey delivery. Each mode consisted of four contacts including an initial mailing, reminder postcard, and two additional follow-ups. Response rates were calculated using the American Association for Public Opinion Research's response rate 3 calculation. Data collection occurred between Febuary and April 2018; data were analyzed March 2019.

Results

Overall reponse rates for the mail-only versus web-push survey delivery were comparable (51.2% vs. 52.8%). Higher response rates across all demographics were seen in the web-push delivery, with the exception of pulmonary/critical care and physicians over the age of 65. The web-push survey yielded a greater response after the first mailing, requiring fewer follow-up contacts resulting in a more cost-effective delivery.

Conclusions

A web-push mail survey is effective in achieving a comparable response rate to traditional mail-only delivery for physicians. The web-push survey was more efficient in terms of cost and in receiving responses in a more timely manner. Future research should explore the efficiency of a web-push survey delivery across various health care provider populations.

Perspective of an International Online Patient and Caregiver Community on the Burden of Spasticity and Impact of Botulinum Neurotoxin Therapy: Survey Study

Background

Patient- and caregiver-reported data are lacking on the burden of spasticity, and the impact of botulinum neurotoxin type A (BoNT-A) treatment for this condition, on patients' daily lives. As recommended in recent guidance from the US Food and Drug Administration, online patient communities can represent a platform from which to gather specific information outside of a clinical trial setting on the burden of conditions experienced by patients and caregivers and their views on treatment options in order to inform evidence-based medicine and drug development.

Objective

The objective of our study is to characterize spasticity symptoms and their associated burdens on Western European and US patients and caregivers in the realms of work, daily activities, quality of life (QoL), as well as the positive and negative impacts of treatment with BoNT-A (cost, time, QoL) using Carenity, an international online community for people with chronic health conditions.

Methods

We performed a noninterventional, multinational survey. Eligible participants were 18 years old or older and had, or had cared for, someone with spasticity who had been treated with BoNT-A for at least 1 year. Patients and caregivers were asked to complete an internet-based survey via Carenity; caregivers reported their own answers and answered on behalf of their patients. Questions included the burden of spasticity on the ability to work, functioning, daily-living activities, and QoL, the impact of BoNT A therapy on patients' lives, and the potential benefits of fewer injections.

Results

There were 615 respondents (427 patients and 188 caregivers). The mean age of patients and caregivers was 41.7 years and 38.6 years, respectively, and the most commonly reported cause of spasticity was multiple sclerosis. Caregivers were most often the parents (76/188, 40%) or another family member (51/188, 27%) of their patients. Spasticity had a clear impact on patients' and caregivers' lives, including the ability to work and injection costs. For patients, spasticity caused difficulties with activities of daily living and reduced QoL indices. The median number of BoNT-A injections was 4 times per year, and 92% (393/427) of patients reported that treatment improved their overall satisfaction with life. Regarding the BoNT-A injection burden, the greatest patient-reported challenges were the cost and availability of timely appointments. Overall, 86% (368/427) of patients believed that a reduced injection frequency would be beneficial. Caregivers answering for their patients gave largely similar responses to those reported by patients.

Conclusions

Spasticity has a negative impact on both patients' and caregivers' lives. All respondents reported that BoNT A treatment improved their lives, despite the associated challenges. Patients believed that reducing the frequency of BoNT-A injections could alleviate practical issues associated with treatment, implying that a longer-acting BoNT-A injection would be well received.

Quality and Impact of Survey Research Among Anesthesiologists: A Systematic Review

New technology has facilitated survey research of anesthesia professional society members. We evaluated prevailing metrics of quality and impact of published research studies based on surveys of anesthesiologists. We hypothesized that adherence to recommended practices (such as use of reminders) would be associated with increased survey response rates, and that higher response rates would be associated with higher article impact. Using the MEDLINE database, we identified 45 English-language research articles published in 2010-2017 reporting original data from surveys of anesthesiologists. The median response rate was 37% (IQR: 25-46%). Recommended survey practices, including the use of reminders (p = 0.861) and validated questionnaires (p = 0.719), were not correlated with response rates. In turn, survey response rates were not associated with measures of article impact (p = 0.528). The impact of published research based on surveys of anesthesiologists, as measured by citation scores (p = 0.493) and Altmetrics (p = 0.826), may be driven primarily by the novel data or questions raised using survey methodology, but does not appear to be associated with response rates. Improving reporting of survey methodology and understanding possible sources of non-response bias are important for future studies in this area.

Optimizing Count Responses in Surveys: A Machine-learning Approach

Count responses with grouping and right censoring have long been used in surveys to study a variety of behaviors, status, and attitudes. Yet grouping or right-censoring decisions of count responses still rely on arbitrary choices made by researchers. We develop a new method for evaluating grouping and right-censoring decisions of count responses from a (semisupervised) machine-learning perspective. This article uses Poisson multinomial mixture models to conceptualize the data-generating process of count responses with grouping and right censoring and demonstrates the link between grouping-scheme choices and asymptotic distributions of the Poisson mixture. To search for the optimal grouping scheme maximizing objective functions of the Fisher information (matrix), an innovative three-step M algorithm is then proposed to process infinitely many grouping schemes based on Bayesian A-, D-, and E-optimalities. A new R package is developed to implement this algorithm and evaluate grouping schemes of count responses. Results show that an optimal grouping scheme not only leads to a more efficient sampling design but also outperforms a nonoptimal one even if the latter has more groups.

Characterizing the US Population by Patterns of Mobile Health Use for Health and Behavioral Tracking: Analysis of the National Cancer Institute's Health Information National Trends Survey Data

BACKGROUND

Multiple types of mobile health (mHealth) technologies are available, such as smartphone health apps, fitness trackers, and digital medical devices. However, despite their availability, some individuals do not own, do not realize they own, or own but do not use these technologies. Others may use mHealth devices, but their use varies in tracking health, behaviors, and goals. Examining patterns of mHealth use at the population level can advance our understanding of technology use for health and behavioral tracking. Moreover, investigating sociodemographic and health-related correlates of these patterns can provide direction to researchers about how to target mHealth interventions for diverse audiences.

OBJECTIVE

The aim of this study was to identify patterns of mHealth use for health and behavioral tracking in the US adult population and to characterize the population according to those patterns.

METHODS

We combined data from the 2017 and 2018 National Cancer Institute Health Information National Trends Survey (N=6789) to characterize respondents according to 5 mutually exclusive reported patterns of mHealth use for health and behavioral tracking: (1) mHealth nonowners and nonusers report not owning or using devices to track health, behaviors, or goals; (2) supertrackers track health or behaviors and goals using a smartphone or tablet plus other devices (eg, Fitbit); (3) app trackers use only a smartphone or tablet; (4) device trackers use only nonsmartphone or nontablet devices and do not track goals; and (5) nontrackers report having smartphone or tablet health apps but do not track health, behaviors, or goals.

RESULTS

Being in the mHealth nonowners and nonusers category (vs all mHealth owners and users) is associated with males, older age, lower income, and not being a health information seeker. Among mHealth owners and users, characteristics of device trackers and supertrackers were most distinctive. Compared with supertrackers, device trackers have higher odds of being male (odds ratio [OR] 2.22, 95% CI 1.55-3.19), older age (vs 18-34 years; 50-64 years: OR 2.83, 95% CI 1.52-5.30; 65+ years: OR 6.28, 95% CI 3.35-11.79), have an annual household income of US $20,000 to US $49,999 (vs US $75,000+: OR 2.31, 95% CI 1.36-3.91), and have a chronic condition (OR 1.69, 95% CI 1.14-2.49). Device trackers also have higher odds of not being health information seekers than supertrackers (OR 2.98, 95% CI 1.66-5.33).

CONCLUSIONS

Findings revealed distinctive sociodemographic and health-related characteristics of the population by pattern of mHealth use, with notable contrasts between those who do and do not use devices to track goals. Several characteristics of individuals who track health or behaviors but not goals (device trackers) are similar to those of mHealth nonowners and nonusers. Our results suggest patterns of mHealth use may inform how to target mHealth interventions to enhance reach and facilitate healthy behaviors.

A Web-Based Adaptation of the Quality of Life in Bipolar Disorder Questionnaire: Psychometric Evaluation Study

BACKGROUND

Quality of life (QoL) is considered a key treatment outcome in bipolar disorder (BD) across research, clinical, and self-management contexts. Web-based assessment of patient-reported outcomes offer numerous pragmatic benefits but require validation to ensure measurement equivalency. A web-based version of the Quality of Life in Bipolar Disorder (QoL.BD) questionnaire was developed (QoL Tool).

OBJECTIVE

This study aimed to evaluate the psychometric properties of a web-based QoL self-report questionnaire for BD (QoL Tool). Key aims were to (1) characterize the QoL of the sample using the QoL Tool, (2) evaluate the internal consistency of the web-based measure, and (3) determine whether the factor structure of the original version of the QoL.BD instrument was replicated in the web-based instrument.

METHODS

Community-based participatory research methods were used to inform the development of a web-based adaptation of the QoL.BD instrument. Individuals with BD who registered for an account with the QoL Tool were able to opt in to sharing their data for research purposes. The distribution of scores and internal consistency estimates, as indicated by Cronbach alpha, were inspected. An exploratory factor analysis using maximum likelihood and oblique rotation was conducted. Inspection of the scree plot, eigenvalues, and minimum average partial correlation were used to determine the optimal factor structure to extract.

RESULTS

A total of 498 people with BD (349/498, 70.1% female; mean age 39.64, SD 12.54 years; 181/498, 36.3% BD type I; 195/498, 39.2% BD type II) consented to sharing their QoL Tool data for the present study. Mean scores across the 14 QoL Tool domains were, in general, significantly lower than that of the original QoL.BD validation sample. Reliability estimates for QoL Tool domains were comparable with that observed for the QoL.BD instrument (Cronbach alpha=.70-.93). Exploratory factor analysis supported the extraction of an 11-factor model, with item loadings consistent with the factor structure suggested by the original study. Findings for the sleep and physical domains differed from the original study, with this analysis suggesting one shared latent construct.

CONCLUSIONS

The psychometric properties of the web-based QoL Tool are largely concordant with the original pen-and-paper QoL.BD, although some minor differences in the structure of the sleep and physical domains were observed. Despite this small variation from the factor structure identified in the QoL.BD instrument, the latent factor structure of the QoL Tool largely reproduced the original findings and theoretical structure of QoL areas relevant to people with BD. These findings underscore the research and clinical utility of this instrument, but further comparison of the psychometric properties of the QoL Tool relative to the QoL.BD instrument is warranted. Future adaptations of the QoL Tool, including the production of an app-based version of the QoL Tool, are also discussed.

Comparison of 1-week and 2-week recall periods for caregiver-reported diarrhoeal illness in children, using nationally representative household surveys

BACKGROUND

Diarrhoeal outcomes in children are often ascertained using caregiver-reported symptoms, which are subject to a variety of biases and methodological challenges. One source of bias is the time window used for reporting diarrhoeal illness and the ability of caregivers to accurately recall episodes in children.

METHODS

Diarrhoea period prevalence in children under five was determined using two similarly administered, nationally representative household surveys: Performance Monitoring and Accountability 2020 (PMA2020) (1-week recall, N = 14 603) and Demographic and Health Surveys (DHS) (2-week recall, N = 66 717). Countries included in the analysis were the Democratic Republic of the Congo, Ethiopia, Ghana, Kenya and Uganda. Diarrhoea period prevalence estimates were compared and water, sanitation and hygiene risk factors were analysed.

RESULTS

Childhood diarrhoea prevalence using 1-week recall (PMA2020) pooled across countries was 21.4% [95% confidence interval (CI): 19.9%, 22.9%] versus 16.0% using 2-week recall (DHS) (95% CI: 15.4%, 16.5%). In stratified analyses for all five countries, the number of diarrhoea cases detected was consistently higher using 1-week recall versus 2-week recall. The key risk factors identified in the PMA2020 data that were not associated with diarrhoeal episodes or were attenuated in the DHS data included: the main sanitation classifications for households, disposal method used for child faeces, number of household members and wealth quintiles.

CONCLUSIONS

For nationally representative household surveys assessing childhood diarrhoea period prevalence, a 2-week recall period may underestimate diarrhoea prevalence compared with a 1-week period. The household sanitation facility and practices remain key risk factors for diarrhoeal disease in children under five.

How Are Debriefing Questions Used in Health Discrete Choice Experiments? An Online Survey

OBJECTIVES

Debriefing questions can assess if respondents understand discrete choice experiments (DCEs) and are answering in a way consistent with theories of decision making and utility maximization. Nevertheless, there is limited literature about how often debriefing questions are included or how the results are used in health economics. The aim of this study was to conduct a survey of the frequency, type, and analysis of debriefing questions in health DCEs.

METHODS

We conducted an online survey of authors of published health DCEs, asking about their use of debriefing questions, including frequency, type, and analysis. We descriptively analyzed the sample characteristics and responses. Free-text questions were analyzed with qualitative thematic analysis.

RESULTS

We received 70 responses (43% response rate), of which 50% reported using debriefing questions. They were most commonly designed to assess difficulty (91%), understanding (49%), and attribute nonattendance (31%) rather than learning effects (3%) or monotonicity (11%). On average, 37% of debriefing questions were analyzed (range, 0% to 69%), and the results were used <50% of the time, usually to exclude respondents or interpret overall results. Researcher experience or confidence with DCEs did not affect their use of debriefing questions.

CONCLUSIONS

These results suggest that although half of researchers conducting health DCEs use debriefing questions, many do not analyze, use, or report the responses. Given the additional respondent burden, there is a need for reliable and valid debriefing questions. In the meantime, the inclusion, analysis, and reporting of debriefing questions should be carefully considered before DCE implementation.

Development of an Instrument Measuring Perceived Environmental Healthfulness: Behavior Environment Perception Survey (BEPS)

OBJECTIVE

To create a tool to measure college students' perception of the healthfulness of their environment.

DESIGN

(1) Item generation, (2) cognitive interview testing and exploratory factor analysis, (3) item refinement/modification, (4) factor structure validation, and (5) criterion validation.

SETTING

Ten college campuses.

PARTICIPANTS

Time point 1 (n = 120 cognitive interviews; n = 922 factor analysis); time point 2 (n = 2,676), convenience sample of undergraduate students.

MAIN OUTCOME MEASURES

Cognitive interviews and survey data were used to assess perceptions about the environment.

ANALYSIS

Exploratory factor analysis, structural equation confirmatory factor analysis, correlations, and regressions.

RESULTS

Item generation resulted in 93 items. Items were eliminated based on cognitive interviews, exploratory factor analysis of pilot data, and elimination of cross-loading or weak loading items. In confirmatory analyses, a 21-item, 5-factor structure was the best fit for the data (χ² = 3,286.77, degrees of freedom = 189; comparative fit index = 0.840; root-mean-square error of approximation = 0.078). Environmental factors include physical activity (α = 0.68, 4 items), healthful eating (α = 0.86, 5 items), mental health (α = 0.85, 5 items), barriers to healthful eating (α = 0.70, 4 items), and peer influences (α = 0.73, 3 items). There were significant associations between scales and validation criteria (P < .05).

CONCLUSIONS AND IMPLICATIONS

The Behavior Environment Perception Survey is a novel instrument measuring perceptions of the healthfulness of the campus environment. Strengths include a development process involving 10 different universities, strong psychometric properties, and breadth of constructs.

Best practice versus actual practice: an audit of survey pretesting practices reported in a sample of medical education journals

Background: Despite recommendations from survey scientists, surveys appear to be utilized in medical education without the critical step of pretesting prior to survey launch. Pretesting helps ensure respondents understand questions as survey developers intended and that items and response options are relevant to respondents and adequately address constructs, topics, issues or problems. While psychometric testing is important in assessing aspects of question quality and item performance, it cannot discern how respondents, based upon their lived experiences, interpret the questions we pose.Aim: This audit study explored whether authors of medical education journal articles within audited journals reported pretesting survey instruments during survey development, as recommended by survey scientists and established guidelines/standards for survey instrument development.Methods: Five national and international medical education journals publishing survey articles from Jan. 2014 - Dec. 2015 were audited to determine whether authors reported pretesting during survey development. All abstracts within all issues of these journals were initially reviewed. Two hundred fifty-one articles met inclusion criteria using a protocol piloted and revised prior to use.Results: The number of survey articles published per journal ranged from 11 to 106. Of 251 audited articles, 181 (72.11%) described using a new instrument without pretesting, while 17 (6.77%) described using a new instrument where items were pretested. Fifty-three (21.12%) articles described using pre-existing instruments; of these, no articles (0%) reported pretesting existing survey instruments prior to use.Conclusions: Findings from this audit study indicate that reported survey pretesting appears to be lower than that reported in healthcare journals. This is concerning, as results of survey studies and evaluation projects are used to inform educational practices, guide future research, and influence policy and program development. Findings apply to both survey developers and faculty across a range of fields, including evaluation and medical education research.

Rethinking Response Rates: New Evidence of Little Relationship Between Survey Response Rates and Nonresponse Bias

BACKGROUND

Federally funded evaluation research projects typically strive for an 80% survey response rate, but the increasing difficulty and expense in reaching survey respondents raises the question of whether such a threshold is necessary for reducing bias and increasing the accuracy of survey estimates.

OBJECTIVES

This analysis focuses on a particular component of survey methodology: the survey response rate and its relationship to nonresponse bias. Following a review of the literature, new analysis of data from a large, multisite random assignment experiment explores the relationship between survey response rates and measured nonresponse bias.

RESEARCH DESIGN

With detailed survey disposition data, the analysis simulates nonresponse bias at lower response rates. The subjects included 12,000 individuals who were fielded for 16 identical surveys as part of the Employment Retention and Advancement evaluation.

RESULTS

The results suggest scant relationship between survey nonresponse bias and response rates. The results also indicate that the pursuit of high response rates lengthens the fielding period, which can create other measurement problems.

CONCLUSIONS

The costly pursuit of a high response rate may offer little or no reduction of nonresponse bias. Achieving such a high rate of response requires considerable financial resources that might be better applied to methods and techniques shown to have a greater effect on the reduction of nonresponse bias.

Effect of airtime incentives on response and cooperation rates in non-communicable disease interactive voice response surveys: randomised controlled trials in Bangladesh and Uganda

Background

The global proliferation of mobile phones offers opportunity for improved non-communicable disease (NCD) data collection by interviewing participants using interactive voice response (IVR) surveys. We assessed whether airtime incentives can improve cooperation and response rates for an NCD IVR survey in Bangladesh and Uganda.

Methods

Participants were randomised to three arms: a) no incentive, b) 1X incentive or c) 2X incentive, where X was set to airtime of 50 Bangladesh Taka (US$0.60) and 5000 Ugandan Shillings (UGX; US$1.35). Adults aged 18 years and older who had a working mobile phone were sampled using random digit dialling. The primary outcomes, cooperation and response rates as defined by the American Association of Public Opinion Research, were analysed using log-binomial regression model.

Results

Between 14 June and 14 July 2017, 440 262 phone calls were made in Bangladesh. The cooperation and response rates were, respectively, 28.8% (353/1227) and 19.2% (580/3016) in control, 39.2% (370/945) and 23.9% (507/2120) in 50 Taka and 40.0% (362/906) and 24.8% (532/2148) in 100 Taka incentive groups. Cooperation and response rates, respectively, were significantly higher in both the 50 Taka (risk ratio (RR) 1.36, 95% CI 1.21 to 1.53) and (RR 1.24, 95% CI 1.12 to 1.38), and 100 Taka groups (RR 1.39, 95% CI 1.23 to 1.56) and (RR 1.29, 95% CI 1.16 to 1.43), as compared with the controls. In Uganda, 174 157 phone calls were made from 26 March to 22 April 2017. The cooperation and response rates were, respectively, 44.7% (377/844) and 35.2% (552/1570) in control, 57.6% (404/701) and 39.3% (508/1293) in 5000 UGX and 58.8% (421/716) and 40.3% (535/1328) in 10 000 UGX groups. Cooperation and response rates were significantly higher, respectively in the 5000 UGX (RR 1.29, 95% CI 1.17 to 1.42) and (RR 1.12, 95% CI 1.02 to 1.23), and 10 000 UGX groups (RR 1.32, 95% CI 1.19 to 1.45) and (RR 1.15, 95% CI 1.04 to 1.26), as compared with the control group.

Conclusion

In two diverse settings, the provision of an airtime incentive significantly improved both the cooperation and response rates of an IVR survey, with no significant difference between the two incentive amounts.

Trial registration number

NCT03768323.

Sample and Respondent Provided County Comparisons Among Cellular Respondents Using Rate Center Assignments

The percentage of cell phones in telephone survey samples continues to grow in proportion to the percentage of potential respondents who rely on cell phones for personal communication. One problem with cell phone samples is that persons who move or who purchase cell phones in locations not close to their residence, may not be eligible for surveys with geographic parameters. This affects researchers' ability to sample and analyze from specific geographic jurisdictions. Because cell phone numbers do not accurately indicate respondent locations, rate centers have been used to ascertain respondent locations in recent years. The Behavioral Risk Factor Surveillance System (BRFSS) is a state-based telephone survey administered to over 400,000 respondents annually. Approximately half of the sample is drawn from cell phone numbers. This research examines the county-level accuracy of the 2016 BRFSS sample. Results indicate that cell phone samples are accurate at the state and county level 58% of the time and at just the state level 93% of the time. However, accuracy rates vary by state, region, metropolitan status as well as by demographic characteristics and survey items. Specific examples of when county-level accuracy vary are provided.

Adaptation of the MISSCARE Survey to the Maternity Care Setting

Missed nursing care is an important measure of nursing care quality that is sensitive to nurse staffing and is associated with patient outcomes in medical-surgical and pediatric inpatient settings. Missed nursing care during labor and birth has not been studied, yet childbirth represents the most common reason for hospitalization in the United States. The Missed Nursing Care (MISSCARE) Survey, a measure of medical-surgical nursing quality with substantial evidence for validity and reliability, was adapted to maternity nursing care using data from focus groups of labor nurses, physicians, and new mothers and an online survey of labor nurses. Content validity was evaluated via participant feedback, and exploratory factor analysis was performed to identify the factor structure of the instrument. The modified version, the Perinatal Missed Care Survey, appears to be a feasible and promising instrument with which to evaluate missed nursing care of women during labor and birth in hospitals.

Monitoring program design for data-limited marine biogenic habitats: A structured approach

Marine biogenic habitats-habitats created by living organisms-provide essential ecosystem functions and services, such as physical structuring, nutrient cycling, biodiversity support, and increases in primary, secondary, and tertiary production. With the growing trend toward ecosystem approaches to marine conservation and fisheries management, there is greater emphasis on rigorously designed habitat monitoring programs. However, such programs are challenging to design for data-limited habitats for which underlying ecosystem processes are poorly understood. To provide guidance in this area, we reviewed approaches to benthic assessments across well-studied marine biogenic habitats and identified common themes related to indicator selection, sampling methods, and survey design. Biogenic habitat monitoring efforts largely focus on the characteristics, distribution, and ecological function of foundation species, but may target other habitat-forming organisms, especially when community shifts are observed or expected, as well as proxies of habitat status, such as indicator species. Broad-scale methods cover large spatial areas and are typically used to examine the spatial configuration of habitats, whereas fine-scale methods tend to be laborious and thus restricted to small survey areas, but provide high-resolution data. Recent, emerging methods enhance the capabilities of surveying large areas at high spatial resolution and improve data processing efficiency, bridging the gap between broad- and fine-scale methods. Although sampling design selection may be limited by habitat characteristics and available resources, it is critically important to ensure appropriate matching of ecological, observational, and analytical scales. Drawing on these common themes, we propose a structured, iterative approach to designing monitoring programs for marine biogenic habitats that allows for rigorous data collection to inform management strategies, even when data and resource limitations are present. A practical application of this approach is illustrated using glass sponge reefs-a recently discovered and data-limited habitat type-as a case study.