Measurement agreement of the self-administered questionnaire of the Belgian Health Interview Survey: Paper-and-pencil versus web-based mode

Therapies go digital. What drives physicians' acceptance?

National healthcare systems face multiple challenges, including the increasing demand for care and decreasing availability of healthcare professionals. Digital health technologies represent opportunities that offer improved efficiency, accessibility, and patient care. In this scenario, Digital Therapeutics are technological advancements to treat or alleviate a disease and deliver a medical intervention with evidence-based therapeutic impacts and regulatory approval. Digital Therapeutics are a paradigm shift for physicians, who exercise caution in terms of trust and wide usage. Digital Therapeutics represents an opportunity and a challenge in healthcare system integration. The research investigates the factors explaining physicians' acceptance of Digital Therapeutics. A research model that combines organizational mechanisms derived from Institutional Theory and rational factors derived from the Technology Acceptance model was developed. The model was tested through 107 responses from a survey distributed to the members of the leading Italian scientific society in Diabetology. Literature-based hypotheses were empirically tested through Structural Equation Modelling. The analysis confirmed the influence of Perceived Ease of Use on Perceived Usefulness and Perceived Usefulness on the Intention To Use Digital Therapeutics. Rules and norms impact Perceived Usefulness when considering the influence of the scientific society. Culture and mindset towards innovation within the hospital positively affect Perceived Ease of Use. The readiness of hospital facilities enhances the extent to which physicians perceive the ease of employing Digital Therapeutics in their daily practice. Instead, esteemed colleagues' opinions and guidelines from the scientific society reveal to physicians the value of Digital Therapeutics in patients' care pathways. Institutions should prioritize cultural, normative, and regulative aspects to accelerate physicians' endorsement of Digital Therapeutics. Findings advance the theoretical knowledge around clinicians' adoption of innovative digital health technologies, unveiling the interaction between rational and institutional factors. The results highlight practical implications for healthcare institutions and Digital Therapeutics manufacturers willing to promote their adoption.

Development of a disease-specific health utility score for chronic obstructive pulmonary disease from a discrete choice experiment patient preference study

OBJECTIVES

While patient input to health technology assessment (HTA) has traditionally been of a qualitative nature, there is increasing interest to integrate quantitative evidence from patient preference studies into HTA decision making. Preference data can be used to generate disease-specific health utility data. We generated a health utility score for patients with chronic obstructive pulmonary disease (COPD) and consider its use within HTAs.

METHODS

Based on qualitative research, six symptoms were identified as important to COPD patients: shortness of breath, exacerbations, chronic cough, mucus secretion, sleep disturbance, and urinary incontinence. We employed a discrete choice experiment (DCE) and the random parameter logistic regression technique to estimate utility scores for all COPD health states. The relationship between patients' COPD health utility scores, self-perceived COPD severity, and EQ-5D-3L utility scores was analyzed, with data stratified according to disease severity and comorbidity subgroups.

RESULTS

The COPD health utility score had face validity, with utility scores negatively correlated with patients' self-perceived COPD severity. The correlation between the COPD health utility scores and EQ-5D-3L values was only moderate. While patient EQ-5D-3L scores were impacted by comorbidities, the COPD health utility score was less impacted by comorbid conditions.

CONCLUSIONS

Our COPD utility measure, derived from a DCE, provides a patient-centered health utility score and is more sensitive to the COPD health of the individual and less sensitive to other comorbidities. This disease-specific instrument should be considered alongside generic health-related quality of life instruments when valuing new COPD therapies in submissions to licensing and reimbursement agencies.

Impact of fixed orthodontic retainers on oral health-related quality of life: a longitudinal prospective study

OBJECTIVE

The aim of the present study was to assess the impact of orthodontic retainers on oral health-related quality of life (OHRQoL) in the short and long terms after orthodontic treatment.

METHODS

Data from 45 patients up to three years after orthodontic treatment (T0) were analyzed. Patients were reassessed four years (T1) after T0. OHRQoL was measured using the OHIP-14 (Oral Health Impact Profile-14) questionnaire. The presence of a fixed retainer in the upper and/or lower arches, sex, and age were the predictive variables evaluated at T0 and T1. The occurrence of retainer fracture at T0 was clinically evaluated. Due to the COVID-19 pandemic, clinical examination on T1 was not possible, so the OHIP-14 and the self-perception of changes in teeth position and fracture of retainers were examined using an on-line questionnaire.

RESULTS

At the initial examination, the presence of upper retainers had a negative impact on quality of life (p=0.018). The OHIP-14 value increased significantly from T0 to T1 (p=0.014), regardless of the presence of retainers. The fracture or debonding of the retainer reported by the patient was the only variable that had a negative impact on OHRQoL (p=0.05).

CONCLUSION

The use of fixed upper retainers suggests a negative impact on the quality of life of the orthodontic patient after the end of orthodontic treatment. This impact, however, is negligible in the long term, except when associated with fracture or debonding. This study emphasizes the need for continuous follow-up of orthodontic patients during the retention period.

Development and content validity of an application to assess 24-hour movement behaviors in 0-4-year-old children involving end-users and key stakeholders: the My Little Moves app

BACKGROUND

Recently, research focus has shifted to the combination of all 24-h movement behaviors (physical activity, sedentary behavior and sleep) instead of each behavior separately. Yet, no reliable and valid proxy-report tools exist to assess all these behaviors in 0-4-year-old children. By involving end-users (parents) and key stakeholders (researchers, professionals working with young children), this mixed-methods study aimed to 1) develop a mobile application (app)-based proxy-report tool to assess 24-h movement behaviors in 0-4-year-olds, and 2) examine its content validity.

METHODS

First, we used concept mapping to identify activities 0-4-year-olds engage in. Parents (n = 58) and professionals working with young children (n = 21) generated a list of activities, sorted related activities, and rated the frequency children perform these activities. Second, using multidimensional scaling and cluster analysis, we created activity categories based on the sorted activities of the participants. Third, we developed the My Little Moves app in collaboration with a software developer. Finally, we examined the content validity of the app with parents (n = 14) and researchers (n = 6) using focus groups and individual interviews.

RESULTS

The app has a time-use format in which parents proxy-report the activities of their child, using eight activity categories: personal care, eating/drinking, active transport, passive transport, playing, screen use, sitting/lying calmly, and sleeping. Categories are clarified by providing examples of children's activities. Additionally, 1-4 follow-up questions collect information on intensity (e.g., active or calm), posture, and/or context (e.g., location) of the activity. Parents and researchers considered filling in the app as feasible, taking 10-30 min per day. The activity categories were considered comprehensive, but alternative examples for several activity categories were suggested to increase the comprehensibility and relevance. Some follow-up questions were considered less relevant. These suggestions were adopted in the second version of the My Little Moves app.

CONCLUSIONS

Involving end-users and key stakeholders in the development of the My Little Moves app resulted in a tailored tool to assess 24-h movement behaviors in 0-4-year-olds with adequate content validity. Future studies are needed to evaluate other measurement properties of the app.

Comparison of the responses of cross-sectional web- and paper-based surveys on lifestyle behaviors of Japanese adolescents

Objective

In Japan, paper-based surveys are currently more effective than web-based surveys. This study compared the response rates and lifestyle behaviors between paper- and web-based surveys conducted among Japanese junior and senior high schools.

Methods

In total, there were 42 and 64 junior and senior high schools, respectively, for the web-based surveys and 20 and 27 junior and senior high schools, respectively, for the paper-based surveys. The questionnaire covered lifestyle behaviors (e.g., alcohol consumption, smoking, exercise, eating, and sleep status), mental health, and plans to attend college. School- and student-level response rates by survey method were assessed, and so was the effect on the reporting of each lifestyle behavior using logistic regression models.

Results

The school response rates were 16.0% and 38.3% for web- and paper-based surveys, respectively. The student response rates were 88.7% and 77.2%, respectively. The web-based group had significantly more female participants and lower response rates for higher grades in senior high schools. The odds of lifetime and current alcohol consumption and poor mental health were lower, whereas those of lifetime use of conventional cigarettes, shorter sleep duration, and plans to continue attending college were higher among web-based (vs. paper-based) participants.

Conclusions

The school response rate was poor in the web-based survey. However, whether the differences in lifestyle behavior are attributed to selection bias or the survey method remains unclear.

Validation of online version of asthma control questionnaire in pediatric patients

Introduction: The Asthma Control Questionnaire (ACQ) is a seven-item questionnaire assessing symptoms that asthma clinicians consider to be most important for evaluating the adequacy of asthma control. An online version of the ACQ may be able to indicate whether a visit to the physician is warranted to modify therapy to achieve better control of their asthma, ultimately reducing the number of unnecessary visits, particularly during the pandemic. The aim of our study is to compare the paper and online ACQ to validate the online version for use in real-life settings.Methods: Our study included 28 patients who completed both paper and the online ACQ on the same day when they came home. The online version of the questionnaire was prepared to look similar to the paper form, with the same sentences and answers.Results: The correlation between paper and online ACQ questionnaires was very high (r = 0.935; p < 0.001). When comparing each individual item, correlation coefficients ranged from 0.672 to 0.935. The lowest correlation is obtained in activity limitations, while the next one is 0.767, others higher than 0.8. The online form gave small and insignificantly higher scores compared to paper form with mean difference between -0.07 and 0.21. Mean difference of 0.01 (p = 0.986) between paper ACQ and online ACQ is obtained.Conclusion: The online version of the ACQ can be used for asthma control monitoring in pediatric patients in order to minimize unnecessary social contacts as well as hospital patient load, but retain adequate surveillance of disease symptoms by their physician.

Measurement Invariance of the Satisfaction With Life Scale in South Korea

Abstract. This study examined the cross-group and temporal measurement invariance of the Satisfaction With Life Scale in Korea. A nationally representative sample ( N = 13,824) and a convenience sample collected at four-time points over approximately 14 months ( N = 338) were used. Full measurement invariance (i.e., equal factor loadings and intercepts) was supported across groups based on gender, age, education, data collection method (face-to-face versus non-face-to-face), and two alternative translations of the scale. Temporal measurement invariance was also supported. Accordingly, the same underlying construct is measured, and the items of the scale are understood and answered similarly across groups and across time in Korea. Supplemental analysis revealed that Item 5 was not invariant between Korea and Japan, with Korean respondents tending to rate this item higher than Japanese respondents.

Assessing Telemedicine Efficiency in Follow-up Care With Video Consultations for Patients in Orthopedic and Trauma Surgery in Germany: Randomized Controlled Trial

Background

Telemedicine can help mitigate important health care challenges, such as demographic changes and the current COVID-19 pandemic, in high-income countries such as Germany. It gives physicians and patients the opportunity to interact via video consultations, regardless of their location, thus offering cost and time savings for both sides.

Objective

We aimed to investigate whether telemedicine can be implemented efficiently in the follow-up care for patients in orthopedic and trauma surgery, with respect to patient satisfaction, physician satisfaction, and quality of care.

Methods

We conducted a prospective randomized controlled trial in a German university hospital and enrolled 60 patients with different knee and shoulder conditions. For follow-up appointments, patients received either an in-person consultation in the clinic (control group) or a video consultation with their physician (telemedicine group). Patients’ and physicians’ subsequent evaluations of these follow-up appointments were collected and assessed using separate questionnaires.

Results

On the basis of data from 52 consultations after 8 withdrawals, it was found that patients were slightly more satisfied with video consultations (mean 1.58, SD 0.643) than with in-clinic consultations (mean 1.64, SD 0.569), although the difference was not statistically significant (P=.69). After excluding video consultations marred by technical problems, no significant difference was found in physician satisfaction between the groups (mean 1.47, SD 0.516 vs mean 1.32, SD 0.557; P=.31). Further analysis indicated that telemedicine can be applied to broader groups of patients and that patients who have prior experience with telemedicine are more willing to use telemedicine for follow-up care.

Conclusions

Telemedicine can be an alternative and efficient form of follow-up care for patients in orthopedic and trauma surgery in Germany, and it has no significant disadvantages compared with in-person consultations in the clinic.

Trial Registration

German Clinical Trials Register DRKS00023445; https://www.drks.de/drks_web/navigate.do?navigationId=trial.HTML&TRIAL_ID=DRKS00023445

Comparison of the agreement between WeChat-based self-administered and interviewer-administered data on infant and young child feeding in China: A test-retest study

Background

Measuring infant and young child feeding (IYCF) indicators is important in evaluating child health programs and making evidence-based decisions. With Internet and new media rapidly developing, communication apps such as WeChat (the most popular mobile social media platform in China) are widely used and can potentially be used as an alternative way to collect infant and young child feeding information. This study compares data agreement between a WeChat-based self-administered and an interviewer-administered survey on infant and young child feeding information.

Methods

We recruited 297 mothers of children aged 6-23 months in Fenxi County, Shanxi Province, China. Using the Test-Retest method, we first collected data through a self-administered survey using a WeChat-based electronic questionnaire and asked 36 questions on breastfeeding and complementary feeding knowledge, practices, and information sources. We then conducted an interviewer-administered survey using the same questionnaire and compared the data agreement between the two survey methods during the same day. Cohen's kappa score (κ) and intraclass correlation coefficients (ICC) were used for data agreement analysis for all 36 questions and six key IYCF indicators. The McNemar test was used to identify differences between the two survey methods for the six key indicators.

Results

There was substantial or almost perfect agreement for 33 questions (κ/ICC>0.60), and slight or fair agreement for the other 3 questions (κ/ICC<0.40). Agreement of all six key IYCF indicators was substantial or almost perfect (κ = 0.78-0.94), while two indicators showed statistical differences between the two survey methods (P = 0.03 for “Minimum meal frequency” and P = 0.001 for “Minimum accepted diet”). Analysis of reasons for inconsistencies showed that 43.6% of all the inconsistencies were not caused by the self-administered survey method. The cost of the interviewer-administered survey was much higher than that of the self-administered survey: ¥45.9 (US$6.8) vs ¥19.7 (US$2.9) per questionnaire.

Conclusions

The WeChat-based self-administered method can be used for future data collection of infant and young child feeding information in China. Most of the questions and key indicators showed very good agreement without statistical differences between the two methods.

Organizing the health interview survey at the local level: design of a pilot study

Background

The local Health Interview Study (LHIS) was developed to gain health information at the level of the municipality in Flanders, the northern part of Belgium. It enables municipalities to make evidence-based decisions in their public health policy. To test the feasibility of implementing the LHIS, a pilot study was conducted in Melle, a small Flemish municipality with 11.736 inhabitants.

Methods

The target sample size was 1000 (≥ 15 years). A systematic sampling technique was applied with substitutes for non-respondents who were matched in terms of statistical sector, age and sex. Selected persons were contacted by post to complete the questionnaire and in case of non-response, a reminder was sent. Questionnaires were collected using a concurrent mixed-mode design: a paper and pencil, and web option. All questions were selected from the Belgian Health Interview Survey relating to health status and determinants of health.

Results

One thousand twenty-two questionnaires were obtained after inviting 3137 individuals (response rate = 32.6%). Older adults were more likely to participate than younger adults, and women more than men. The final sample resembled the initial sample in terms of sex and statistical sector, but not in terms of age. Younger adults were underrepresented whereas older adults were overrepresented. Lastly, older adults were more likely to fill in the questionnaire on paper than younger adults, and women more than men.

Conclusion

The LHIS can be successfully implemented in Flemish municipalities. The method, however, does not guarantee that the composition of the final sample reflects the initial sample. Therefore, weights should be added in the analyses to correct for potential deviations in sample composition. Furthermore, implementing a sequential mixed-mode design with a web option preceding a paper and pencil option in future studies could reduce costs and improve data quality.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13690-022-00909-z.

People living with Moderate-to-Severe COPD Prefer Improvement of Daily Symptoms Over the Improvement of Exacerbations: A Multi-Country Patient Preference Study

Introduction

This patient preference study sought to quantify the preferences of people living with COPD regarding symptom improvement in the UK, USA, France, Australia and Japan.

Methods

The inclusion criteria were people living with COPD aged 40 years or older who experienced ≥1 exacerbation in the previous year with daily symptoms of cough and excess mucus production. The study design included: 1) development of an attributes and levels grid through qualitative patient interviews; and 2) implementation of the main online quantitative survey, which included a discrete choice experiment (DCE) to allow assessment of attributes and levels using hypothetical health state profiles. Preference weights (utilities) were derived from the DCE using hierarchical Bayesian analysis. A preference simulator was developed that enabled different health state scenarios to be evaluated based on the predicted patient preferences.

Results

1050 people living with moderate-to-severe COPD completed the survey. All attributes were considered important when patients determined their preferences in the DCE. In a health state preference simulation, two hypothetical health states (comprising attribute levels) with qualitatively equivalent improvements in A) cough and mucus and B) shortness of breath (SOB) resulted in a clear preference for cough and mucus improved profile. When comparing two profiles with C) daily symptoms improved and D) exacerbations improved, there was a clear preference for the daily symptoms improved profile.

Conclusions

People living with moderate-to-severe COPD prefer to reduce cough and mucus production together over improvement of SOB and would prefer to reduce combined daily symptoms over an improvement in exacerbations.

There is a need for symptom-focused therapies to deliver meaningful outcomes for people living with COPDhttps://bit.ly/3KqcSur

Development of 2 Short Patient-Report Questionnaires of Patient Safety in Primary Care

OBJECTIVES

The Patient Reported Experiences and Outcomes of Safety in Primary Care (PREOS-PC) is a valid and reliable instrument (61 items across 5 domains) of patients' perceptions of safety. Stakeholder feedback has supported shorter versions for improving choice and facilitating uptake of routine patient-centered evaluation. We sought to develop 2 shorter versions of PREOS-PC: one including the shortest possible scales that met established measurement performance standards and a screening version including a single item per domain.

METHODS

A total of 1244 patients from 45 general practices across England completed PREOS-PC questionnaires. All scale items in PREOS-PC underwent Item Response Theory analysis, applying standard criteria for the item reduction. Cognitive debriefing from 10 patient interviews allowed for the assessment of the instruments' readability. The instruments' psychometrics properties were reassessed in a validation sample of 1557 patients in 21 English general practices.

RESULTS

"PREOS-PC Compact" includes 25 items and 2 open-ended questions across the 5 domains, 44% of the length of the original instrument. "PREOS-PC Screen" consists of 6 items: the best-performing single items for 2 domains, 1 item modified from original items for each of the remaining 3 domains, and 1 open-ended question. The evaluation of the instruments confirmed they were acceptable to patients and met standards for readability; construct, convergent, and divergent validity; and reliability.

CONCLUSIONS

PREOS-PC Compact meets high-performance standards while reducing patient burden for routine monitoring of patient safety in primary care. PREOS-PC Screen is a concise tool apt for incorporation into audits and to target more in-depth review as needed.

Determinants of Chronic Biological Stress, Measured as Hair Cortisol Concentration, in a General Population of Adolescents: From Individual and Household Characteristics to Neighborhood Urbanicity

Chronic biological stress may adversely affect adolescents' physical and mental health, but insight in the personal and environmental factors that determine chronic stress is limited. We measured 3-month cumulative hair cortisol concentration (HCC) in 419 adolescents, participating in the Flemish Environment and Health Study. Adolescents' health and lifestyle characteristics, household and neighborhood socio-economic status as well as neighborhood urbanicity were assessed as potential determinants of HCC, using multiple linear regression models. We additionally explored heterogeneity of our results by sex. HCC were significantly higher in boys from densely populated neighborhoods, the association was not significant in girls. Accordingly, boys living outside cities had significantly lower HCC than boys, living in cities. HCC was significantly lower in adolescents with an optimal vitality, a measure of a positive mental health status. In adolescent girls, menarcheal status (pre-/postmenarche) was a significant determinant of HCC. Our findings are the first to suggest that residential urbanicity may have an impact on chronic biological stress in a general population of adolescent boys.

Assessing the effectiveness of an ergonomics intervention program with a participatory approach: ergonomics settlement in an Iranian steel industry

PURPOSE

Work-related musculoskeletal disorders (WMSDs) are common occupational problems affecting the health and productivity of workers worldwide. Ergonomic intervention programs (EIPs) can play an effective role in preventing these disorders in the workplace. Assessing the effectiveness of an EIP is a challenge faced by both industries and researchers. This study was aimed at assessing the effectiveness of an EIP on human resources productivity (HRP), musculoskeletal disorders (MSDs), general health and occupational fatigue in a steel industry.

METHODS

This study was conducted in a steel industry in Isfahan, Iran, between 2018 and 2021. To assess the effectiveness of the EIP with a participatory approach, training and redesign of workstations, the criteria of HRP, MSDs, general health and occupational fatigue were investigated before and after the intervention, using HRP Questionnaire, Nordic musculoskeletal questionnaire (NMQ), 28-item General Health Questionnaire (28-GHQ), Swedish Occupational Fatigue Inventory (SOFI-20) and Occupational Fatigue/Exhaustion Recovery (OFER-15) Questionnaire, as data collection tools, respectively.

RESULTS

The implementation of EIP in the studied industry significantly led to an increase in HRP (p < 0.05). The prevalence of MSDs decreased significantly in most regions of the body after the interventions (p < 0.001). In addition, the program significantly improved general health (p < 0.001) and reduced occupational fatigue among employees (p < 0.001).

CONCLUSIONS

The implementation of EIP was significantly effective in working conditions improvement. Therefore, implementing EIP with participatory approach, workforce training, as well as redesigning of workstations are recommended in industries.

Development of a Parkinson's disease specific falls questionnaire

BACKGROUND

Falls are a major health burden for older adults with Parkinson's disease (PD), but there is currently no reliable questionnaire to capture the circumstances and consequences of falls in older adults with PD. This study aimed to develop a PD-specific falls questionnaire and to evaluate its test-retest reliability in older adults with PD.

METHODS

A novel PD-specific falls questionnaire (PDF-Q) was developed in two modes (online and paper-based version) and used to assess falls and near-falls events over the past 12-months. Questions were agreed upon by an expert group, with the domains based on previous falls-related questionnaires. The questions included the number and circumstances (activities, location and direction) of falls and near-falls, and consequences (injuries and medical treatment) of falls. The PDF-Q was distributed to 46 older adults with PD (online n = 30, paper n = 16), who completed the questionnaire twice, 4 weeks apart. Kappa (κ) statistics were used to establish test-retest reliability of the questionnaire items.

RESULTS

Pooled results from both questionnaires for all participants were used to assess the overall test-retest reliability of the questionnaire. Questions assessing the number of falls (κ = 0.41) and the number of near-falls (κ = 0.51) in the previous 12-months demonstrated weak agreement, while questions on the location of falls (κ = 0.89) and near-falls (κ = 1.0) demonstrated strong to almost perfect agreement. Questions on the number of indoor (κ = 0.86) and outdoor (κ = 0.75) falls demonstrated moderate to strong agreement, though questions related to the number of indoor (κ = 0.47) and outdoor (κ = 0.56) near-falls demonstrated weak agreement. Moderate to strong agreement scores were observed for the most recent fall and near-fall in terms of the direction (indoor fall κ = 0.80; outdoor fall κ = 0.81; near-fall κ = 0.54), activity (indoor fall κ = 0.70; outdoor fall κ = 0.82; near-fall κ = 0.65) and cause (indoor fall κ = 0.75; outdoor fall κ = 0.62; near-fall κ = 0.56).

CONCLUSIONS

The new PDF-Q developed in this study was found to be reliable for capturing the circumstances and consequences of recent falls and near-falls in older adults with PD.

Comparison of the printed and online administration of the Behavioral Regulation in Exercise Questionnaire (BREQ-2)

OBJECTIVE

To compare the traditional printed form of the Behavioral Regulation in Exercise Questionnaire with a proposed online form in terms of validity, reliability, and applicability.

METHODS

A crossover design study was conducted with 157 undergraduate students. Half of the sample answered the printed questionnaire first and then answered the online questionnaire 7 days later, while the other half of the sample did the inverse. Cronbach's alpha was used to analyze the internal consistency of both the online and printed questionnaires. The construct validity was analyzed by confirmatory factor analysis, using a weighted least square mean and adjusted variance estimation and oblique rotation. The quality of the model was tested with fit indices.

RESULTS

The confirmatory factor analysis showed the 19-item structure with five factors: χ2 of 230.718; degrees of freedom of 142; χ2/degrees of freedom of 1.625; comparative fit index of 0.978 and root mean square error of approximation of 0.073. All items presented factorial loads above 0.5. There was also excellent consistency between the formats of administration in all dimensions, with Cronbach's alpha values above 0.70. The stability between the formats of administration varied between 0.78 (95%CI: 0.69-0.85) and 0.84 (95%CI: 0.77-0.89), suggesting desirable confidence between both formats of administration.

CONCLUSION

The five-factor model of the online Behavioral Regulation in Exercise Questionnaire shows internal consistency both in terms of the scale dimensions as well as in terms of the total items.

Reliability of Chinese web-based ocular surface disease index questionnaire in dry eye patients: a randomized, crossover study

AIM

To assess the reliability of web-based version of ocular surface disease index in Chinese (C-OSDI) on clinically diagnosed dry eye disease (DE) patients.

METHODS

A total of 254 Chinese participants (51% male, 129/254; mean age: 27.90±9.06y) with DED completed paper- and web-based versions of C-OSDI questionnaires in a randomized crossover design. Ophthalmology examination and DED diagnosis were performed prior to the participants being invited to join the study. Participants were randomly designated to either group A (paper-based first and web-based second) or group B (web-based first and paper-based second). Final data analysis included participants that had successfully completed both versions of the C-OSDI. Demographic characteristics, test-retest reliability, and agreement of individual items, subscales, and total score were evaluated with intraclass correlation coefficients (ICC), Spearman rank correlation, Wilcoxon test and Rasch analysis.

RESULTS

Reliability indexes were adequate, Pearson correlation was greater than 0.8 and ICCs range was 0.827 to 0.982; total C-OSDI score was not statistically different between the two versions. The values of mean-squares fit statistics were very low compared to 1, indicating that the responses to the items by the model had a high degree of predictability. While comparing the favorability 72% (182/254) of the participants preferred web-based assessment.

CONCLUSION

Web-based C-OSDI is reliable in assessing DED and correlation with the paper-based version is significant in all subscales and overall total score. Web-based C-OSDI can be administered to assess individuals with DED as participants predominantly favored online assessment.

Comparing the efficiency of paper-based and electronic data capture during face-to-face interviews

On-site surveys involving face-to-face interviews are implemented globally across many scientific disciplines. Incorporating new technologies into such surveys by using electronic devices is becoming more common and is widely viewed to be more cost-effective and accurate. However, Electronic Data Capture methods (EDC) when compared to traditional Paper-based Data Capture (PDC) are often implemented without proper evaluation of any changes in efficiency, especially from surveys in coastal and marine environments. A roving creel survey of recreational shore-based fishers in Western Australia in 2019 enabled a direct comparison between the two methods. Randomisation strategies were employed to ensure biases in using each technique were minimised. A total of 1,068 interviews with recreational fishers were undertaken with a total error rate of 5.1% (CI95%: 4.8–5.3%) for PDC and 3.1% (CI95%: 2.9–3.3%) for EDC. These results confirmed that EDC can reduce errors whilst increasing efficiency and decreasing cost, although some aspects of this platform could be improved with some streamlining. This study demonstrates how EDC can be successfully implemented in coastal and marine environments without compromising the randomised, stratified nature of a survey and highlights the cost-effectiveness of this method. Such findings can be widely applied to any discipline which uses face-to-face interviews for data collection.

Interformat Reliability of Web-Based Parent-Rated Questionnaires for Assessing Neurodevelopmental Disorders Among Preschoolers: Cross-sectional Community Study

BACKGROUND

Early detection and intervention for neurodevelopmental disorders are effective. Several types of paper questionnaires have been developed to assess these conditions in early childhood; however, the psychometric equivalence between the web-based and the paper versions of these questionnaires is unknown.

OBJECTIVE

This study examined the interformat reliability of the web-based parent-rated version of the Autism Spectrum Screening Questionnaire (ASSQ), Attention-Deficit/Hyperactivity Disorder Rating Scale (ADHD-RS), Developmental Coordination Disorder Questionnaire 2007 (DCDQ), and Strengths and Difficulties Questionnaire (SDQ) among Japanese preschoolers in a community developmental health check-up setting.

METHODS

A set of paper-based questionnaires were distributed for voluntary completion to parents of children aged 5 years. The package of the paper format questionnaires included the ASSQ, ADHD-RS, DCDQ, parent-reported SDQ (P-SDQ), and several additional demographic questions. Responses were received from 508 parents of children who agreed to participate in the study. After 3 months, 300 parents, who were among the initial responders, were randomly selected and asked to complete the web-based versions of these questionnaires. A total of 140 parents replied to the web-based format and were included as a final sample in this study.

RESULTS

We obtained the McDonald ω coefficients for both the web-based and paper formats of the ASSQ (web-based: ω=.90; paper: ω=.86), ADHD-RS total and subscales (web-based: ω=.88-.94; paper: ω=.87-.93), DCDQ total and subscales (web-based: ω=.82-.94; paper: ω=.74-.92), and P-SDQ total and subscales (web-based: ω=.55-.81; paper: ω=.52-.80). The intraclass correlation coefficients between the web-based and paper formats were all significant at the 99.9% confidence level: ASSQ (r=0.66, P<.001); ADHD-RS total and subscales (r=0.66-0.74, P<.001); DCDQ total and subscales (r=0.66-0.71, P<.001); P-SDQ Total Difficulties and subscales (r=0.55-0.73, P<.001). There were no significant differences between the web-based and paper formats for total mean score of the ASSQ (P=.76), total (P=.12) and subscale (P=.11-.47) mean scores of DCDQ, and the P-SDQ Total Difficulties mean score (P=.20) and mean subscale scores (P=.28-.79). Although significant differences were found between the web-based and paper formats for mean ADHD-RS scores (total: t₁₃₂=2.83, P=.005; Inattention subscale: t₁₃₃=2.15, P=.03; Hyperactivity/Impulsivity subscale: t₁₃₃=3.21, P=.002), the effect sizes were small (Cohen d=0.18-0.22).

CONCLUSIONS

These results suggest that the web-based versions of the ASSQ, ADHD-RS, DCDQ, and P-SDQ were equivalent, with the same level of internal consistency and intrarater reliability as the paper versions, indicating the applicability of the web-based versions of these questionnaires for assessing neurodevelopmental disorders.

Quality of life and related constructs in a group of infertile Hungarian women: a validation study of the FertiQoL

Quality-of-life measurement is a basic prerequisite for psychologically sensitive fertility care and the FertiQoL is a psychometrically sound outcome measure in this field. The aim of the present research was to investigate the reliability and validity of the Hungarian Core FertiQoL. Two independent samples of infertile women were merged (n = 320). While the model fit of the four-factor Confirmatory Factor Analysis was under the level of acceptability (χ²(246) = 626.36, p < 0.001, RMSEA = 0.070 [CI₉₀ = 0.063-0.076], CFI = 0.878, SRMR = 0.071), the four-factor Exploratory Structural Equation Model showed much improved model fit (χ²(186) = 395.63, p < 0.001, RMSEA = 0.059 [CI₉₀ = 0.051-0.067], CFI = 0.933, SRMR = 0.035). Good internal consistency (Cronbach's Alphas 0.77-0.92) and construct reliability (0.75-0.95) were found for both factor structures. Depression correlated negatively with fertility-specific quality of life. Almost a quarter of the sample suffered from moderate-to-severe depression. Multivariate analysis of variance indicated that Beck Depression Inventory categories (mild, moderate etc.) co-occurred with significantly distinct FertiQoL score ranges, leading to a possible, clinically meaningful threshold on the Core FertiQoL. Pearson coefficients showed secondary infertility, rural residency and pre-treatment status to be associated with better fertility quality of life.

Is depression comparable between asylum seekers and native Germans? An investigation of measurement invariance of the PHQ-9

BACKGROUND

Asylum seekers show high prevalence of depressive disorders compared to native populations. For the assessment of depression, the Patient Health Questionnaire-9 (PHQ-9) is a widely used instrument that has shown high validity and reliability. However, it is largely unknown whether PHQ-9 scores are comparable between asylum seekers living in Western countries and native populations, and whether results can be interpreted without reservation.

METHOD

Data from asylum seekers living in Germany (n = 243) and Germans without a migration background (n = 171) were used to analyze measurement invariance of the PHQ-9. Configural, scalar, and metric invariance was investigated, and test functioning was determined.

RESULTS

The PHQ-9 was not measurement invariant across Germans without a migration background and asylum seekers living in Germany. Differences were found regarding metric invariance and scalar invariance. The items anhedonia, depressed mood, appetite changes, psychomotor changes, and suicidal ideation had lower loadings and lower thresholds in asylum seekers compared to Germans without a migration background. That led to an overestimation translated into approximately one point on the sum-score.

LIMITATIONS

The study limitations include a heterogeneous sample of asylum seekers regarding countries of origin, and the utilization of the different language versions of the PHQ-9.

CONCLUSION

Our results may have implications for studies comparing levels of depression between asylum seekers and native Western samples. Even with the same latent level of depression, asylum seekers may have higher scores on several items and consequently a higher sum score. Therefore, the present results suggest a new determination or differentiation of the cut-off scores that were derived from Western samples.

Comparing web-based versus face-to-face and paper-and-pencil questionnaire data collected through two Belgian health surveys

OBJECTIVES

Using the European Health Interview Survey (EHIS) questionnaire, a web-based survey was organized alongside a face-to-face (F2F) survey including a paper-and-pencil (P&P) questionnaire for sensitive topics. Associated with these different modes, other design features varied too (e.g., recruitment, incentives, sampling). We assessed whether these whole data collection systems developed around the modes produced equivalent health estimates.

METHODS

Data were obtained from two population-based surveys: the EHISWEB (web-administered, n = 1010) and the Belgian Health Interview Survey 2018 (BHIS2018) (interviewer-administered, n = 2748). Logistic regression analyses were used to assess mode system differences while adjusting for socio-demographic differences in the net samples.

RESULTS

For the P&P mode of the BHIS, significant mode system differences were detected for 2 of the 9 health indicators. Among the indicators collected via the F2F mode, 9 of the 18 indicators showed significant differences.

CONCLUSIONS

Indicators collected via the web-based and P&P self-administered modes were generally more comparable than indicators collected via the web-based and F2F mode. Furthermore, fewer differences were detected for indicators based on simple and factual questions compared to indicators based on subjective or complex questions.

Residential green space and seasonal distress in a cohort of tree pollen allergy patients

BACKGROUND

Residential green space may improve human health, for example by promoting physical activity and by reducing stress. Conversely, residential green space may increase stress by emitting aeroallergens and exacerbating allergic disease. Here we examine impacts of exposure to residential green space on distress in the susceptible subpopulation of adults sensitized to tree pollen allergens.

METHODS

In a panel study of 88 tree pollen allergy patients we analyzed self-reported mental health (GHQ-12), perceived presence of allergenic trees (hazel, alder, birch) near the residence and residential green space area within 1 km distance [high (≥3 m) and low (<3 m) green]. Results were adjusted for patients' background data (gender, age, BMI, smoking status, physical activity, commuting distance, education level, allergy medication use and chronic respiratory problems) and compared with distress in the general population (N = 2467).

RESULTS

Short-term distress [mean GHQ-12 score 2.1 (95% confidence interval 1.5-2.7)] was higher in the study population than in the general population [1.5 (1.4-1.7)]. Residential green space had protective effects against short-term distress [high green, per combined surface area of 10 ha: adjusted odds ratio OR = 0.94 (95% confidence interval 0.90-0.99); low green, per 10 ha: OR = 0.85 (0.78-0.93)]. However, distress was higher in patients who reported perceived presence of allergenic trees near their residence [present vs. absent: OR = 2.04 (1.36-3.07)].

CONCLUSIONS

Perceived presence of allergenic tree species in the neighbourhood of the residence of tree pollen allergy patients modulates the protective effect of residential green space against distress during the airborne tree pollen season.

Acceptability, internal consistency and test-retest reliability of scales to assess parental and nursery staff's self-efficacy, motivation and knowledge in relation to pre-school children's nutrition, oral health and physical activity

Objective

To determine the acceptability, internal consistency and test–retest reliability of self-efficacy, motivation and knowledge scales relating to pre-school children’s nutrition, oral health and physical activity.

Design

An online questionnaire was completed twice with an interval of 7–11d.

Setting

Online questionnaires were sent to participants via email from nursery managers. The parent questionnaire was also available on the parenting website www.netmums.com.

Participants

Eighty-two parents and sixty-nine nursery staff from Bristol, UK who had and worked with 2–4-year-olds, respectively.

Results

Response rates were 86·3 and 86·0 % and missing data 15·9 and 14·5 % for the second administration of the parent and nursery staff questionnaires, respectively. Weighted κ coefficients for individual items mostly fell under the ‘moderate’ agreement category for the parental (75·0 %) and nursery staff (55·8 %) items. All self-efficacy and motivation scales had acceptable levels of internal consistency (Cronbach’s α coefficients>0·7). The intraclass correlation coefficients for the self-efficacy, motivation and knowledge scales ranged between 0·48 and 0·82. Paired t tests found an increase between test and retest knowledge scores for the Nutrition Motivation (t=−2·91, df=81, P=0·00) and Knowledge (t=−3·22, df=81, P=0·00) scales in the parent questionnaire.

Conclusions

Our findings demonstrate that the items and scales show good acceptability, internal consistency and test–retest reliability.

'Only God can promise healing.': help-seeking intentions and lay beliefs about cures for post-traumatic stress disorder among Sub-Saharan African asylum seekers in Germany

Background: Epidemiological studies have reported high rates of post-traumatic stress disorder (PTSD) among asylum seekers from Sub-Saharan Africa. In order to provide appropriate and culturally sensitive mental health care for this group, further knowledge about treatment preferences might be necessary. Objective: We aimed to provide insights into help-seeking intentions and lay beliefs about cures for PTSD held by asylum seekers from Sub-Saharan Africa living in Germany. Methods: To address this objective, we used a quantitative and qualitative methodological triangulation strategy based on a vignette describing symptoms of PTSD. In the quantitative part of the study, asylum seekers (n = 119), predominantly from Eritrea (n = 41), Somalia (n = 36), and Cameroon (n = 25), and a German comparison sample without a migration background (n = 120) completed the General Help-Seeking Questionnaire (GHSQ). In the qualitative part, asylum seekers (n = 26) reviewed the results of the questionnaire survey within eight focus group discussions sampled from groups of the three main countries of origin. Results: Asylum seekers showed a high intention to seek religious, medical, and psychological treatment for symptoms of PTSD. However, asylum seekers indicated a higher preference to seek help from religious authorities and general practitioners, as well as a lower preference to enlist psychological and traditional help sources than Germans without a migration background. Furthermore, asylum seekers addressed structural and cultural barriers to seeking medical and psychological treatment. Conclusion: To facilitate access to local health care systems for asylum seekers and refugees, it might be crucial to develop public health campaigns in collaboration with religious communities. When treating asylum seekers and refugees from Sub-Saharan Africa, practitioners should explore different religious and cultural frameworks for healing and recovery in order to signal understanding and acceptance of varying cultural contexts.

Witnessing intimate partner violence as a child: How boys and girls model their parents' behaviors in adolescence

Childhood witnesses of adult violence at home are at risk for future violence. It is unclear how gender of the child and adult perpetrator are related to adolescent relationship violence. We explore how childhood witnessing of same-gender, opposite-gender, and bidirectional violence perpetrated by adults is associated with adolescent relationship violence victimization only, perpetration only, and combined victimization/perpetration for male and female undergraduates. We gathered cross-sectional data from 907 undergraduates attending 67 randomly-selected classes at three distinct East-Coast colleges using pencil-and-paper surveys administered at the end of class time. Multiple imputation with chained equations was used to impute missing data. Multinomial regression models controlling for gender, age, race, school, and community violence predicted adolescent outcomes for each witnessing exposure; relative risk ratios and average adjusted probabilities with 95% confidence intervals are presented. Adolescent relationship violence outcomes vary based on gender of the child witness and adult perpetrator. Witnessing adult males perpetrate is associated with higher perpetration for boys and higher combined victimization/perpetration for girls. Witnessing adult females perpetrate - either as the sole perpetrator or in a mutually violent relationship with an adult male - increases risk for combined victimization/perpetration for boys and girls during adolescence.