The impact of misclassification due to survey response fatigue on estimation and identifiability of treatment effects

Real-world use, perception, satisfaction, and adherence of calcipotriol and betamethasone dipropionate PAD-cream in patients with plaque psoriasis in Spain and Germany: results from a cross-sectional, online survey

BACKGROUND

Psoriasis significantly impacts patients' quality of life (QoL). Dissatisfaction and non-adherence are major barriers associated with topical treatments. A cream based on the polyaphron dispersion (PAD) Technology containing a fixed-dose of calcipotriol (CAL) and betamethasone dipropionate (BDP) was designed for a patient-friendly psoriasis management. The CAL/BDP PAD-cream demonstrated efficacy, convenience, and safety/tolerability in clinical trials.

OBJECTIVES

This research assesses the real-world use, perception, satisfaction, and adherence of CAL/BDP PAD-cream among plaque psoriasis patients.

METHODS

Between September-November 2023, psoriasis patients from Spain and Germany using or having used CAL/BDP PAD-cream for >2 weeks were recruited via Wefight network to complete a 30-questions online survey. Anonymized results were pooled for descriptive statistical analysis.

RESULTS

The survey was completed by 129 patients (mean age: 43 years; 66% females; mean psoriasis duration: 12 years). Most patients (93%) were satisfied with CAL/BDP PAD-cream. The 66% reported high adherence (visual analogue scale 80-100) and 91% preferred CAL/BDP PAD-cream to their previous topical(s). Patients highlighted its ease/convenience of application, tolerability, and lack of itching/burning.

CONCLUSIONS

Psoriasis patients treated with CAL/BDP PAD-cream in a real-world setting show high satisfaction, good adherence, and a positive perception of the product, suggesting that favorable outcomes observed in clinical trials translate to real clinical practice.

COVID-19 Vaccine Effectiveness and Digital Pandemic Surveillance in Germany (eCOV Study): Web Application-Based Prospective Observational Cohort Study

BACKGROUND

The COVID-19 pandemic posed significant challenges to global health systems. Efficient public health responses required a rapid and secure collection of health data to improve the understanding of SARS-CoV-2 and examine the vaccine effectiveness (VE) and drug safety of the novel COVID-19 vaccines.

OBJECTIVE

This study (COVID-19 study on vaccinated and unvaccinated subjects over 16 years; eCOV study) aims to (1) evaluate the real-world effectiveness of COVID-19 vaccines through a digital participatory surveillance tool and (2) assess the potential of self-reported data for monitoring key parameters of the COVID-19 pandemic in Germany.

METHODS

Using a digital study web application, we collected self-reported data between May 1, 2021, and August 1, 2022, to assess VE, test positivity rates, COVID-19 incidence rates, and adverse events after COVID-19 vaccination. Our primary outcome measure was the VE of SARS-CoV-2 vaccines against laboratory-confirmed SARS-CoV-2 infection. The secondary outcome measures included VE against hospitalization and across different SARS-CoV-2 variants, adverse events after vaccination, and symptoms during infection. Logistic regression models adjusted for confounders were used to estimate VE 4 to 48 weeks after the primary vaccination series and after third-dose vaccination. Unvaccinated participants were compared with age- and gender-matched participants who had received 2 doses of BNT162b2 (Pfizer-BioNTech) and those who had received 3 doses of BNT162b2 and were not infected before the last vaccination. To assess the potential of self-reported digital data, the data were compared with official data from public health authorities.

RESULTS

We enrolled 10,077 participants (aged ≥16 y) who contributed 44,786 tests and 5530 symptoms. In this young, primarily female, and digital-literate cohort, VE against infections of any severity waned from 91.2% (95% CI 70.4%-97.4%) at week 4 to 37.2% (95% CI 23.5%-48.5%) at week 48 after the second dose of BNT162b2. A third dose of BNT162b2 increased VE to 67.6% (95% CI 50.3%-78.8%) after 4 weeks. The low number of reported hospitalizations limited our ability to calculate VE against hospitalization. Adverse events after vaccination were consistent with previously published research. Seven-day incidences and test positivity rates reflected the course of the pandemic in Germany when compared with official numbers from the national infectious disease surveillance system.

CONCLUSIONS

Our data indicate that COVID-19 vaccinations are safe and effective, and third-dose vaccinations partially restore protection against SARS-CoV-2 infection. The study showcased the successful use of a digital study web application for COVID-19 surveillance and continuous monitoring of VE in Germany, highlighting its potential to accelerate public health decision-making. Addressing biases in digital data collection is vital to ensure the accuracy and reliability of digital solutions as public health tools.

Nonresponse data in sexual well-being among breast reconstruction patients-who are we overlooking?

BACKGROUND

Missing data can affect the representativeness and accuracy of survey results, and sexual health-related surveys are especially at a higher risk of nonresponse due to their sensitive nature and stigma. The purpose of this study was to evaluate the proportion of patients who do not complete the BREAST-Q Sexual Well-being relative to other BREAST-Q modules and compare responders versus nonresponders of Sexual Well-being. We secondarily examined variables associated with Sexual Well-being at 1-year.

METHODS

A retrospective analysis of patients who underwent breast reconstruction from January 2018 to December 2021 and completed any of the BREAST-Q modules postoperatively at 1-year was performed.

RESULTS

The 2941 patients were included. Of the four BREAST-Q domains, Sexual Well-being had the highest rate of nonresponse (47%). Patients who were separated (vs. married, OR = 0.69), whose primary language was not English (vs. English, OR = 0.60), and had Medicaid insurance (vs. commercial, OR = 0.67) were significantly less likely to complete the Sexual Well-being. Postmenopausal patients were significantly more likely to complete the survey than premenopausal patients. Lastly, autologous reconstruction patients were 2.93 times more likely to respond than implant-based reconstruction patients (p < 0.001) while delayed (vs. immediate, OR = 0.70, p = 0.022) and unilateral (vs. bilateral, OR = 0.80, p = 0.008) reconstruction patients were less likely to respond. History of psychiatric diagnosis, aromatase inhibitors, and immediate breast reconstruction were significantly associated with lower Sexual Well-being at 1-year.

CONCLUSION

Sexual Well-being is the least frequently completed BREAST-Q domain, and there are demographic and clinical differences between responders and nonresponders. We encourage providers to recognize patterns in nonresponse data for Sexual-Well-being to ensure that certain patient population's sexual health concerns are not overlooked.

Emotionally intelligent school leadership predicts educator well-being before and during a crisis

We examined the role of educator perceptions of school leader emotion regulation (ER) and emotional support (ES) in educator well-being during a typical year and during the COVID-19 pandemic. Based on emotion contagion theory, leaders' (in)ability to regulate their own emotions may trigger ripple effects of positive or negative emotions throughout their organizations, impacting staff well-being. Additionally, based on conservation of resources theory, when experiencing psychologically taxing events, skillful emotional support provided by leaders may help to replenish staff's depleted psychological resources, promoting staff well-being. In two national studies, a cross-sectional (NStudy 1 = 4,847) and a two-wave study (NStudy 2 = 2,749), we tested the association between United States preK-12 educator perceptions of school leaders' ER and ES with educator well-being before and during the COVID-19 pandemic, employing structural equation modeling and multilevel modeling. In Studies 1 and 2, educator reports of their leaders' ER and ES skills predicted greater educator well-being, including higher positive affect and job satisfaction and lower emotional exhaustion and turnover intentions. In moderation analyses, perceived leader ER predicted well-being about equally among educators facing severe versus mild health impacts from COVID-19. In contrast, perceived leader ES was more strongly associated with educator well-being for some outcomes in those severely versus mildly impacted by COVID-19 illness and death. Leader ER played a role in the well-being of everyone, whereas leader ES was more predictive of well-being for those severely impacted by a crisis. Regarding implications for policy and practice, efforts to promote well-being among educators may be enhanced when combined with efforts to develop school leaders' ER and ES skills, especially in times of crisis. Accordingly, school districts should consider the value of investing in systematic, evidence-based emotion skills training for their leaders.

Pilot Study on the Efficacy and Safety of Long-Term Oral Imepitoin Treatment for Control of (Thunder)Storm-Associated Noise Phobia/Noise Aversion in Dogs Using an Individualized-Dose Titration Approach

Imepitoin is a low-affinity partial agonist for benzodiazepine binding sites of gamma-aminobutyric acid receptors with anxiolytic effects. It has been shown to reduce anxiety during noise-related events in dogs when given at 30 mg/kg PO BID, although this dose was associated with ataxia and increased appetite in some cases. The objective of this study was to assess its safety and efficacy for storm anxiety when started at 10 mg/kg PO BID and titrated to effect up to 30 mg/kg PO BID during storm season. Significant decreases in anxiety scores were seen in weekly surveys and storm logs (SLs) at 10, 20 and 30 mg/kg PO BID. Serious adverse events (AEs) were not reported in any subject. Ataxia was the most commonly reported non-serious AE (14/33), followed by increased hunger (13/33). The frequency of AEs was higher in the 20 mg/kg PO BID group than in the 10 mg/kg group PO BID. No clinically significant changes were seen in lab work pre- and post-study. In conclusion, Imepitoin given during storm season at doses ranging from 10 to 30 mg/kg PO BID reduced clinical signs of fear and anxiety during storms for the dogs in this study. These findings support the use of an individually titrated dose.

The Veterans Rand-12 Physical Composite Score Prognosticates Postoperative Clinical Outcomes in Patients Undergoing Anterior Cervical Discectomy and Fusion

OBJECTIVE

To determine prognostic value of preoperative Veterans RAND 12-Item Health Survey (VR-12) physical composite score (PCS) on outcomes in patients undergoing anterior cervical discectomy and fusion (ACDF).

METHODS

ACDF patients with preoperative VR-12 PCS formed 2 cohorts: VR-12 PCS <35 and VR-12 PCS ≥35. The following patient-reported outcome measures (PROMs) were gathered preoperatively and postoperatively up to 2 years: VR-12 mental composite score (MCS)/PCS, Neck Disability Index (NDI), Patient-Reported Outcomes Measurement Information System (PROMIS) PF, 9-Item Patient Health Questionnaire (PHQ-9), visual analog scale (VAS) neck/arm pain, and 12-Item Short Form Health Survey (SF-12) PCS/MCS. Comparing PROMs change with established thresholds determined achievement of minimum clinically important difference (MCID). Univariate analysis compared demographics, perioperative characteristics, and preoperative PROMs. Multivariable regression analysis compared postoperative PROMs and MCID achievement.

RESULTS

Of 174 patients, 83 had VR-12 PCS <35. Preoperatively, patients with reduced PF displayed lower patient-reported outcome scores in NDI, PHQ-9, and SF-12 MCS (P ≤ 0.008), but not in VAS arm. At 6 weeks postoperatively, these patients continued to score lower in NDI (P ≤ 0.014) and SF-12 PCS (P ≤ 0.001), among others. By the final check, most scores remained lower (P ≤ 0.002) except for PHQ-9 and VAS arm (P > 0.05). Greater improvements at 6 weeks postoperatively were especially noted in patients with lower initial VR-12 PCS for NDI, PROMIS PF, and SF-12 PCS (P < 0.05). However, by final follow-up, only PROMIS PF showed noteworthy improvement (P = 0.19). Regarding MCID achievement, significant differences were largely absent except in NDI, where patients with reduced PF exhibited more MCID achievement (P = 0.016).

CONCLUSIONS

ACDF patients with VR-12 PCS <35 experienced inferior PF, mental health, and disability postoperatively until final follow-up. There were no significant differences in postoperative improvement magnitude and MCID achievement. Results suggest that baseline VR-12 PCS in ACDF patients may indicate poorer PF, mental health, and disability postoperatively. However, VR-12 PCS does not limit extent of postoperative improvement.

Longitudinal social contact data analysis: insights from 2 years of data collection in Belgium during the COVID-19 pandemic

BACKGROUND

During the COVID-19 pandemic, the CoMix study, a longitudinal behavioral survey, was designed to monitor social contacts and public awareness in multiple countries, including Belgium. As a longitudinal survey, it is vulnerable to participants' "survey fatigue", which may impact inferences.

METHODS

A negative binomial generalized additive model for location, scale, and shape (NBI GAMLSS) was adopted to estimate the number of contacts reported between age groups and to deal with under-reporting due to fatigue within the study. The dropout process was analyzed with first-order auto-regressive logistic regression to identify factors that influence dropout. Using the so-called next generation principle, we calculated the effect of under-reporting due to fatigue on estimating the reproduction number.

RESULTS

Fewer contacts were reported as people participated longer in the survey, which suggests under-reporting due to survey fatigue. Participant dropout is significantly affected by household size and age categories, but not significantly affected by the number of contacts reported in any of the two latest waves. This indicates covariate-dependent missing completely at random (MCAR) in the dropout pattern, when missing at random (MAR) is the alternative. However, we cannot rule out more complex mechanisms such as missing not at random (MNAR). Moreover, under-reporting due to fatigue is found to be consistent over time and implies a 15-30% reduction in both the number of contacts and the reproduction number ([Formula: see text]) ratio between correcting and not correcting for under-reporting. Lastly, we found that correcting for fatigue did not change the pattern of relative incidence between age groups also when considering age-specific heterogeneity in susceptibility and infectivity.

CONCLUSIONS

CoMix data highlights the variability of contact patterns across age groups and time, revealing the mechanisms governing the spread/transmission of COVID-19/airborne diseases in the population. Although such longitudinal contact surveys are prone to the under-reporting due to participant fatigue and drop-out, we showed that these factors can be identified and corrected using NBI GAMLSS. This information can be used to improve the design of similar, future surveys.

HealthLit4Kids: teacher experiences of health literacy professional development in an Australian primary school setting

Health literacy (HL) is a critical asset for 21st century learners to possess given its positive impact on health outcomes and educational attainment. Concerningly, HL is an area that primary school teachers report having a lack of understanding, confidence, and ability to teach. The HealthLit4Kids initiative aimed to address this issue through a series of teacher professional development (PD) workshops. To evaluate how teachers experienced the PD, teacher evaluations collected at the completion of each of the workshops were analysed using a mixed methods approach. According to the teachers, the PD had improved their understanding of HL, including how to implement it into their practice. The study also found that the teachers perceived that collaborative practice was a key strength of the programme, and that at the end of the PD, teachers described valuing HL more in their practice. Teachers reported time as a major barrier to them implementing the professional learning and suggested further resources could help to mitigate this barrier. Additional research is required to help substantiate the claims made in this research. This study also highlights the critical need for additional HL resources for primary school teachers.

The Job Perception Inventory: considering human factors and needs in the design of human-AI work

Introduction

Artificial intelligence (AI) is seen as a driver of change, especially in the context of business, due to its progressive development and increasing connectivity in operational practice. Although it changes businesses and organizations vastly, the impact of AI implementation on human workers with their needs, skills, and job identity is less considered in the development and implementation process. Focusing on humans, however, enables unlocking synergies as well as desirable individual and organizational outcomes.

Methods

The objective of the present study is (a) to develop a survey-based inventory from the literature on work research and b) a first validation with employees encountering an AI application. The Job Perception Inventory (JOPI) functions as a work-analytical tool to support the human-centered implementation and application of intelligent technologies. It is composed of established and self-developed scales, measuring four sections of work characteristics, job identity, perception of the workplace, and the evaluation of the introduced AI.

Results

Overall, the results from the first study from a series of studies presented in this article indicate a coherent survey inventory with reliable scales that can now be used for AI implementation projects.

Discussion

Finally, the need and relevance of the JOPI are discussed against the background of the manufacturing industry.

Quality of Life After Bariatric and Body Contouring Surgery in the Australian Public Health System

INTRODUCTION

The goals of bariatric surgery are weight loss, improved management of obesity-related diseases, and enhanced health-related quality of life (HRQoL). The aim of this study is to determine HRQoL among postoperative bariatric surgery patients. The aim of this study was to evaluate the utility of bariatric surgery and the role of body contouring surgery (BCS) when considering quality of life in low-volume centres in the Australian public health system.

METHODS

This cohort study compared patients who underwent bariatric surgery between 2008 and 2018, to those awaiting surgery. An additional analysis was completed for patients who also underwent BCS. Patients completed the Short Form-36 quality of life (SF-36) survey. Linear regression was used to assess the differences in mean scores between cohorts for each of the SF-36 domains.

RESULTS

A total of 131 postoperative patients were identified, with a follow up rate of 68%. The mean follow up was 5.4 y. The mean scores for all domains of the SF-36 in the postoperative group were higher than the preoperative group (P ≤ 0.0001). A significant difference in scores persisted after controlling for patients' current BMI. When considering patients who underwent BCS (n = 24), there was a further global improvement in HRQoL in physical function (P = 0.0065), role limitation to physical health (P = 0.0026), pain (P = 0.0004), energy (P = 0.0023) and general health perceptions (P = 0.0023).

CONCLUSIONS

Bariatric surgery followed by BCS may improve HRQoL for the patient when compared to bariatric surgery alone. We advocate for the use of bariatric surgery followed by BCS in low-volume centres in the Australian public health system.

Idiopathic Hypersomnia: Neurobiology, Diagnosis, and Management

Idiopathic hypersomnia is a chronic neurologic sleep disorder that manifests as excessive daytime sleepiness despite normal or prolonged sleep times for age. Frequently, idiopathic hypersomnia is clinically characterized by marked sleep inertia, long and unrefreshing naps, and a high sleep efficiency. Since the initial description, there has been an ongoing evolution of its nomenclature, approach to diagnosis, characterization of symptoms, and determination of the burden of disease. In addition, an increased attention to and study of its epidemiology, neurobiology, and potential therapeutic strategies has begun to contribute to a better approach to identifying and treating it. At present, idiopathic hypersomnia is considered an orphan disease with unknown frequency and the cause is unknown; however, there is evidence to suggest circadian and sleep structure differences, structural brain changes, and neurochemical changes may contribute to the development and expression of this disease. The approach to treatment can be challenging owing to a limited number of approved treatments (calcium, magnesium, potassium, and sodium oxybates) in idiopathic hypersomnia. However, consideration of therapies shown to improve excessive daytime sleepiness in other disorders is frequently employed. Future directions require a clear consensus on the defining characteristics of idiopathic hypersomnia to enhance the opportunity for improved recognition, diagnosis, and treatment strategies to be established. This article provides a historical review of the evolving diagnostic classification of idiopathic hypersomnia, potential insights to the underlying pathophysiology, and a summary of proposed approaches for diagnosis and therapeutic intervention.

Perceived research burden of a novel therapeutic intervention: A study of transcranial magnetic stimulation for smoking cessation

Background

Translating repetitive transcranial magnetic stimulation (rTMS) into evidence-based clinical applications relies on research volunteers with different perspectives on the burden of study participation. Additionally, clinical applications of rTMS require multiple visits over weeks or months, the impact of research burden is an important component for these studies and translation of these findings to clinical practice. High frequency rTMS has significant potential to be developed as an evidence-based treatment for smoking cessation, however, the optimal rTMS dosing strategies have yet to be determined. Participant burden is an important component of determining optimal dosing strategy for rTMS as a treatment for long-term smoking cessation.

Methods

In this double-blinded, sham-controlled, randomized design, the effects of treatment duration, intensity, and active/sham assignment of rTMS on research burden were examined.

Results

Overall level of perceived research burden was low. Experienced burden (M = 26.50) was significantly lower than anticipated burden (M = 34.12). Research burden did not vary by race or income.

Conclusions

Overall research burden was relatively low. Contrary to our hypotheses, we found little evidence of added significant burden for increasing the duration or intensity of rTMS, and we found little evidence for differences in research burden by race or income.

Clinical Trial Registration

identifier NCT03865472.

Questionnaire-free machine-learning method to predict depressive symptoms among community-dwelling older adults

The 15-item Geriatric Depression Scale (GDS-15) is widely used to screen for depressive symptoms among older populations. This study aimed to develop and validate a questionnaire-free, machine-learning model as an alternative triage test for the GDS-15 among community-dwelling older adults. The best models were the random forest (RF) and deep-insight visible neural network by internal validation, but both performances were undifferentiated by external validation. The AUROC of the RF model was 0.619 (95% CI 0.610 to 0.627) for the external validation set with a non-local ethnic group. Our triage test can allow healthcare professionals to preliminarily screen for depressive symptoms in older adults without using a questionnaire. If the model shows positive results, then the GDS-15 can be used for follow-up measures. This preliminary screening will save a lot of time and energy for healthcare providers and older adults, especially those persons who are illiterate.

Prenatal stress assessment using heart rate variability and salivary cortisol: A machine learning-based approach

OBJECTIVE

To develop a machine learning algorithm utilizing heart rate variability (HRV) and salivary cortisol to detect the presence of acute stress among pregnant women that may be applied to future clinical research.

METHODS

ECG signals and salivary cortisol were analyzed from 29 pregnant women as part of a crossover study involving a standardized acute psychological stress exposure and a control non-stress condition. A filter-based features selection method was used to identify the importance of different features [heart rate (HR), time- and frequency-domain HRV parameters and salivary cortisol] for stress assessment and reduce the computational complexity. Five machine learning algorithms were implemented to assess the presence of stress with and without salivary cortisol values.

RESULTS

On graphical visualization, an obvious difference in heart rate (HR), HRV parameters and cortisol were evident among 17 participants between the two visits, which helped the stress assessment model to distinguish between stress and non-stress exposures with greater accuracy. Eight participants did not display a clear difference in HR and HRV parameters but displayed a large increase in cortisol following stress compared to the non-stress conditions. The remaining four participants did not demonstrate an obvious difference in any feature. Six out of nine features emerged from the feature selection method: cortisol, three time-domain HRV parameters, and two frequency-domain parameters. Cortisol was the strongest contributing feature, increasing the assessment accuracy by 10.3% on average across all five classifiers. The highest assessment accuracy achieved was 92.3%, and the highest average assessment accuracy was 76.5%.

CONCLUSION

Salivary cortisol contributed a significant increase in accuracy of the assessment model compared to using a range of HRV parameters alone. Our machine learning model demonstrates acceptable accuracy in detection of acute stress among pregnant women when combining salivary cortisol with HR and HRV parameters.

Reliability, Validity, and Responsiveness of the DEG, a Three-Item Dyspnea Measure

BACKGROUND

Dyspnea is a common and debilitating symptom that affects many different patient populations. Dyspnea measures should assess multiple domains.

OBJECTIVE

To evaluate the reliability, validity, and responsiveness of an ultra-brief, multi-dimensional dyspnea measure.

DESIGN

We adapted the DEG from the PEG, a valid 3-item pain measure, to assess average dyspnea intensity (D), interference with enjoyment of life (E), and dyspnea burden with general activity (G).

PARTICIPANTS

We used data from a multi-site randomized clinical trial among outpatients with heart failure.

MAIN MEASURES

We evaluated reliability (Cronbach's alpha), concurrent validity with the Memorial-Symptom-Assessment-Scale (MSAS) shortness-of-breath distress-orbothersome item and 7-item Generalized-Anxiety-Disorder (GAD-7) scale, knowngroups validity with New-York-Heart-Association-Functional-Classification (NYHA) 1-2 or 3-4 and presence or absence of comorbid chronic obstructive pulmonary disease (COPD), responsiveness with the MSAS item as an anchor, and calculated a minimal clinically important difference (MCID) using distribution methods.

KEY RESULTS

Among 312 participants, the DEG was reliable (Cronbach's alpha 0.92). The mean (standard deviation) DEG score was 5.26 (2.36) (range 0-10) points. DEG scores correlated strongly with the MSAS shortness of breath distress-or-bothersome item (r=0.66) and moderately with GAD-7 categories (ρ=0.36). DEG scores were statistically significantly lower among patients with NYHA 1-2 compared to 3-4 [mean difference (standard error): 1.22 (0.27) points, p<0.01], and those without compared to with comorbid COPD [0.87 (0.27) points, p<0.01]. The DEG was highly sensitive to change, with MCID of 0.59-1.34 points, or 11-25% change.

CONCLUSIONS

The novel, ultra-brief DEG measure is reliable, valid, and highly responsive. Future studies should evaluate the DEG's sensitivity to interventions, use anchor-based methods to triangulate MCID estimates, and determine its prognostic usefulness among patients with chronic cardiopulmonary and other diseases.

Minimum standards of clinical practice for physiotherapists working in adult intensive care units in Singapore

Background

Physiotherapists play a crucial role in rehabilitating critically ill patients in intensive care units (ICU). However, variations are found in clinical practice amongst physiotherapists working in the ICU, both locally and internationally, due to the lack of minimum clinical standards and varying knowledge on critical care rehabilitation resulting in inconsistent quality of care.

Purpose

To establish a framework of the minimum standards of clinical practice for physiotherapists working in ICU in Singapore and compare the standards with existing literature.

Methods

A three-round modified Delphi questionnaire survey technique collated responses from ICU physiotherapists. The questionnaire contained 222 items, categorised into assessments, conditions and treatments. Responses to the items were either: “Yes, it is essential”, “No, it is not essential”, or “I am not sure”. Consensus for an item was reached when 70% of participants ranked it essential or non-essential. Participants comprised registered physiotherapists who have worked in the ICU for at least six months in the last 12 months and are currently working in the ICU.

Results

23 physiotherapists (median ICU-experience 7.0 (4.3–9.8) years) gave consent and completed the initial survey. 13 completed all three rounds of questionnaires. Overall, 163 items were regarded as essential, 21 as non-essential, and 38 did not reach consensus. The identified 163 items varied from similar studies due to different scopes of physiotherapy practice and professional autonomy.

Conclusion

This framework may guide the content of the physiotherapy education curriculum on critical care rehabilitation and minimise variability in clinical practice across different healthcare institutions in Singapore.

Development and Validation of a Knowledge, Attitude and Practice Questionnaire on Antibiotic Use in Arabic and French Languages in Lebanon

Objectives: Validated knowledge–attitude–practice (KAP) questionnaires are essential to design and evaluate intervention programs on antibiotic use. Recently, we validated the first KAP questionnaire on antibiotics in Spain. Cross-cultural adaptation and validation of research tools increase their universal usefulness. Here, we aimed to validate the questionnaire in a developing country with different socioeconomic characteristics from that of Spain. Methods: We translated the previously developed KAP-questionnaire into Arabic and French, tailored it and then validated it in adult population in Lebanon. The item content validity index (I-CVI), scale content validity index (S-CVI/Ave) and modified Kappa (k*) were calculated. The construct validity of the questionnaire was evaluated using confirmatory factorial analysis (CFA, N = 1460) and its reliability was assessed using intraclass correlation coefficients (ICC, N = 100) and Cronbach’s alpha statistic. Results: ICV-I (>0.78), k* (equal to ICV-I for all items) and S-CVI/Ave (≥0.95) confirmed the questionnaire content validity. Pilot testing (N = 40) and face validity showed the understandability of the questionnaire by the population. Test–retest reliability analysis (N = 100) yielded ICC ≥ 0.59 for all knowledge and attitude items, showing the capacity of the questionnaire to generate reproducible results. CFA evidenced adequate fit of the chosen model, thus establishing the construct validity of the questionnaire (root mean squared error approximation = 0.053, standardized root mean square residual = 0.045, comparative fit index = 0.92 and Tucker–Lewis index = 0.90). The questionnaire showed an acceptable internal reliability (Cronbach’s alpha = 0.62) and was highly accepted in Lebanon (response rate = 96% and item response rates ≥ 94%). Conclusions: The validity of the KAP-questionnaire on antibiotics in Arabic and French was demonstrated in Lebanon.

Validation of the Arabic and French Versions of a Knowledge, Attitudes and Practices (KAP) Questionnaire on Tranquilizer Misuse

Tranquilizer misuse is an emerging international public health concern. The psychosocial determinants of this misuse remain understudied. Instruments to measure the Knowledge, Attitudes and Practices (KAP) of tranquilizer misuse are unavailable, except for a recently published questionnaire validated in the Spanish language. We translated the KAP questionnaire into Arabic and French, adapted it and undertook a complete validation procedure in the general adult population in Lebanon. The content validity indicators were good: item content validity index ranged between 0.89 and 1.00, the content validity index scale average was ≥0.95 and the modified Kappa statistic for each of the KAP items was equal to I-CVI. The intra-class correlation coefficient values (n = 100) were ≥0.62 for all Knowledge and Attitudes items, demonstrating the item reliability. Confirmatory factorial analysis (n = 1450) showed that the selected model of Knowledge and Attitude constructs has adequate fit indicators and encompassed three factors that showed acceptable internal reliability: Knowledge (Cronbach’s alpha = 0.72), personal Attitudes towards tranquilizers (Cronbach’s alpha = 0.79) and Attitudes towards healthcare providers (Cronbach’s alpha = 0.65). The Arabic/French questionnaire was highly accepted, with a response rate of 95.72% and item non-response rate ≤3.6%. The availability of a cross-cultural adapted and multilingual validated questionnaire would stimulate research on tranquilizer misuse.

Expert consensus on the minimum clinical standards of practice for Nigerian physiotherapists working in intensive care units: A modified Delphi study

BACKGROUND

Management of patients in intensive care units (ICUs) needs staff with a recommended level of expertise and experience owing to the life-threatening nature of illnesses, injuries and complications that these patients present with. There are no specific guidelines governing physiotherapy practice in ICUs in Nigeria. Hence, there is a need to have expert consensus on the minimum clinical standard of practice for physiotherapists working in ICUs as a first step to proposing/developing guidelines in the future.

OBJECTIVES

To assess the expert consensus on the minimum clinical standard of practice for physiotherapists working in ICUs in Nigeria.

METHODS

Physiotherapists with working experience in Nigerian ICUs were purposively recruited into the present study using a modified Delphi technique. A questionnaire comprising 222 question items on the role of physiotherapy in critical care was adopted and administered to the participants over three rounds of Delphi procedure (online). Participants checked either 'essential', 'not essential' or 'unsure' for each question item. For each question item to be considered 'essential' or 'not essential', a consensus agreement ≥70% had to be met. Questions without consensus were further modified by providing definition or clarification and presented in subsequent rounds. Data were analysed descriptively.

RESULTS

We recruited 26 expert physiotherapists who consented to the study and completed the first round of the study. The majority of the physiotherapists (n=24) remained in the study after the third round. A total of 178 question items were adjudged to be 'essential' after the first round, and a further 15 and three additional items were subsequently adjudged to be as 'essential' after modifying the outstanding question items during the second and third rounds, respectively. No consensus was reached for 24 items. None of the question items were ranked as 'not essential' after all the rounds.

CONCLUSION

Expert consensus was achieved for a substantial number of question items regarding knowledge and skills for assessment, condition and treatment items of the questionnaire by experienced critical care physiotherapists in Nigeria.

Translation and Examination of the Reliability and Validity of the Spanish Version of the Smoking Self-Efficacy Questionnaire Among Latino Smokers

The 12-item Smoking Self-Efficacy Questionnaire (SEQ-12) is a valid and reliable instrument to assess confidence in one’s ability to refrain from smoking in a variety of different situations. This study evaluated the psychometric properties of the Spanish version of the 12-item Smoking Self-Efficacy Questionnaire (SEQ-12) among a sample of Spanish-speaking Latino smokers engaged in a smoking cessation research study. A forward-backward translation procedure guided the translation of the SEQ-12 into Spanish. The Spanish version of the SEQ-12 showed promising internal consistency reliability and construct validity among Latino smokers, with potential applications in both research and clinical settings.

Development and validation of a knowledge, attitude and practice questionnaire of personal use of tranquilizers

BACKGROUND

Tranquilizer misuse is insufficiently acknowledged as a public health problem despite its alarming consequences. Instruments to measure psychosocial factors related to tranquilizer misuse are lacking. We aimed to develop and validate a Knowledge, Attitude and Practice questionnaire of tranquilizer misuse by adults in Spain.

METHODS

The questionnaire was designed after an extensive literature review and several meetings with experts. We assessed face and content validity, and pilot tested the questionnaire. We examined its reliability by test-retest analysis in a sample of 145 adults. We distributed the questionnaire to 879 individuals, tested the construct validity through Confirmatory Factor Analysis (CFA), measured its overall reliability and determined its acceptability.

RESULTS

The Item Content Validity Index (I-CVI from 0.78 to 1.00), the Scale Content Validity Index, using the averaging method (S-CVI/Ave = 0.95) and the fact that the modified Kappa statistic for each of the Knowledge, Attitude and Practice items was equal to I-CVI demonstrated the content validity of the questionnaire. The Intra-Class Correlation coefficients for Knowledge and Attitude items were > 0.5, establishing their reliability. The Knowledge and Attitude construct was modeled using CFA and the model showed a good fit, thus establishing its validity. The overall reliability of the construct was revealed by Cronbach՚s alpha values > 0.6. The questionnaire was highly accepted (response rate = 95 % and item non-response ≤ 4%).

CONCLUSIONS

The validity of the developed questionnaire was established. Its availability will stimulate the initiation of research on tranquilizer misuse and will consequently help in designing related public health interventions.

A Systematic Review of Discrete Choice Experiments and Conjoint Analysis on Genetic Testing

BACKGROUND

Although genetic testing has the potential to offer promising medical benefits, concerns regarding its potential negative impacts may influence its acceptance. Users and providers need to weigh the benefits, costs and potential harms before deciding whether to take up or recommend genetic testing. Attribute-based stated-preference methods, such as discrete choice experiment (DCE) or conjoint analysis, can help to quantify how individuals value different features of genetic testing.

OBJECTIVES

The aim of this paper was to conduct a systematic review of DCE and conjoint analysis studies on genetic testing, including genomic tests.

METHODS

A systematic search was conducted in seven databases: Web of Science, CINAHL Plus with Full Text (EBSCO), PsycINFO, PubMed, Embase, The Cochrane Library and SCOPUS. The search was conducted in February 2021 and was limited to English peer-reviewed articles published until the search date. The search keywords included relevant keywords such as 'genetic testing', 'genomic testing', 'pharmacogenetic testing', 'discrete choice experiment' and 'conjoint analysis'. Narrative synthesis of the studies was conducted on survey population, testing type, recruitment and data collection, survey development, questionnaire content, survey validity, analysis, outcomes and other design features.

RESULTS

Of the 292 articles retrieved, 38 full-text articles were included in this review. Nearly two-thirds of the studies were published since 2015 and all were conducted in high-income countries. Survey samples included patients, parents, general population and healthcare providers. The articles assessed preferences for pharmacogenetic testing (28.9%), predictive testing and diagnostic testing (18.4%), while only one (2.6%) study investigated preferences for carrier testing. The most common sampling method was convenience sampling (57.9%) and the majority recruited participants via web-enabled surveys (60.5%). Review of literature (84.6%), discussions with healthcare professionals (71.8%) and cognitive interviews (53.8%) were commonly used for attribute identification. A survey validity test was included in only one-quarter of the studies (28.2%). Cost attributes were the most studied attribute type (76.9%), followed by risk attributes (61.5%). Among those that reported relative attribute importance, attributes related to benefits were the most commonly reported attributes with the highest relative attribute importance. Preference heterogeneity was investigated in most studies by modelling, such as via mixed logit analysis (82.1%) and/or by using interaction effects with respondent characteristics (74.4%). Willingness to pay was the most commonly estimated outcome and was presented in about two-thirds (n = 25; 64.1%) of the studies.

CONCLUSION

With the continuous advancement in genetic technology resulting in expanding options for genetic testing and improvements in delivery methods, the application of genetic testing in clinical care is expected to rise. DCEs and conjoint analysis remain robust and useful methods to elicit preferences of potential stakeholders. This review serves as a summary for future researchers when designing similar studies.

COP and the Cloth: Quantitatively and Normatively Assessing Religious NGO Participation at the Conference of Parties to the United Nations Framework Convention on Climate Change

How much is religion quantitatively involved in global climate politics? After assessing the role of the Conference of Parties to the United Nations Framework Convention on Climate Change from a normative perspective, this descriptive, transdisciplinary and unconventional study offers the first comprehensive quantitative examination of religious nongovernmental organizations that formally participate in its annual meetings, the largest attempts to solve the climate crisis through global governance. This study finds that although their numbers are growing, only about 3 percent of registered nongovernmental organizations accredited to participate in the conference are overtly religious in nature—and that more than 80 percent of those faith-based groups are Christian. Additionally, this study finds that religious nongovernmental organizations that participate in the conference are mostly from the Global North. The results call for greater participation of religious institutions in the international climate negotiations in order for society to address the planetary emergency of climate change.

Determinants of Knowledge About Dietary Supplements Among Polish Internet Users: Nationwide Cross-sectional Study

Background

An accurate understanding of dietary supplements (DS) is a prerequisite for informed decisions regarding their intake. However, there is a need for studies on this understanding among the public based on validated research tools.

Objective

This study aims to assess the knowledge about DS among Polish internet users with no medical education and to identify its determinants and design an appropriate predictive model.

Methods

The study protocol was prospectively registered with a statistical analysis plan. Polish users of a web-based health service and a social networking service were administered a survey consisting of the recently developed questionnaire on knowledge about DS, the questionnaire on trust in advertising DS, the beliefs about medicines questionnaire, and several other health-related single-item measures and sociodemographic questions. The results were subjected to general linear modeling.

Results

A total of 6273 participants were included. Of the 17 yes or no questions in the questionnaire of knowledge about DS, the mean number of correct responses was 9.0 (95% CI 8.9-9.1). Health service users performed worse than social networking users by 2.3 points (95% CI 2.1-2.5) in an analysis adjusted for potential confounders. Internet users had fewer true beliefs about DS if they presented higher trust in their advertising (adjusted β=−.37; 95% CI −.39 to −.34), used DS (adjusted β=−.14; 95% CI −.17 to −.12), experienced their positive effect (adjusted β=−.16; 95% CI −.18 to −.13), were older or younger than 35 years (adjusted β=−.14; 95% CI −.17 to −.12), expressed interest in the topic of DS (adjusted β=−.10; 95% CI −.13 to −.08), reported getting information about the products from friends (adjusted β=−.13; 95% CI −.15 to −.11), and believed that medicines are harmful (adjusted β=−.12; 95% CI −.15 to −.10). The proposed 5-predictor model could explain 31.2% of the variance in knowledge about DS. The model appeared resistant to overfitting and was able to forecast most of the observed associations.

Conclusions

Polish internet users with no medical education exhibit some false beliefs regarding DS. Trusting the advertising of DS appears to conflict with knowledge about them. There is an urgent need for effective web-based educational campaigns on DS and the promotion of advertising literacy. After the proposed predictive model is externally validated, it may help identify the least informed target audience.

Stress and worry in the 2020 coronavirus pandemic: relationships to trust and compliance with preventive measures across 48 countries in the COVIDiSTRESS global survey

The COVIDiSTRESS global survey collects data on early human responses to the 2020 COVID-19 pandemic from 173 429 respondents in 48 countries. The open science study was co-designed by an international consortium of researchers to investigate how psychological responses differ across countries and cultures, and how this has impacted behaviour, coping and trust in government efforts to slow the spread of the virus. Starting in March 2020, COVIDiSTRESS leveraged the convenience of unpaid online recruitment to generate public data. The objective of the present analysis is to understand relationships between psychological responses in the early months of global coronavirus restrictions and help understand how different government measures succeed or fail in changing public behaviour. There were variations between and within countries. Although Western Europeans registered as more concerned over COVID-19, more stressed, and having slightly more trust in the governments' efforts, there was no clear geographical pattern in compliance with behavioural measures. Detailed plots illustrating between-countries differences are provided. Using both traditional and Bayesian analyses, we found that individuals who worried about getting sick worked harder to protect themselves and others. However, concern about the coronavirus itself did not account for all of the variances in experienced stress during the early months of COVID-19 restrictions. More alarmingly, such stress was associated with less compliance. Further, those most concerned over the coronavirus trusted in government measures primarily where policies were strict. While concern over a disease is a source of mental distress, other factors including strictness of protective measures, social support and personal lockdown conditions must also be taken into consideration to fully appreciate the psychological impact of COVID-19 and to understand why some people fail to follow behavioural guidelines intended to protect themselves and others from infection. The Stage 1 manuscript associated with this submission received in-principle acceptance (IPA) on 18 May 2020. Following IPA, the accepted Stage 1 version of the manuscript was preregistered on the Open Science Framework at https://osf.io/g2t3b. This preregistration was performed prior to data analysis.

Analysing the predictive capacity and dose-response of wellness in load monitoring

This study aimed to identify the predictive capacity of wellness questionnaires on measures of training load using machine learning methods. The distributions of, and dose-response between, wellness and other load measures were also examined, offering insights into response patterns. Data (n= 14,109) were collated from an athlete management systems platform (Catapult Sports, Melbourne, Australia) and were split across three sports (cricket, rugby league and football) with data analysis conducted in R (Version 3.4.3). Wellness (sleep quality, readiness to train, general muscular soreness, fatigue, stress, mood, recovery rating and motivation) as the dependent variable, and sRPE, sRPE-TL and markers of external load (total distance and m.min^-1) as independent variables were included for analysis. Classification and regression tree models showed high cross-validated error rates across all sports (i.e., > 0.89) and low model accuracy (i.e., < 5% of variance explained by each model) with similar results demonstrated using random forest models. These results suggest wellness items have limited predictive capacity in relation to internal and external load measures. This result was consistent despite varying statistical approaches (regression, classification and random forest models) and transformation of wellness scores. These findings indicate practitioners should exercise caution when interpreting and applying wellness responses.

Advancing European nutrition - are pharmacists eligible partners in the process?

BACKGROUND/OBJECTIVES

Pharmacists may play an important role in disease prevention through the public education about dietary and lifestyle behaviors, however their expertise is constantly ignored. The study primarily aimed to identify nutrition knowledge and dietary habits among Polish pharmacists.

SUBJECTS

A total sample screened consisted of 1412 respondents, yet 667 (573 females and 94 males) pharmacists finally participated in the study. A validated questionnaire for Polish population, the Dietary Habits and Nutrition Beliefs Questionnaire, was used for the evaluation.

RESULTS

The majority of pharmacists (94%) were current non-smokers with BMI levels below 25 kg/m² (66.5%). Female pharmacists had higher the Pro-Healthy (pHDI-10) score (p < 0.001) and lower the Non-Healthy (nHDI-14) score (p = 0.004) compared to the males. In the self-assessment of nutritional habits, the pHDI-10 was significantly higher in the "very good" group compared to the "poor" (p < 0.001) and the "very poor" (p = 0.015) group, and the "poor group" had higher nHDI-14 when compared to "very good" (p < 0.001) and "good" (p < 0.001) groups. The nutrition knowledge test score was above average in over 72% of respondents, was correlated with the pHDI-10 (r = 0.16), yet the score decreased with age (r = -0.19).

CONCLUSIONS

We believe that our analysis justifies the inevitability to benefit from pharmacists' expertise. Pharmacists with around-the-clock accessibility should be eligible partners, as members of an interdisciplinary team, in the process of advancing population-based nutrition.

Amalgam Phase-Down Part 2: UK-Based Knowledge, Opinions, and Confidence in the Alternatives

Introduction:

Amalgam use has recently been phased down, and the potential for a phase-out is being investigated.

Objectives:

The study aimed to identify knowledge of the phase-down and opinions of a potential phase-out of amalgam by UK primary care clinicians and assess their confidence in using different materials in different situations.

Methods:

An anonymized, prepiloted cross-sectional e-survey was used to assess primary care clinicians’ knowledge and opinions of the amalgam phase-down and potential phase-out and their confidence in using amalgam and the alternatives in different situations. In total, 11,902 invitations were distributed through British dentist and therapist associations. Prior hypotheses were tested alongside descriptive statistics.

Results:

Response rate was 13% (n = 1,513). Knowledge of the amalgam phase-down was low, with just 3% clinicians correctly identifying all patient groups in whom amalgam use should be avoided in the United Kingdom. Postgraduate education on posterior composite placement was high (88%), but a large majority had personal and patient-centered concerns over the suitability of the alternatives and lacked confidence when placing composite in comparison to amalgam in difficult situations (P < 0.0001). Logistic regressions revealed that the best predictors of high confidence in placing mesio-occluso-distal composites and composites in difficult situations were being a private general dentist or being primarily a composite user.

Conclusion:

Primary care clinicians have major personal and patient-centered concerns regarding the amalgam phase-down (of which they have limited knowledge) and potential phase-out. Many lack confidence in using the alternative, composite, to restore posterior teeth in difficult situations, whereas confidence in using amalgam in similar situations is high. Effective education of clinicians and understanding patients’ needs, alongside policy changes, are required to enable a successful amalgam phase-down and potential phase-out.

Knowledge Transfer Statement:

This study shows that UK primary care clinicians are worried about the phase-down of amalgam for themselves and their patients. Many lack confidence in the alternative, composite, when used in difficult situations, which is in stark contrast to amalgam. Knowledge of the phase-down is limited. There is a need for more effective education of clinicians, an understanding of patients’ values, and policy changes to ensure the success of the phase-down and potential phase-out of amalgam.

Validating the VR-12 Physical Function Instrument After Anterior Cervical Discectomy and Fusion with SF-12, PROMIS, and NDI

BACKGROUND

Development and validation of Veterans RAND 12-item (VR-12) physical component survey (PCS) has been established among civilian and veteran populations but it has not been examined among anterior cervical discectomy and fusion (ACDF) patients.

PURPOSES/QUESTIONS

We sought to validate legacy patient-reported outcome measures (PROMs) with VR-12 PCS among patients undergoing ACDF procedures.

METHODS

A prospectively collected surgical registry was retrospectively evaluated for elective single or multi-level ACDFs performed for degenerative spinal pathologies from January 2014 to August 2019. Exclusion criteria included missing pre-operative surveys and surgery for trauma, metastasis, or infection. Demographic variables, baseline pathologies, and peri-operative variables were collected. A paired t test evaluated the change from the pre-operative score to each post-operative timepoint for VR-12 PCS, the 12-item Short-Form Survey (SF-12) PCS, Patient-Reported Outcomes Measurement Information System physical function (PROMIS-PF), and Neck Disability Index (NDI). Minimal clinically important difference (MCID) achievement was calculated at each timepoint. Correlation was evaluated with a Pearson's correlation coefficient and time-independent partial correlation.

RESULTS

Of the 202 patients who underwent ACDF, 41.1% were female and the average age was 49.5 years. All PROMs had statistically significantly increased from baseline when compared with post-operative timepoints (12 weeks, 6 months, 1 year, and 2 years). MCID achievement rates increased through 2 years. All timepoints revealed strong VR-12 PCS correlations with SF-12 PCS, PROMIS-PF, and NDI scores.

CONCLUSION

VR-12 PCS was strongly correlated with the well-validated SF-12 PCS and NDI metrics as well as with the more recent PROMIS-PF. All PROMs demonstrated statistically significant improvement in patients post-operatively. VR-12 PCS is a valid measure of physical function among patients undergoing ACDF.

Design, reliability and construct validity of a Knowledge, Attitude and Practice questionnaire on personal use of antibiotics in Spain

Numerous questionnaires are available on Knowledge, Attitudes, and Practices (KAP) towards antibiotics' use by adults, but none of these questionnaires is fully validated. We undertook an exhaustive literature review to design a comprehensive KAP questionnaire concerning the personal use of antibiotics in Galicia, North Spain. The Item Content Validity Index (I-CVI) and modified Kappa statistic (K*), confirmed the content validity of the questions (0.78 ≤ I-CVI ≤ 1.00 and 0.78 ≤ K* ≤ 1.00). The S-CVI statistic showed the content validity of the scale (S-CVI/Ave: 0.95). Following face validity and pilot testing, the Test-Retest Reliability in a sample of 145 adults confirmed the reliability of the questions. We carried out Confirmatory Factor Analysis using cross loadings and modification indices to choose the most adequate model in data collected from 844 adults. We estimated the indicators of model fit and demonstrated that the selected model has a good to excellent fit, thus establishing the construct validity. The final version of the questionnaire was highly accepted by the general adult population as reflected by the response rate (95.85%) and the low percentage of unanswered questions (0.4-2.7%). Our fully validated questionnaire could prove useful for research as it permits generating high quality data and reducing measurement error.

An intergroup approach to collective narcissism: Intergroup threats and hostility in four European Union countries

Although it is known that collective narcissism is associated with problematic intergroup relations, its predictors are less well understood. Two studies, conducted in four European Union countries (Germany, Greece, Portugal, the United Kingdom [UK]), tested the hypotheses that integrated (i.e., realistic and symbolic) threat (Study 1, N = 936) as well as distinctiveness threat (Study 2, N = 434) positively predict national collective narcissism and national ingroup satisfaction, but that only national collective narcissism predicts problematic intergroup relations in reference to threatening outgroups. The results were consistent with those hypotheses. The two types of threat predicted increased national collective narcissism and national ingroup satisfaction. However, only national collective narcissism was associated with negative emotions and hostile behavioral intentions toward the threatening outgroups, when its overlap with national ingroup satisfaction was partialled out. These cross-national findings advanced knowledge of predictors, as well as consequences, of collective narcissism.

Respondent Understanding in Discrete Choice Experiments: A Scoping Review

Introduction

Despite the recognised importance of participant understanding for valid and reliable discrete choice experiment (DCE) results, there has been limited assessment of whether, and how, people understand DCEs, and how ‘understanding’ is conceptualised in DCEs applied to a health context.

Objectives

Our aim was to identify how participant understanding is conceptualised in the DCE literature in a health context. Our research questions addressed how participant understanding is defined, measured, and used.

Methods

Searches were conducted (June 2019) in the MEDLINE, EMBASE, PsychINFO and Econlit databases, as well as hand searching. Search terms were based on previous DCE systematic reviews, with additional understanding keywords used in a proximity-based search strategy. Eligible studies were peer-reviewed journal articles in the field of health, related to DCE or best-worst scaling type 3 (BWS3) studies, and reporting some consideration or assessment of participant understanding. A descriptive analytical approach was used to chart relevant data from each study, including publication year, country, clinical area, subject group, sample size, study design, numbers of attributes, levels and choice sets, definition of understanding, how understanding was tested, results of the understanding tests, and how the information about understanding was used. Each study was categorised based on how understanding was conceptualised and used within the study.

Results

Of 306 potentially eligible articles identified, 31 were excluded based on titles and abstracts, and 200 were excluded on full-text review, resulting in 75 included studies. Three categories of study were identified: applied DCEs (n = 52), pretesting studies (n = 7) and studies of understanding (n = 16). Typically, understanding was defined in relation to either the choice context, such as attribute terminology, or the concept of choosing. Very few studies considered respondents’ engagement as a component of understanding. Understanding was measured primarily through qualitative pretesting, rationality or validity tests included in the survey, and participant self-report, however reporting and use of the results of these methods was inconsistent.

Conclusions

Those conducting or using health DCEs should carefully select, justify, and report the measurement and potential impact of participant understanding in their specific choice context. There remains scope for research into the different components of participant understanding, particularly related to engagement, the impact of participant understanding on DCE validity and reliability, the best measures of understanding, and methods to maximise participant understanding.

Electronic supplementary material

The online version of this article (10.1007/s40271-020-00467-y) contains supplementary material, which is available to authorized users.

Voice Component Relationships with High Reflux Symptom Index Scores in Muscle Tension Dysphonia

OBJECTIVE

To analyze the Reflux Symptom Index (RSI) and the Voice-Related Quality of Life (V-RQOL) scores based on the perceptual and analytical parameters in primary MTD patients with no reflux.

STUDY DESIGN

Cross-sectional study.

METHODS

One hundred and eighteen participants, that is, sixty patients with normal voices and fifty-eight patients with primary MTD were recruited in this study. The diagnosis of primary MTD was made by perceptual voice analysis, neck palpation, video-laryngoscopic examination, and exclusion of other etiologies. Acoustic analysis and the GRBAS (Grade, Roughness, Breathiness, Asthenia, and Strain) scale were evaluated for all participants. The V-RQOL and RSI questionnaires were then given to all participants.

RESULTS

This study included 118 participants of 29 males (48.3%) and 31 females (51.7%) in the normal group. MTD group also included 27 males (46.6%) and 31 (53.4%) female patients. Mean (SD) RSI and V-RQOL scores were 12.35 (3.84) and 11.09 (2.20) for the normal group, and 22.87 (6.97) and 22.89 (7.94) for the MTD group (P = .000). In the MTD group, V-RQOL had a positive correlation with jitter for /i/ and /u/, Noise to Harmonic Ratio (NHR) for /i/, /a/, and /u/, and Grade, Roughness, and Strain of GRBAS scale (P < .05). In addition, RSI had a positive correlation with Strain in the MTD group (P < .05).

CONCLUSION

MTD patients in the absence of laryngopharyngeal reflux findings may have high RSI scores. Hence, patients with high RSI scores and disproportionate acoustic and perceptual analysis would require a thorough evaluation of MTD.

LEVEL OF EVIDENCE

4 Laryngoscope, 131:E1573-E1579, 2021.

Seven Challenges in Conceptualizing and Assessing Entrepreneurial Skills or Mindsets in Engineering Entrepreneurship Education

The growth of undergraduate entrepreneurship education programs and research, both within and outside of business programs, has led to a diverse array of academic literature on this topic. The diversity of perspectives has led to many conceptual and educational challenges that remain unresolved within the literature. The following conceptual paper offers a critical perspective on challenges that have been identified. A narrative-style literature review was conducted to explore challenges emerging from both (a) the practice of teaching entrepreneurship and (b) the definitions and assessment of entrepreneurial mindsets and skills that result from those education processes in entrepreneurship education, particularly within an undergraduate engineering education context. We achieve this objective by discussing previously dispersed sources of literature from disciplines that have critically discussed and explored entrepreneurial themes, such as business education, sociology, psychology, and philosophy. Contemporary debates within multiple disciplines are integrated and organized as challenges to inspire new theoretical discussions among scholars, educators, and other practitioners that can inform a more comprehensive way to conceive and assess entrepreneurship in engineering education. Seven challenges were identified ranging from the definition of entrepreneurship in education to the role of ethics in the teaching and assessment of entrepreneurship. We use these seven challenges and research questions as a starting point for the disambiguation of the working definition of entrepreneurship in the context of engineering education.

Measuring Outcomes in Psoriatic Arthritis: Comparing Routine Assessment of Patient Index Data and Psoriatic Arthritis Impact of Disease

OBJECTIVE

To examine the construct validity of Routine Assessment of Patient Index Data 3 (RAPID3) and Psoriatic Arthritis Impact of Disease (PsAID) in patients with psoriatic arthritis (PsA). In examining construct validity, we also addressed scores among subgroups with severe psoriasis, poly articular disease, enthesitis, and dactylitis, and evaluated influences of sociodemographic factors and comorbidities (contextual factors) on these patient-reported outcomes (PRO).

METHODS

Patients with PsA were enrolled in the Psoriatic Arthritis Research Consortium (PARC) between 2014 and 2016. PARC is a longitudinal observational cohort study conducted at 4 US institutions. In this cross-sectional study, construct validity was assessed by examining Spearman correlation coefficients for RAPID3 and PsAID with physician-reported disease activity measures and other PRO [e.g., Medical Outcomes Study Short Form-12 physical component summary/mental component summary (SF-12 PCS/MCS), Functional Assessment of Chronic Illness Therapy-Fatigue scale (FACIT-F)]. Contextual factors and disease subgroups were assessed in multivariable linear regression models with RAPID3 or PsAID12 as outcomes of interest and the hypothesized contextual factors as covariates.

RESULTS

Among 401 patients enrolled in PARC, 347 completed RAPID3 or PsAID12. Of these, most were white females with a mean age of 51.7 years (SD 14.02). RAPID3 and PsAID were highly correlated (r = 0.90). These measures were also correlated with the SF-12 PCS (r = -0.67) and FACIT-F (r = -0.77). Important contextual factors and disease subgroups included enthesitis, joint counts, education, insurance type, and depression.

CONCLUSION

RAPID3 and PsAID12 have excellent construct validity in PsA and are strongly correlated despite differing items. Contextual factors (i.e., the presence of depression and obesity) should be considered when interpreting raw scores of the RAPID3 and PsAID12.

A longitudinal study of the association between domestic contact with livestock and contamination of household point-of-use stored drinking water in rural Siaya County (Kenya)

Background

Emerging evidence suggests close domestic proximity of livestock and humans may lead to microbiological contamination of hands, objects, food and water supplies within domestic environments, adversely impacting public health. However, evidence quantifying the relationship between livestock, domestic animals, humans and microbiological contamination of household stored water remains limited.

Aim

This longitudinal study aimed to examine the relationship between domestic contact with livestock and domestic animals on microbiological contamination of household Point-of-Use (POU) stored drinking water in rural Kenya and assess the influence of choice of faecal indicator on such associations.

Methodology

A survey was performed in 234 households in Siaya county, Kenya, to observe presence of livestock (cattle, goats, poultry) and domestic animals (cats, dogs) in household compounds, alongside other risk factors for contamination of POU stored drinking water such as sanitation, storage conditions and hygiene practices. Samples from water sources (e.g. piped, spring/wells, boreholes, surface and rainwater) and from POU storage containers were tested for E. coli and intestinal enterococci. Livestock-related risk factors for water contamination were examined through multinomial regression, controlling for confounders.

Results

Rainwater was the main POU water source and was found to be highly susceptible to contamination. Multivariate analysis showed greater risk of gross (>100 CFU/100 mL) water contamination (with E. coli) for households where goats were observed, and/or where poultry roosted in proximity to stored household water (relative risk RR = 2.71; p = 0.001 and RR = 2.02; p = 0.012 respectively). Presence of a poultry coop was also associated with elevated intestinal enterococci densities (RR = 4.46; p = 0.001). Associations between contamination and livestock risk factors were thus similar for both bacteria groups, but E. coli counts declined more rapidly following collection from surface waters than enterococci counts (p = 0.024).

Conclusion

The presence of livestock (particularly goats) and poultry within household compounds increases POU water contamination risk, suggesting the need for improved interventions to address cross-contamination within rural domestic settings. Within Siaya county, more effective community education is needed to raise awareness of POU water quality protection, particularly of rainwater.

•

Poultry and goats are risk factors for household stored water contamination.

•

Poultry are risk factors for both enterococci and E. coli contamination.

•

Attenuation of enterococci in household stored water is lower than for E. coli.

•

Residual free chlorine is mostly too low to prevent stored water recontamination.

Objective stress monitoring based on wearable sensors in everyday settings

Monitoring people's stress levels has become an essential part of behavioural studies for physical and mental illnesses conducted within the biopsychosocial framework. There have been several stress assessment studies in laboratory-based controlled settings. However, the results of these studies do not always translate effectively to an everyday context. The current state of wearable sensor technology allows us to develop systems measuring the physiological signals reflecting stress 24/7 while capturing the context. In this paper, we present a stress monitoring system that provides objective daily stress measurements in everyday settings based on three physiological signals: electrocardiogram (ECG), photoplethysmogram (PPG), and galvanic skin response (GSR) using Shimmer3 ECG, Shimmer3 GSR+, and Empatica E4 wearable sensors. We perform controlled stress assessment experiments on 17 participants in which we successfully detect stress with a 94.55% accuracy for 10-fold cross-validation and an 85.71% accuracy for subject-wise cross-validation. In everyday settings, the system assesses stress with an 81.82% accuracy. We also examine whether motion artefacts affect stress assessment and filter the low-confidence readings to minimise false alarms.

Advances in the Functional Assessment of Patients with Sarcoma

Functional assessment of patients with osteosarcoma may yield unique insights into the guide and advance treatment. A range of patient-reported outcomes has been validated, including general health and condition-specific measures as well as computer adaptive testing. Health state utility measures, which facilitate comparative-effectiveness research, are also available. Beyond these surveys, and laboratory-dependent gait analyses, is the potential for real-world evaluation through research-oriented and consumer-oriented accelerometers. Initial studies have shown promising validity of these activity trackers and may also have implications for traditional oncologic outcomes.

Reducing Annotation Burden Through Multimodal Learning

Choosing an optimal data fusion technique is essential when performing machine learning with multimodal data. In this study, we examined deep learning-based multimodal fusion techniques for the combined classification of radiological images and associated text reports. In our analysis, we (1) compared the classification performance of three prototypical multimodal fusion techniques: Early, Late, and Model fusion, (2) assessed the performance of multimodal compared to unimodal learning; and finally (3) investigated the amount of labeled data needed by multimodal vs. unimodal models to yield comparable classification performance. Our experiments demonstrate the potential of multimodal fusion methods to yield competitive results using less training data (labeled data) than their unimodal counterparts. This was more pronounced using the Early and less so using the Model and Late fusion approaches. With increasing amount of training data, unimodal models achieved comparable results to multimodal models. Overall, our results suggest the potential of multimodal learning to decrease the need for labeled training data resulting in a lower annotation burden for domain experts.

A Machine Learning Approach to Classifying Self-Reported Health Status in a Cohort of Patients With Heart Disease Using Activity Tracker Data

Constructing statistical models using personal sensor data could allow for tracking health status over time, thereby enabling the possibility of early intervention. The goal of this study was to use machine learning algorithms to classify patient-reported outcomes (PROs) using activity tracker data in a cohort of patients with stable ischemic heart disease (SIHD). A population of 182 patients with SIHD were monitored over a period of 12 weeks. Each subject received a Fitbit Charge 2 device to record daily activity data, and each subject completed eight Patient-Reported Outcomes Measurement Information Systems short form at the end of each week as a self-assessment of their health status. Two models were built to classify PRO scores using activity tracker data. The first model treated each week independently, whereas the second used a hidden Markov model (HMM) to take advantage of correlations between successive weeks. Retrospective analysis compared the classification accuracy of the two models and the importance of each feature. In the independent model, a random forest classifier achieved a mean area under curve (AUC) of 0.76 for classifying the physical function PRO. The HMM model achieved significantly better AUCs for all PROs (p < 0.05) other than Fatigue and Sleep Disturbance, with a highest mean AUC of 0.79 for the physical function-short form 10a. Our study demonstrates the ability of activity tracker data to classify health status over time. These results suggest that patient outcomes can be monitored in real time using activity trackers.

How Are Debriefing Questions Used in Health Discrete Choice Experiments? An Online Survey

OBJECTIVES

Debriefing questions can assess if respondents understand discrete choice experiments (DCEs) and are answering in a way consistent with theories of decision making and utility maximization. Nevertheless, there is limited literature about how often debriefing questions are included or how the results are used in health economics. The aim of this study was to conduct a survey of the frequency, type, and analysis of debriefing questions in health DCEs.

METHODS

We conducted an online survey of authors of published health DCEs, asking about their use of debriefing questions, including frequency, type, and analysis. We descriptively analyzed the sample characteristics and responses. Free-text questions were analyzed with qualitative thematic analysis.

RESULTS

We received 70 responses (43% response rate), of which 50% reported using debriefing questions. They were most commonly designed to assess difficulty (91%), understanding (49%), and attribute nonattendance (31%) rather than learning effects (3%) or monotonicity (11%). On average, 37% of debriefing questions were analyzed (range, 0% to 69%), and the results were used <50% of the time, usually to exclude respondents or interpret overall results. Researcher experience or confidence with DCEs did not affect their use of debriefing questions.

CONCLUSIONS

These results suggest that although half of researchers conducting health DCEs use debriefing questions, many do not analyze, use, or report the responses. Given the additional respondent burden, there is a need for reliable and valid debriefing questions. In the meantime, the inclusion, analysis, and reporting of debriefing questions should be carefully considered before DCE implementation.

Communicating cardiovascular risk to high-risk cancer survivors: a mixed-methods pilot study of a statin risk communication tool

PURPOSE

Childhood, adolescent, and young adult cancer survivors treated with radiation therapy (RT) may be unaware of their high cardiovascular disease (CVD) risk or how to mitigate it. Tools are needed to improve understanding. We developed and pilot-tested a risk communication tool for shared decision-making with survivors regarding CVD risk reduction with statin therapy. We included quantitative and qualitative arms to further tool development and testing.

METHODS

The statin risk communication tool was adapted from a previously validated tool. Patients were at increased risk for CVD due to history of chest RT and recruited to usual care and intervention arms. The post-visit survey included Likert-like scales to explore acceptability of the tool, knowledge questions, and a decisional conflict scale. This pilot study used descriptive statistics and was not powered for significance. Semi-structured interviews with intervention arm participants explored shared decision-making processes.

RESULTS

Median participant (n = 46) age was 45. Most intervention patients (22/24, 92%) and 50% (11/22) of controls found statin information acceptable while 31% (7/22) of the control arm selected "not applicable" regarding information acceptability. Most participants were unaware of their personal CVD risk or potential statin side effects. In semi-structured interviews, participants found the tool is helpful to visualize risk and aid conversations.

CONCLUSIONS

The risk communication tool was acceptable. Qualitative data suggested the tool improved decisional clarity and comfort.

IMPLICATIONS FOR CANCER SURVIVORS

Poor knowledge of CVD and statins and poor recall of CVD risk conversation suggest a need to continue to optimize conversations regarding cardiovascular risk and statin therapy.

Barriers to vaccination service delivery within general practice: opportunity to make a sustainable difference in Aboriginal child health?

OBJECTIVE

To identify behavioural barriers of service provision within general practice that may be impacting the vaccination coverage rates of Aboriginal children in Perth, Western Australia (WA).

METHODS

A purposive developed survey was distributed to 316 general practices across Perth and three key informant interviews were conducted using a mixed-methods approach.

RESULTS

Of the surveyed participants (n=101), 67.4% were unaware of the low vaccination coverage in Aboriginal children; 64.8% had not received cultural sensitivity training in their workplace and 46.8% reported having inadequate time to follow up overdue child vaccinations. Opportunistic vaccination was not routinely performed by 30.8% of participants. Key themes identified in the interviews were awareness, inclusion and cultural safety.

CONCLUSION

Inadequate awareness of the current rates, in association with a lack of cultural safety training, follow-up and opportunistic practice, may be preventing greater vaccination uptake in Aboriginal children in Perth. Cultural safety is a critical component of the acceptability and accessibility of services; lack of awareness may restrict the development of strategies designed to equitably address low coverage.

IMPLICATIONS

The findings of this study provide an opportunity to raise awareness among clinicians in general practice and inform future strategies to equitably deliver targeted vaccination services to Aboriginal children.

The Case for the Use of Patient and Caregiver Perception of Change Assessments in Rare Disease Clinical Trials: A Methodologic Overview

INTRODUCTION

The traditional model of evaluating treatments based primarily on primary outcome measures has stumbled in its application to rare disease. Rare disease clinical trials face the methodological challenges of small, heterogeneous patient populations and relatively few validated, disease-specific outcome measures. Incorporating qualitative research into rare disease clinical trials may help sponsors, regulators, payers, and prescribers to better understand the real-world and patient-specific impact of a potential therapy. This paper provides a methodologic overview of the use of Patient and Caregiver Perception of Change (PPC and CPC) Assessments utilizing patient and caregiver video interviews to complement the data captured by traditional endpoints in rare disease clinical trials.

METHODS

Incorporating qualitative patient and caregiver video interviews into clinical trials allows for the rigorous capture of patient experiences and caregiver observations. Interview guides informed by input from key stakeholders provide the opportunity to solicit structured feedback on experiences before, during, and after the clinical trial. Patients and caregivers can complete their video interviews in a study mobile application, and interview transcripts are analyzed by independent coders. Themes are summarized by the treatment group and individual patient, which adds context to the clinical outcome measures of how patients feel and function, as well as elucidates the degree of change that is meaningful to patients and caregivers. The qualitative results can be compared to the data captured in clinical trials to assess data concordance.

CONCLUSION

Capturing patient experience data with sufficient rigor allows it to contribute to the body of evidence utilized in regulatory, payer, and prescriber decision-making. Adding PPC and CPC Assessments to rare disease clinical trials offers an innovative and powerful way to tap into the unique insights of patients and their families to develop a fuller picture of the patient experience in the clinical trial.

FUNDING

Stealth BioTherapeutics Inc.

An Evaluation of the Impact of High-Fidelity Endovascular Simulation on Surgeon Stress and Technical Performance

OBJECTIVE

To measure the physiological stress response associated with high-fidelity endovascular team simulation.

DESIGN

This is a prospective cohort study.

SETTING

This study was performed at St Mary's Hospital (Imperial College London, London, UK), in a tertiary setting.

PARTICIPANTS

Thirty-five participants (10 vascular surgical residents, 4 surgical interns, 12 theatre nurses, 2 attending vascular surgeons, 6 medical students and 1 technician) were recruited from the Imperial Vascular Unit at St Mary's Hospital, Imperial College London by direct approach. All participants finished the study.

RESULTS

Junior surgeons experienced significantly increased sympathetic tone (Low frequency/high frequency (LF/HF) ratio) during team simulation compared to individual simulation (6.01 ± 1.68 vs. 8.32 ± 2.84, p < 0.001). Within team simulation junior surgeons experienced significantly higher heart rate (beats per minute) than their senior counterparts (82 ± 5.83 vs. 76 ± 6.02, p = 0.033). Subjective workload scores (NASA Task Load Index [NASA-TLX]) correlated moderately and significantly with sympathetic tone in surgeons across all stages of simulation. (r = 0.39, p = 0.01).

CONCLUSIONS

A discrete, measurable increase in stress is experienced by surgeons during high-fidelity endovascular simulation and differentially effects junior surgeons. High-fidelity team simulation may have a role to play in improving nontechnical skill, reducing intra-operative stress, and reducing error.

Development of the Fatigue Risk Assessment and Management in High-Risk Environments (FRAME) Survey: A Participatory Approach

Existing risk assessment tools are not effective or sustainable in identifying Oil and Gas Extraction (OGE) workers at high risk of fatigue-related injuries or incidents. We developed a comprehensive Fatigue Risk Assessment and Management in high-risk Environments (FRAME) survey through an industry-academic participatory approach. The FRAME survey was developed through: (1) systematic gathering of existing fatigue scales; (2) refining the inventory using the Delphi Consensus technique; and (3) further refinement through employee/worker focus groups. The participatory approach resulted in a final FRAME survey across four fatigue dimensions-sleep, shiftwork, physical, and mental fatigue, and was composed of 26 items. The FRAME survey was founded on occupational fatigue science and refined and tailored to the OGE industry, through rigorous industry stakeholder input, for safer, effective, practical, and sustainable fatigue assessment and management efforts.

The Academic Anxiety Inventory: Evidence for Dissociable Patterns of Anxiety Related to Math and Other Sources of Academic Stress

Anxiety about mathematics can have detrimental effects on performance and understanding, yet little research has investigated how math anxiety is related to other types of anxiety. Here we develop the Academic Anxiety Inventory (AAI), an efficient and valid self-report measure designed to test math anxiety, as well as differentiate anxiety associated with mathematics from other contributions of anxiety across various academic domains. In Study 1, we isolated items that independently measure each domain of anxiety, reducing the overlapping variance between math anxiety and other constructs, and determining which components can or cannot be differentiated. Studies 2 and 3 demonstrate that the AAI is consistent and reliable for undergraduate and adolescent populations. In Study 3, anxiety-related performance deficits in a high school math class were associated with scores the AAI-Math subscale. In Study 4, the AAI-Math subscale was associated with perceptions of increased mathematical complexity, decreased estimations of accuracy, and increased negative emotion when participants viewed mathematical expressions. Across four studies, we demonstrate the AAI is a reliable and valid measure of math anxiety and other domains of academic anxiety, providing an efficient questionnaire to determine areas in which students may require extra support in order to reach their full potential.