Mixing mixed-mode designs in a national health interview survey: a pilot study to assess the impact on the self-administered questionnaire non-response

Lessons Learned From a Sequential Mixed-Mode Survey Design to Recruit and Collect Data From Case-Control Study Participants: Formative Evaluation

BACKGROUND

Sequential mixed-mode surveys using both web-based surveys and telephone interviews are increasingly being used in observational studies and have been shown to have many benefits; however, the application of this survey design has not been evaluated in the context of epidemiological case-control studies.

OBJECTIVE

In this paper, we discuss the challenges, benefits, and limitations of using a sequential mixed-mode survey design for a case-control study assessing risk factors during the COVID-19 pandemic.

METHODS

Colorado adults testing positive for SARS-CoV-2 were randomly selected and matched to those with a negative SARS-CoV-2 test result from March to April 2021. Participants were first contacted by SMS text message to complete a self-administered web-based survey asking about community exposures and behaviors. Those who did not respond were contacted for a telephone interview. We evaluated the representativeness of survey participants to sample populations and compared sociodemographic characteristics, participant responses, and time and resource requirements by survey mode using descriptive statistics and logistic regression models.

RESULTS

Of enrolled case and control participants, most were interviewed by telephone (308/537, 57.4% and 342/648, 52.8%, respectively), with overall enrollment more than doubling after interviewers called nonresponders. Participants identifying as female or White non-Hispanic, residing in urban areas, and not working outside the home were more likely to complete the web-based survey. Telephone participants were more likely than web-based participants to be aged 18-39 years or 60 years and older and reside in areas with lower levels of education, more linguistic isolation, lower income, and more people of color. While there were statistically significant sociodemographic differences noted between web-based and telephone case and control participants and their respective sample pools, participants were more similar to sample pools when web-based and telephone responses were combined. Web-based participants were less likely to report close contact with an individual with COVID-19 (odds ratio [OR] 0.70, 95% CI 0.53-0.94) but more likely to report community exposures, including visiting a grocery store or retail shop (OR 1.55, 95% CI 1.13-2.12), restaurant or cafe or coffee shop (OR 1.52, 95% CI 1.20-1.92), attending a gathering (OR 1.69, 95% CI 1.34-2.15), or sport or sporting event (OR 1.05, 95% CI 1.05-1.88). The web-based survey required an average of 0.03 (SD 0) person-hours per enrolled participant and US $920 in resources, whereas the telephone interview required an average of 5.11 person-hours per enrolled participant and US $70,000 in interviewer wages.

CONCLUSIONS

While we still encountered control recruitment challenges noted in other observational studies, the sequential mixed-mode design was an efficient method for recruiting a more representative group of participants for a case-control study with limited impact on data quality and should be considered during public health emergencies when timely and accurate exposure information is needed to inform control measures.

Organizing the health interview survey at the local level: design of a pilot study

Background

The local Health Interview Study (LHIS) was developed to gain health information at the level of the municipality in Flanders, the northern part of Belgium. It enables municipalities to make evidence-based decisions in their public health policy. To test the feasibility of implementing the LHIS, a pilot study was conducted in Melle, a small Flemish municipality with 11.736 inhabitants.

Methods

The target sample size was 1000 (≥ 15 years). A systematic sampling technique was applied with substitutes for non-respondents who were matched in terms of statistical sector, age and sex. Selected persons were contacted by post to complete the questionnaire and in case of non-response, a reminder was sent. Questionnaires were collected using a concurrent mixed-mode design: a paper and pencil, and web option. All questions were selected from the Belgian Health Interview Survey relating to health status and determinants of health.

Results

One thousand twenty-two questionnaires were obtained after inviting 3137 individuals (response rate = 32.6%). Older adults were more likely to participate than younger adults, and women more than men. The final sample resembled the initial sample in terms of sex and statistical sector, but not in terms of age. Younger adults were underrepresented whereas older adults were overrepresented. Lastly, older adults were more likely to fill in the questionnaire on paper than younger adults, and women more than men.

Conclusion

The LHIS can be successfully implemented in Flemish municipalities. The method, however, does not guarantee that the composition of the final sample reflects the initial sample. Therefore, weights should be added in the analyses to correct for potential deviations in sample composition. Furthermore, implementing a sequential mixed-mode design with a web option preceding a paper and pencil option in future studies could reduce costs and improve data quality.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13690-022-00909-z.

Anxiety and Depression in Belgium during the First 15 Months of the COVID-19 Pandemic: A Longitudinal Study

The COVID-19 pandemic and policy measures enacted to contain the spread of the coronavirus have had nationwide psychological effects. This study aimed to assess the impact of the first 15 months of the COVID-19 pandemic on the level of anxiety (GAD-7 scale) and depression (PHQ-9 scale) of the Belgian adult population. A longitudinal study was conducted from April 2020 to June 2021, with 1838 respondents participating in 6 online surveys. Linear mixed models were used to model the associations between the predictor variables and the mental health outcomes. Results showed that the prevalence of symptoms of anxiety and depression was higher in times of stricter policy measures. Furthermore, after the initial stress from the outbreak, coping and adjustment were observed in participants, as symptoms of anxiety and depression decreased during times of lower policy restrictions to almost the same level as in pre-COVID times (2018). Though time trends were similar for all population subgroups, higher levels of both anxiety and depression were generally found among women, young people, people with poor social support, extraverts, people having pre-existing psychological problems, and people who were infected/exposed to the COVID-19 virus. Therefore, investment in mental health treatment programs and supports, especially for those risk groups, is crucial.

Domestic violence during the COVID-19 confinement: do victims feel more socially isolated?

BACKGROUND

Since March 13th 2020, confinement measures have been introduced in Belgium to curb the spread of the coronavirus (COVID-19). These measures also have an impact on people's daily life (closure of school/businesses, teleworking, recommendation to stay at home). This can cause stress on social, economic and psychological levels and thereby can trigger domestic violence. Besides, confinement also fosters social isolation, which can complicate help seeking behaviour. The aim of this study is to determine the prevalence of domestic violence during the coronavirus crisis and to assess whether there is an association between domestic violence and social isolation.

METHODS

Several online COVID-19 Health Surveys were organised among Belgian residents aged 18+ via snowball sampling. This study is based on the second (April 2020) and the sixth survey (March 2021). After excluding 1-person households and missing data, the sample size was respectively 25,251 and 12,589. Weighted prevalence of domestic violence was evaluated for the two surveys. The association (OR; 95% CI; p-value) between domestic violence and subjective social isolation was assessed with logistic regression stratified by survey and adjusted for covariates.

RESULTS

In April 2020, 4.0% of the adult population reported being a victim of domestic violence (1.2% in the Health Interview Survey 2018); in March 2021, this was 6.2%. In April 2020, victims of domestic violence had higher odds of being unsatisfied with their social contacts (OR = 1.25; 95% CI: 1.08-1.44; p < .05), weak social support (OR = 2.26; 95% CI: 1.97-2.58; p < .0001) and having less confidence in health care services (OR = 1.38; 95% CI: 1.13-1.71; p < .05). In March 2021, victims had higher odds of being unsatisfied with their social contacts (OR = 1.30; 95% CI: 1.08-1.56; p < .05) and weak social support (OR = 2.41; 95% CI: 2.04-2.84; p < .0001), and social (OR = 2.64; 95% CI: 2.23-3.13; p < .0001) and emotional loneliness (OR = 2.22; 95% CI: 1.80-2.73; p < .0001).

CONCLUSIONS

More people have reported domestic violence since the start of the coronavirus crisis than did in 2018. An association between domestic violence and social isolation was determined. Although confinement is needed to counteract the virus, it can put people in a dangerous situation since they do not get the help they need. Therefore, adequate support is essential.

Short-term impact of the COVID-19 confinement measures on health behaviours and weight gain among adults in Belgium

BACKGROUND

In Belgium, confinement measures were introduced on the 13th of March 2020 to curb the spread of the coronavirus disease (COVID-19). These measures may affect health behaviours of the population such as eating habits, physical activity and alcohol consumption, which in turn can lead to weight gain resulting in overweight and obesity, increasing the risk of several chronic diseases, but also of severe COVID-19. The purpose of this study is to assess the impact of confinement measures on health behaviours and their associations with weight gain.

METHODS

Data were derived from the second national COVID-19 health survey. Data were collected between the 16th and the 23rd of April 2020. The recruitment of participants was based on snowball sampling via Sciensano's website, invitations via e-mail and social media. The study sample includes participants aged 18 years and over with no missing data on the variables of interest (n = 28,029). The association between self-reported weight gain and health behaviour changes, adjusted for gender, age group and household composition was assessed through OR's (95% CI) calculated with logistic regression models, using post-stratification weights.

RESULTS

Overall, 28.6% reported weight gain after 6 weeks of confinement. Higher odds of weight gain were observed among participants who increased or decreased their consumption of sugar-sweetened beverages (OR = 1.39 (1.15-1.68) and 1.29 (1.04-1.60), respectively), among those who increased their consumption of sweet or salty snacks (OR = 3.65 (3.27-4.07)), among those who became less physically active (OR = 1.91 (1.71-2.13)), and among those who increased their alcohol consumption (OR = 1.86 (1.66-2.08)).

CONCLUSIONS

The most important correlates of weight gain during confinement were an increased consumption of sweet or salty snacks and being less physically active. These findings confirm the impact of diet and exercise on short term weight gain and plead to take more action, in supporting people to achieve healthier behaviours in order to tackle overweight and obesity, especially during the COVID-19 pandemic.