Mixing modes in a population-based interview survey: comparison of a sequential and a concurrent mixed-mode design for public health research

Background

Population-based surveys currently face the problem of decreasing response rates. Mixed-mode designs are now being implemented more often to account for this, to improve sample composition and to reduce overall costs. This study examines whether a concurrent or sequential mixed-mode design achieves better results on a number of indicators of survey quality.

Methods

Data were obtained from a population-based health interview survey of adults in Germany that was conducted as a methodological pilot study as part of the German Health Update (GEDA). Participants were randomly allocated to one of two surveys; each of the surveys had a different design. In the concurrent mixed-mode design (n = 617) two types of self-administered questionnaires (SAQ-Web and SAQ-Paper) and computer-assisted telephone interviewing were offered simultaneously to the respondents along with the invitation to participate. In the sequential mixed-mode design (n = 561), SAQ-Web was initially provided, followed by SAQ-Paper, with an option for a telephone interview being sent out together with the reminders at a later date. Finally, this study compared the response rates, sample composition, health indicators, item non-response, the scope of fieldwork and the costs of both designs.

Results

No systematic differences were identified between the two mixed-mode designs in terms of response rates, the socio-demographic characteristics of the achieved samples, or the prevalence rates of the health indicators under study. The sequential design gained a higher rate of online respondents. Very few telephone interviews were conducted for either design. With regard to data quality, the sequential design (which had more online respondents) showed less item non-response. There were minor differences between the designs in terms of their costs. Postage and printing costs were lower in the concurrent design, but labour costs were lower in the sequential design. No differences in health indicators were found between the two designs. Modelling these results for higher response rates and larger net sample sizes indicated that the sequential design was more cost and time-effective.

Conclusions

This study contributes to the research available on implementing mixed-mode designs as part of public health surveys. Our findings show that SAQ-Paper and SAQ-Web questionnaires can be combined effectively. Sequential mixed-mode designs with higher rates of online respondents may be of greater benefit to studies with larger net sample sizes than concurrent mixed-mode designs.

Linking health survey data with health insurance data: methodology, challenges, opportunities and recommendations for public health research. An experience from the HISlink project in Belgium

In recent years, the linkage of survey data to health administrative data has increased. This offers new opportunities for research into the use of health services and public health. Building on the HISlink use case, the linkage of Belgian Health Interview Survey (BHIS) data and Belgian Compulsory Health Insurance (BCHI) data, this paper provides an overview of the practical implementation of linking data, the outcomes in terms of a linked dataset and of the studies conducted as well as the lessons learned and recommendations for future links.Individual BHIS 2013 and 2018 data was linked to BCHI data using the national register number. The overall linkage rate was 92.3% and 94.2% for HISlink 2013 and HISlink 2018, respectively. Linked BHIS-BCHI data were used in validation studies (e.g. self-reported breast cancer screening; chronic diseases, polypharmacy), in policy-driven research (e.g., mediation effect of health literacy in the relationship between socioeconomic status and health related outcomes, and in longitudinal study (e.g. identifying predictors of nursing home admission among older BHIS participants). The linkage of both data sources combines their strengths but does not overcome all weaknesses.The availability of a national register number was an asset for HISlink. Policy-makers and researchers must take initiatives to find a better balance between the right to privacy of respondents and society's right to evidence-based information to improve health. Researchers should be aware that the procedures necessary to implement a link may have an impact on the timeliness of their research. Although some aspects of HISlink are specific to the Belgian context, we believe that some lessons learned are useful in an international context, especially for other European Union member states that collect similar data.

Validity of self-reported air pollution annoyance to assess long-term exposure to air pollutants in Belgium

In epidemiological studies, assessment of long term exposure to air pollution is often estimated using air pollution measurements at fixed monitoring stations, and interpolated to the residence of survey participants through Geographical Information Systems (GIS). However, obtaining georeferenced address data from national registries requires a long and cumbersome administrative procedure, since this kind of personal data is protected by privacy regulations. This paper aims to assess whether information collected in health interview surveys, including air pollution annoyance, could be used to build prediction models for assessing individual long term exposure to air pollution, removing the need for data on personal residence address. Analyses were carried out based on data from the Belgian Health Interview Survey (BHIS) 2013 linked to GIS-modelled air pollution exposure at the residence place of participants older than 15 years (n = 9347). First, univariate linear regressions were performed to assess the relationship between air pollution annoyance and modelled exposure to each air pollutant. Secondly, a multivariable linear regression was performed for each air pollutant based on a set of variables selected with elastic net cross-validation, including variables related to environmental annoyance, socio-economic and health status of participants. Finally, the performance of the models to classify individuals in three levels of exposure was assessed by means of a confusion matrix. Our results suggest a limited validity of self-reported air pollution annoyance as a direct proxy for air pollution exposure and a weak contribution of environmental annoyance variables in prediction models. Models using variables related to the socio-economic status, region, urban level and environmental annoyance allow to predict individual air pollution exposure with a percentage of error ranging from 8% to 18%. Although these models do not provide very accurate predictions in terms of absolute exposure to air pollution, they do allow to classify individuals in groups of relative exposure levels, ranking participants from low over medium to high air pollution exposure. This model represents a rapid assessment tool to identify groups within the BHIS participants undergoing the highest levels of environmental stress.

Trends in adults' energy imbalance gaps over two decades in Belgium using system dynamics modelling

BACKGROUND

The energy imbalance gap (EIG) represents the average daily difference between energy intake and energy expenditure. The maintenance energy gap (MEG) captures the increased energy intake needed to maintain a higher average bodyweight compared with an initial distribution of bodyweight. This study quantified the dynamics of the EIG and MEG over time and across different genders/regions/BMI groups for Belgian adults.

METHODS

A validated system dynamics model was adapted to estimate the trends/dynamics of the EIG among different subpopulations over two decades in Belgium. The model was calibrated using data from the six Belgian national Health Interview Surveys (1997, 2001, 2004, 2008, 2013, 2018).

RESULTS

EIG was negative for all BMI groups among Belgian females in 2018, implying the start of a decrease in prevalence of overweight/obesity in this subpopulation. However, this was not the case among Belgian males. Flemish and Walloon males had positive EIGs across BMI groups in 2018, however, Brussels' males showed negative EIGs across BMI groups. Flemish and Brussels' females showed negative EIGs across all BMI groups in 2018, while Walloon females showed positive EIGs across almost all BMI groups. According to the MEG, Belgian men consumed (and expended) on average 59 kcal/day more in 2018 than in 1997 to maintain their heavier body weight. The MEG for Belgian women was 46 kcal/day in 2018, triple the MEG in 2004.

CONCLUSIONS

The detailed heterogeneous trends of the EIG describe the obesity patterns for different subpopulations in Belgium and could be used to model the differential effects of specific nutrition policies targeting energy intake.