Effect of Personalized Email-Based Reminders on Participants' Timeliness in an Online Education Program: Randomized Controlled Trial

BACKGROUND

Postsecondary students need to be able to handle self-regulated learning and manage schedules set by instructors. This is particularly the case with online courses, as they often come with a limited number of social reminders and less information directly from the teacher compared to courses with physical presence. This may increase procrastination and reduce timeliness of the students. Reminders may be a tool to improve the timeliness of students' study behavior, but previous research shows that the effect of reminders differs between types of reminders, whether the reminder is personalized or general, and depending on the background of the students. In the worst cases, reminders can even increase procrastination.

OBJECTIVE

The aim of this study was to test if personalized email reminders, as compared to general email reminders, affect the time to completion of scheduled online coursework. The personalized reminders included information on which page in the online material the participants ought to be on at the present point in time and the last page they were on during their last session. The general reminders only contained the first part of this information: where they ought to be at the present point in time.

METHODS

Weekly email reminders were sent to all participants enrolled in an online program, which included 39 professional learners from three East African countries. All participants in the Online Education for Leaders in Nutrition and Sustainability program, which uses a question-based learning methodology, were randomly assigned to either personalized or general reminders. The structure of the study was AB-BA, so that group A received personalized reminders for the first unit, then general reminders for the rest of the course, while group B started with general reminders and received personalized reminders only in the third (and last) unit in the course.

RESULTS

In total, 585 email reminders were distributed, of which 390 were general reminders and 195 were personalized. A Bayesian mixed-effects logistic regression was used to estimate the difference in the probability of being on time with one's studies. The probability of being on time was 14 percentage points (95% credible interval 3%-25%) higher following personalized reminders compared to that following general reminders. For a course with 100 participants, this means 14 more students would be on time.

CONCLUSIONS

Personalized reminders had a greater positive effect than general reminders for a group of adults working full-time while enrolled in our online educational program. Considering how small the intervention was-adding a few words with the page number the student ought to be on to a reminder-we consider this effect fairly substantial. This intervention could be repeated manually by anyone and in large courses with some basic programming.

A Web-Based Program About Sustainable Development Goals Focusing on Digital Learning, Digital Health Literacy, and Nutrition for Professional Development in Ethiopia and Rwanda: Development of a Pedagogical Method

Background

East African countries face significant societal challenges related to sustainable development goals but have limited resources to address these problems, including a shortage of nutrition experts and health care workers, limited access to physical and digital infrastructure, and a shortage of advanced educational programs and continuing professional development.

Objective

This study aimed to develop a web-based program for sustainable development with a focus on digital learning, digital health literacy, and child nutrition, targeting government officials and decision-makers at nongovernmental organizations (NGOs) in Ethiopia and Rwanda.

Methods

A web-based program—OneLearns (Online Education for Leaders in Nutrition and Sustainability)—uses a question-based learning methodology. This is a research-based pedagogical method developed within the open learning initiative at Carnegie Mellon University, United States. Participants were recruited during the fall of 2020 from ministries of health, education, and agriculture and NGOs that have public health, nutrition, and education in their missions. The program was conducted during the spring of 2021.

Results

Of the 70 applicants, 25 (36%) were selected and remained active throughout the entire program and filled out a pre- and postassessment questionnaire. After the program, of the 25 applicants, 20 (80%, 95% CI 64%-96%) participants reported that their capacity to drive change related to the sustainable development goals as well as child nutrition in their organizations had increased to large extent or to a very large extent. Furthermore, 17 (68%, 95% CI 50%-86%) and 18 (72%, 95% CI 54%-90%) participants reported that their capacity to drive change related to digital health literacy and digital learning had increased to a large extent and to a very large extent, respectively.

Conclusions

Digital learning based on a question-based learning methodology was perceived as a useful method for increasing the capacity to drive change regarding sustainable development among government officials and decision-makers at NGOs in Ethiopia and Rwanda.

Diet-related greenhouse gas emissions assessed by a food frequency questionnaire and validated using 7-day weighed food records

BACKGROUND

The current food system generates about 25 % of total greenhouse gas emissions (GHGE), including deforestation, and thereby substantially contributes to the warming of the earth's surface. To understand the association between food and nutrient intake and GHGE, we therefore need valid methods to assess diet-related GHGE in observational studies.

METHODS

Life cycle assessment (LCA) studies assess the environmental impact of different food items. We linked LCA data expressed as kg carbon dioxide equivalents (CO2e) per kg food product to data on food intake assessed by the food frequency questionnaire (FFQ) Meal-Q and validated it against a 7-day weighed food record (WFR). 166 male and female volunteers aged 20-63 years completed Meal-Q and the WFR, and their food intake was linked to LCA data.

RESULTS

The mean GHGE assessed with Meal-Q was 3.76 kg CO2e per day and person, whereas it was 5.04 kg CO2e using the WFR. The energy-adjusted and deattenuated Pearson and Spearman correlation coefficients were 0.68 and 0.70, respectively. Moreover, compared to the WFR, Meal-Q provided a good ranking ability, with 90 % of the participants classified into the same or adjacent quartile according to their daily average CO2e. The Bland-Altman plot showed an acceptable level of agreement between the two methods and the reproducibility of Meal-Q was high.

CONCLUSIONS

This is the first study validating the assessment of diet-related GHGE by a questionnaire. The results suggest that Meal-Q is a useful tool for studying the link between food habits and CO2e in future epidemiological studies.

A new mobile phone-based tool for assessing energy and certain food intakes in young children: a validation study

Background

Childhood obesity is an increasing health problem globally. Obesity may be established already at pre-school age. Further research in this area requires accurate and easy-to-use methods for assessing the intake of energy and foods. Traditional methods have limited accuracy, and place large demands on the study participants and researchers. Mobile phones offer possibilities for methodological advancements in this area since they are readily available, enable instant digitalization of collected data, and also contain a camera to photograph pre- and post-meal food items. We have recently developed a new tool for assessing energy and food intake in children using mobile phones called the Tool for Energy Balance in Children (TECH).

Objective

The main aims of our study are to (1) compare energy intake by means of TECH with total energy expenditure (TEE) measured using a criterion method, the doubly labeled water (DLW) method, and (2) to compare intakes of fruits and berries, vegetables, juice, and sweetened beverages assessed by means of TECH with intakes obtained using a Web-based food frequency questionnaire (KidMeal-Q) in 3 year olds.

Methods

In this study, 30 Swedish 3 year olds were included. Energy intake using TECH was compared to TEE measured using the DLW method. Intakes of vegetables, fruits and berries, juice, as well as sweetened beverages were assessed using TECH and compared to the corresponding intakes assessed using KidMeal-Q. Wilcoxon matched pairs test, Spearman rank order correlations, and the Bland-Altman procedure were applied.

Results

The mean energy intake, assessed by TECH, was 5400 kJ/24h (SD 1500). This value was not significantly different (P=.23) from TEE (5070 kJ/24h, SD 600). However, the limits of agreement (2 standard deviations) in the Bland-Altman plot for energy intake estimated using TECH compared to TEE were wide (2990 kJ/24h), and TECH overestimated high and underestimated low energy intakes. The Bland-Altman plots for foods showed similar patterns. The mean intakes of vegetables, fruits and berries, juice, and sweetened beverages estimated using TECH were not significantly different from the corresponding intakes estimated using KidMeal-Q. Moderate but statistically significant correlations (ρ=.42-.46, P=.01-.02) between TECH and KidMeal-Q were observed for intakes of vegetables, fruits and berries, and juice, but not for sweetened beverages.

Conclusion

We found that one day of recordings using TECH was not able to accurately estimate intakes of energy or certain foods in 3 year old children.

Relative validity of micronutrient and fiber intake assessed with two new interactive meal- and Web-based food frequency questionnaires

BACKGROUND

The meal- and Web-based food frequency questionnaires, Meal-Q and MiniMeal-Q, were developed for cost-efficient assessment of dietary intake in epidemiological studies.

OBJECTIVE

The objective of this study was to evaluate the relative validity of micronutrient and fiber intake assessed with Meal-Q and MiniMeal-Q. The reproducibility of Meal-Q was also evaluated.

METHODS

A total of 163 volunteer men and women aged between 20 and 63 years were recruited from Stockholm County, Sweden. Assessment of micronutrient and fiber intake with the 174-item Meal-Q was compared to a Web-based 7-day weighed food record (WFR). Two administered Meal-Q questionnaires were compared for reproducibility. The 126-item MiniMeal-Q, developed after the validation study, was evaluated in a simulated validation by using truncated Meal-Q data.

RESULTS

The study population consisted of approximately 80% women (129/163) with a mean age of 33 years (SD 12) who were highly educated (130/163, 80% with >12 years of education) on average. Cross-classification of quartiles with the WFR placed 69% to 90% in the same/adjacent quartile for Meal-Q and 67% to 89% for MiniMeal-Q. Bland-Altman plots with the WFR and the questionnaires showed large variances and a trend of increasing underestimation with increasing intakes. Deattenuated and energy-adjusted Spearman rank correlations between the questionnaires and the WFR were in the range ρ=.25-.69, excluding sodium that was not statistically significant. Cross-classifications of quartiles of the 2 Meal-Q administrations placed 86% to 97% in the same/adjacent quartile. Intraclass correlation coefficients for energy-adjusted intakes were in the range of .50-.76.

CONCLUSIONS

With the exception of sodium, this validation study demonstrates Meal-Q and MiniMeal-Q to be useful methods for ranking micronutrient and fiber intake in epidemiological studies with Web-based data collection.

Two new meal- and web-based interactive food frequency questionnaires: validation of energy and macronutrient intake

BACKGROUND

Meal-Q and its shorter version, MiniMeal-Q, are 2 new Web-based food frequency questionnaires. Their meal-based and interactive format was designed to promote ease of use and to minimize answering time, desirable improvements in large epidemiological studies.

OBJECTIVE

We evaluated the validity of energy and macronutrient intake assessed with Meal-Q and MiniMeal-Q as well as the reproducibility of Meal-Q.

METHODS

Healthy volunteers aged 20-63 years recruited from Stockholm County filled out the 174-item Meal-Q. The questionnaire was compared to 7-day weighed food records (WFR; n=163), for energy and macronutrient intake, and to doubly labeled water (DLW; n=39), for total energy expenditure. In addition, the 126-item MiniMeal-Q was evaluated in a simulated validation using truncated Meal-Q data. We also assessed the answering time and ease of use of both questionnaires.

RESULTS

Bland-Altman plots showed a varying bias within the intake range for all validity comparisons. Cross-classification of quartiles placed 70%-86% in the same/adjacent quartile with WFR and 77% with DLW. Deattenuated and energy-adjusted Pearson correlation coefficients with the WFR ranged from r=0.33-0.74 for macronutrients and was r=0.18 for energy. Correlations with DLW were r=0.42 for Meal-Q and r=0.38 for MiniMeal-Q. Intraclass correlations for Meal-Q ranged from r=0.57-0.90. Median answering time was 17 minutes for Meal-Q and 7 minutes for MiniMeal-Q, and participants rated both questionnaires as easy to use.

CONCLUSIONS

Meal-Q and MiniMeal-Q are easy to use and have short answering times. The ranking agreement is good for most of the nutrients for both questionnaires and Meal-Q shows fair reproducibility.

Dietary intake and supplement use of vitamins C and E and upper respiratory tract infection

OBJECTIVE

Antioxidants are regulators of immune function and may play a role in upper respiratory tract infections (URTI). We investigated the potential effects of dietary intake from food and supplement use of vitamins C and E on the risk of self-reported URTI.

METHODS

We conducted a population-based cohort study of 1509 Swedish men and women ages 20 to 60 with a follow-up period of 4 months. Participants reported a total of 1181 occurrences of URTI. Poisson regression model was used to control for age, sex, and other confounding factors.

RESULTS

Among women, we found that the incidence rate ratio (IRR) for high intake of vitamin C (>200 mg/d) from food was 0.69 (95% CI 0.49-0.98) compared with low intake (<100 mg/d). This association was not seen among men, for whom the IRR was 1.16 (95% CI 0.79-1.70) for high intake of vitamin C (>150 mg/d) compared with low intake (<50 mg/d). We saw no protective effect of vitamin E from food among either men or women, but a possible protective effect of vitamin C and E supplement use among men (vitamin C, 0.69 [95% CI 0.47-1.02]; vitamin E, 0.56 [95% CI 0.33-0.95]), although not among women.

CONCLUSION

The present study is the first observational study to suggest that intake of vitamin C from food is sufficient to lower the risk of URTI among women. In addition, it appears that supplement use of vitamin E and vitamin C may reduce the risk of URTI among men, who overall had a lower intake of vitamin C from food than women.

Physical activity, stress, and self-reported upper respiratory tract infection

PURPOSE

upper respiratory tract infection (URTI) is the most common reason for seeking primary care in many countries. Still, little is known about potential strategies to reduce susceptibility. We investigated the relationships between physical activity level, perceived stress, and incidence of self-reported URTI.

METHODS

we conducted a population-based prospective cohort study of 1509 Swedish men and women aged 20-60 yr with a follow-up period of 4 months. We used a Web-based questionnaire to assess disease status and lifestyle factors at the start of the study. We assessed physical activity and inactivity as total MET-hours (MET task) per day and perceived stress by the 14-item Perceived Stress Scale. Participants were contacted every 3 wk via e-mail to assess incidence of URTI. They reported a total of 1181 occurrences of URTI. We used Poisson regression models to control for age, sex, and other potential confounding factors.

RESULTS

we found that high levels of physical activity (≥ 55 MET·h·d) were associated with an 18% reduced risk (incidence rate ratio (IRR) = 0.82, 95% confidence interval (CI) = 0.69-0.98) of self-reporting URTI compared with low levels of physical activity (<45 MET·h·d). This association was stronger among those reporting high levels of stress (IRR = 0.58, 95% CI = 0.43-0.78), especially among men (IRR = 0.37, 95% CI = 0.24-0.59), but absent in the group with low levels of stress.

CONCLUSIONS

we found that high physical activity was associated with a lower risk of contracting URTI for both men and women. In addition, we found that highly stressed people, particularly men, appear to benefit more from physical activity than those with lower stress levels.

Validity and reliability of self-reported total energy expenditure using a novel instrument

Improved methods for quantitative self-reports of total physical activity in epidemiological studies are needed. We evaluated randomly selected individuals' ability to integrate their perception of physical activity over time to produce an estimate of the "usual" level, using a novel instrument for self-quantification of energy expenditure. A population-based sample of 418 Swedish men and women, age 20-59, completed a questionnaire containing the new instrument. For validation, three 24 hour recalls by phone served as gold standard. Reproducibility was assessed through administering the instrument another three times. The validation involved 133 subjects and another 160 completed the reproducibility evaluation. Pearson correlation between usual daily energy expenditure measured by the instrument and the mean of the 24 hour recalls was 0.73. After subdividing the self-reported daily energy expenditure and the mean of the 24 hour recalls into quintiles, 83.5% of the participants remained in the same quintile, or one quintile apart. There was a tendency towards overestimation of usual daily physical activity. This was significantly associated with low education. Reproducibility showed an intraclass correlation of 0.55. Although integrated reports of usual daily energy expenditure over longer periods seem to be afflicted with a tendency of overestimation, total energy expenditure can be estimated with reasonable validity and reproducibility using our instrument.

Web-based and mailed questionnaires: a comparison of response rates and compliance

BACKGROUND

We assessed response rates and compliance for a printed questionnaire and a Web questionnaire in a Swedish population-based study and explored the influence of adding personalized feedback to the Web questionnaire.

METHODS

We assigned 875 subjects to 1 of 3 groups: printed questionnaire, plain Web questionnaire, or Web questionnaire with personalized feedback. The questionnaire had 2 parts, first a general section and then a dietary section.

RESULTS

The response rate for the general section was 64% for the printed questionnaire, compared with 50% for the Web questionnaire with feedback. For the dietary questionnaire, the rates were reversed, resulting in a total response rate for the dietary questionnaire that did not differ between printed and web questionnaire with feedback.

CONCLUSIONS

Interactivity in the Web questionnaire increased compliance in completion of the second section of the questionnaire. Web questionnaires can be useful for research purposes in settings in which Internet access is high.

Demands on web survey tools for epidemiological research

In countries where the Internet access is high, a web-based questionnaire could save time and money compared to printed questionnaires, mainly by eliminating the two steps of transferring answers from printed to a digital data set and manually completing missing and impossible answers. However, many of the features wanted for conducting large epidemiological studies are not available in many web survey systems. Here we describe design issues the investigator needs to be aware of when using web-based questionnaires in epidemiological research.