Boosting for insight and/or boosting for agency? How to maximize accurate test interpretation with natural frequencies

BACKGROUND

Many physicians do not know how to accurately interpret test results using Bayes' rule. As a remedy, two kinds of interventions have been shown effective: boosting insight and boosting agency with natural frequencies. To boost insight, test statistics are provided in natural frequencies (rather than conditional probabilities), without instructions on how to use them. To boost agency, a training is provided on how to translate probabilities into natural frequencies and apply them in Bayes' rule. What has not been shown is whether boosting agency is sufficient or if representing test statistics in natural frequencies may additionally boost insight to maximize accurate test interpretation.

METHODS

We used a pre/posttest design to assess test interpretation accuracy of 577 medical students before and after a training on two Bayesian reasoning tasks, one providing conditional probabilities, the other natural frequencies. The pretest assessed baseline abilities versus the effect of natural frequencies to boost insight. After participants received a training on how to translate conditional probabilities into natural frequencies and how to apply them in Bayes' rule, test interpretation skills were assessed using the same tasks again, comparing the effects of training-induced agency with versus without additionally boosting insight (i.e., test statistics in natural frequencies versus conditional probabilities).

RESULTS

Compared to the test question formatted in conditional probabilities (34% correct answers), natural frequencies facilitated Bayesian reasoning without training (68%), that is, they increased insight. The training on how to use natural frequencies improved performance for tasks formatted in conditional probabilities (64%). Performance was maximal after training and with test statistics formatted in natural frequencies, that is, with a combination of boosting insight and agency (89%).

CONCLUSIONS

Natural frequencies should be used to boost insight and agency to maximize effective use of teaching resources. Thus, mandating that test statistics are provided in natural frequencies and adopting short trainings on how to translate conditional probabilities into natural frequencies and how to apply them in Bayes' rule will help to maximize accurate test interpretation.

TRIAL REGISTRATION

The study was a registered with the German Clinical Trial Registry ( DRKS00008723 ; 06/03/2015).

Testing the impact of overt and covert ordering interventions on sustainable consumption choices: A randomised controlled trial

Food products have significant impacts on the environment over their life cycle. We investigated whether displaying products in ascending order of carbon footprint in an online supermarket environment can shift consumer choices towards more sustainable options. We examined whether the effect of the ordering intervention differs when the ordering is overt (information about the ordering is explicit), compared to when it is covert (participants not told about the ordering). We conducted a three-arm parallel-group randomised trial using 1842 online participants from England, Wales, and Northern Ireland. Participants shopped for a meal, choosing one product from each of six product categories in a simulated online supermarket. Six products were listed vertically on each product-category page. Products were randomly ordered for the control arm but ordered by carbon footprint in the covert and overt ordering arms. In the overt ordering arm, a statement was displayed at the top of each product page about the ordering of products. The primary outcome was whether one of the three most sustainable products was chosen in each product category. There was no effect of the covert ordering on the probability of choosing more sustainable products compared with the control arm (OR = 0.97, 95% CI 0.88-1.07, p = 0.533). Furthermore, we did not find evidence that the effects of the covert ordering and overt ordering differed (p = 0.594). Within the control condition, products in different positions were chosen with similar frequencies, suggesting that product positioning does not have an impact on choices. This may explain why re-ordering products had no effect. In the overt condition, only 19.5% of people correctly answered that the products were ordered according to sustainability in a follow-up question, suggesting that they didn't notice the statement. Results suggest that choices for grocery products might be too ingrained to be changed by subtle rearrangements of choice architecture like the ordering interventions, and highlight the difficulty of conveying information effectively to consumers in the online grocery shopping environment.

The effects of default nudges on promoting approval of welfare cuts: An exploration during COVID-19

The global COVID-19 pandemic has created significant financial and operational challenges for some businesses. As a result, temporary welfare benefit reduction may be a tough but future-oriented choice for both employers and employees. The present study examined whether default nudges can be used to promote employees' approval of welfare-cutting policy while avoiding negative attitudes. Two online surveys were conducted during the first pandemic wave in China (February 2020). In the first study (N = 310), the participants were presented with a hypothetical welfare-cutting policy that used either an opt-in approach or an opt-out approach. We aimed to investigate how their approval and attitudes were different between two conditions. The results showed that the employees in the opt-out condition were more likely to accept the welfare-cutting policy than those in the opt-in condition, while participants' attitudes toward the policy employing opt-out approach were as negative as that employing opt-in approach. Study 2 (N = 1,519) involved a replication of Study 1 with two additional improved opt-out approaches (opt-out education and opt-out transparency). Compared with the opt-in approach and standard opt-out approach, the opt-out education approach both increased policy support and improved attitudes toward the welfare-cutting policy. The theoretical and practical implications of these findings are discussed.

Transparent by choice: Proactive disclosures increase compliance with digital defaults

Default nudges successfully guide choices across multiple domains. Online use cases for defaults range from promoting sustainable purchases to inducing acceptance of behavior tracking scripts, or “cookies.” However, many scholars view defaults as unethical due to the covert ways in which they influence behavior. Hence, opt-outs and other digital decision aids are progressively being regulated in an attempt to make them more transparent. The current practice of transparency boils down to saturating the decision environment with convoluted legal information. This approach might be informed by researchers, who hypothesized that nudges could become less effective once they are clearly laid out: People can retaliate against influence attempts if they are aware of them. A recent line of research has shown that such concerns are unfounded when the default-setters proactively discloses the purpose of the intervention. Yet, it remained unclear whether the effect persists when defaults reflect the current practice of such mandated transparency boils down to the inclusion of information disclosures, containing convoluted legal information. In two empirical studies (N = 364), respondents clearly differentiated proactive from mandated transparency. Moreover, they choose the default option significantly more often when the transparency disclosure was voluntary, rather than mandated. Policy implications and future research directions are discussed.

The Effects of Nudges: One-Shot Only? Exploring the Temporal Spillover Effects of a Default Nudge

Nudges, such as defaults, are generally found to be effective in guiding immediate behavioural decisions. However, little is known about whether the effect of a nudge can be lasting, meaning that it spills over to subsequent similar choices without the presence of a nudge. In three experiments, we explored the temporal spillover effects of a default nudge. The results of Experiments 1 (N = 1,077) and 2 (N = 1,036) suggest that nudging participants into completing a longer questionnaire affected their decision for the same behaviour a day later without the presence of a nudge. However, nudging participants into a healthier food choice in Experiment 3 (N = 969) did not result in such a temporal spillover effect. The results indicated that participants' change in attitude towards the nudged behaviour may partly explain the temporal spillover effects. These findings suggest that for some, but not all behaviours, default nudges may have the potential to yield temporal spillover effects and warrant a further investigation of boundary conditions and facilitators of the spillover effects of nudges.