Blocks, ovals, or people? Icon type affects risk perceptions and recall of pictographs

Enhancing Patient Understanding of Laboratory Test Results: Systematic Review of Presentation Formats and Their Impact on Perception, Decision, Action, and Memory

BACKGROUND

Direct access of patients to their web-based patient portal, including laboratory test results, has become increasingly common. Numeric laboratory results can be challenging to interpret for patients, which may lead to anxiety, confusion, and unnecessary doctor consultations. Laboratory results can be presented in different formats, but there is limited evidence regarding how these presentation formats impact patients' processing of the information.

OBJECTIVE

This study aims to synthesize the evidence on effective formats for presenting numeric laboratory test results with a focus on outcomes related to patients' information processing, including affective perception, perceived magnitude, cognitive perception, perception of communication, decision, action, and memory.

METHODS

The search was conducted in 3 databases (PubMed, Web of Science, and Embase) from inception until May 31, 2023. We included quantitative, qualitative, and mixed methods articles describing or comparing formats for presenting diagnostic laboratory test results to patients. Two reviewers independently extracted and synthesized the characteristics of the articles and presentation formats used. The quality of the included articles was assessed by 2 independent reviewers using the Mixed Methods Appraisal Tool.

RESULTS

A total of 18 studies were included, which were heterogeneous in terms of study design and primary outcomes used. The quality of the articles ranged from poor to excellent. Most studies (n=16, 89%) used mock test results. The most frequently used presentation formats were numerical values with reference ranges (n=12), horizontal line bars with colored blocks (n=12), or a combination of horizontal line bars with numerical values (n=8). All studies examined perception as an outcome, while action and memory were studied in 1 and 3 articles, respectively. In general, participants' satisfaction and usability were the highest when test results were presented using horizontal line bars with colored blocks. Adding reference ranges or personalized information (eg, goal ranges) further increased participants' perception. Additionally, horizontal line bars significantly decreased participants' tendency to search for information or to contact their physician, compared with numerical values with reference ranges.

CONCLUSIONS

In this review, we synthesized available evidence on effective presentation formats for laboratory test results. The use of horizontal line bars with reference ranges or personalized goal ranges increased participants' cognitive perception and perception of communication while decreasing participants' tendency to contact their physicians. Action and memory were less frequently studied, so no conclusion could be drawn about a single preferred format regarding these outcomes. Therefore, the use of horizontal line bars with reference ranges or personalized goal ranges is recommended to enhance patients' information processing of laboratory test results. Further research should focus on real-life settings and diverse presentation formats in combination with outcomes related to patients' information processing.

Probability overestimation induced by icon arrays

In decision making under risk, where the consequences of choices vary depending on specific probabilities, a proper interpretation of the presented probabilities is essential. However, because people are not good at evaluating numerical values, such as percentages, efforts have been made to accurately convey presented probabilities using visual aids represented by icon arrays. However, previous studies have suggested that icon arrays produce an overestimation of probabilities under specific conditions. Especially, (a) the arrangement of highlighted icons and (b) the severity of the outcomes represented by highlighted icons can lead to an overestimation of probabilities. By considering the absolute estimation of probabilities indicated by icon arrays and manipulating the aforementioned factors, this study investigated whether these factors could elicit an overestimation of probabilities in an additive manner or whether they have interactive effects. Two studies (total N = 1171) consistently showed that the arrangement of highlighted icons and the outcome severity they indicate induced a perceptual bias in the estimation of the probabilities presented in icon arrays in an additive manner. When the highlighted icons were random and the outcomes they indicate were severe, the probabilities presented by the icon arrays were overestimated. Accordingly, the study not only confirms the robustness of the findings of previous studies but also expand our understanding of the probability overestimation caused by icon arrays. Here, we discuss our findings in terms of the impact of risk-related communication.

Using Separate Single-Outcome Risk Presentations Instead of Integrated Multioutcome Formats Improves Comprehension in Discrete Choice Experiments

INTRODUCTION

Despite decades of research on risk-communication approaches, questions remain about the optimal methods for conveying risks for different outcomes across multiple time points, which can be necessary in applications such as discrete choice experiments (DCEs). We sought to compare the effects of 3 design factors: 1) separated versus integrated presentations of the risks for different outcomes, 2) use or omission of icon arrays, and 3) vertical versus horizontal orientation of the time dimension.

METHODS

We conducted a randomized study among a demographically diverse sample of 2,242 US adults recruited from an online panel (mean age 59.8 y, s = 10.4 y; 21.9% African American) that compared risk-communication approaches that varied in the 3 factors noted above. The primary outcome was the number of correct responses to 12 multiple-choice questions asking survey respondents to identify specific numbers, contrast options to recognize dominance (larger v. smaller risks), and compute differences. We used linear regression to test the effects of the 3 design factors, controlling for health literacy, graph literacy, and numeracy. We also measured choice consistency in a subsequent DCE choice module.

RESULTS

Mean comprehension varied significantly across versions (P < 0.001), with higher comprehension in the 3 versions that provided separated risk information for each risk. In the multivariable regression, separated risk presentation was associated with 0.58 more correct responses (P < 0.001; 95% confidence interval: 0.39, 0.77) compared with integrated risk information. Neither providing icon arrays nor using vertical versus horizontal time formats affected comprehension rates, although participant understanding did correlate with DCE choice consistency.

CONCLUSIONS

In presentations of multiple risks over multiple time points, presenting risk information separately for each health outcome appears to increase understanding.

HIGHLIGHTS

When conveying information about risks of different outcomes at multiple time points, separate presentations of single-outcome risks resulted in higher comprehension than presentations that combined risk information for different outcomes.We also observed benefits of presenting single-outcome risks separately among respondents with lower numeracy and graph literacy.Study participants who scored higher on risk understanding were more internally consistent in their responses to a discrete choice experiment.

Icon Arrays for Medical Risk Communication: Do Icon Type and Color Influence Cardiovascular Risk Perception and Recall?

BACKGROUND

Icon arrays have been shown to be an effective method for communicating medical risk information. However, in practice, icon arrays used to visualize personal risks often differ in the type and color of the icons. The aim of this study was to examine the influence of icon type and color on the perception and recall of cardiovascular risk, as little is known about how color affects the perception of icon arrays.

METHODS

A total of 866 participants aged 40 to 90 years representative of the German population in terms of gender and age completed an online experiment. Using a 2 × 2 between-subjects design, participants were randomly assigned to 1 of 4 experimental groups. They received their hypothetical 10-year cardiovascular risk using an icon array that varied by icon type (smiley v. person) and color (black/white v. red/yellow). We measured risk perception, emotional response, intentions of taking action to reduce the risk (e.g., increasing one's physical activity), risk recall, and graph evaluation/trustworthiness, as well as numeracy and graphical literacy.

RESULTS

Icon arrays using person icons were evaluated more positively. There was no effect of icons or color on risk perception, emotional response, intentions of taking action to reduce the risk, or trustworthiness of the graph. While more numerate/graphical literate participants were more likely to correctly recall the presented risk estimate, icon type and color did not influence the probability of correct recall.

CONCLUSIONS

Differences in the perception of the tested icon arrays were rather small, suggesting that they may be equally suitable for communicating medical risks. Further research on the robustness of these results across other colors, icons, and risk domains could add to guidelines on the design of visual aids.

HIGHLIGHTS

The use of different icons and colors did not influence the perception and the probability of recalling the 10-year cardiovascular risk, the emotional response, or the intentions to reduce the presented risk.Icon arrays with person icons were evaluated more positively.There was no evidence to suggest that the effectiveness of the studied icon arrays varied based on individuals' levels of numerical or graphical literacy, nor did it differ between people with or without a history of CVD or on medication for an increased CVD risk.

How the manner in which data is visualized affects and corrects (mis)perceptions of political polarization

While the mechanisms underlying polarization are complex, scholars have consistently found a pervasive overestimation of perceptions of polarization to be a contributing factor. We argue that one mitigation strategy that can work at scale to address such misperceptions might be relatively straightforward: better data visualizations of cross-party attitudes on key issues. In a large-scale (N = 6603), international replication, we find that mode of presentation-or the manner in which data are visually presented-plays a significant role in moderating perceptions of polarization, even for longstanding, divisive issues for which partisans would likely hold strong prior beliefs. Additionally, we find the effects that different modes of presentation have on issue-specific polarization also extend to participant beliefs about overall interparty polarization, with certain modes proving capable of not only promoting less polarized views but also enabling more accurate estimates of the extent to which political groups agree. Finally, our findings also suggest that the manner in which intergroup data are visualized may also exert influence over the degree to which political groups are essentialized-a finding with implications for not only political perception but also for apolitical social psychological phenomena such as dehumanization.

Evaluating layperson interpretation of actuarial sexual violence risk data: A multi-method comparison of risk communication with attention to gender bias

Forensic clinicians are often called upon to help courts determine the likelihood that someone will continue to commit sexually violent acts in the future. The utility of these evaluations depends largely on how effectively the results are communicated to and understood by the trier of fact. Actuarial results, such as those commonly reported in sexual offense risk assessments, appear particularly challenging for laypersons to understand. Using a representative sample of 206 U.S. adults, this study examines three methods of communicating actuarial risk via simulated expert testimony on participants' ratings of a hypothetical evaluee's risk of sexual re-offending. The results suggested that all participants, regardless of how results were communicated, over-estimated the examinee's risk level relative to the expert's probabilistic findings, but tended to agree with the expert's categorical predictions. Participants who were only shown actuarial data consistently rated the evaluee as more dangerous and likely to commit future sexually violent acts. Additionally, it was found that gender significantly impacted participants' perceptions, such that women found the evaluee more dangerousness and desired greater social distance from him. This study has implications for best practices regarding expert communication of actuarial results in cases involving sexual violence.

Cardiovascular disease risk communication: Strategies, impact, and future directions

Cardiovascular disease (CVD) prevails as the leading cause of global mortality, claiming the lives of an estimated 17.9 million individuals in 2019, representing a substantial portion of worldwide mortality. Research indicates that individuals with a deeper understanding of their cardiovascular health are more inclined to adhere to preventive measures, potentially leading to improved outcomes. Moreover, inadequate communication may undermine confidence in healthcare professionals, fostering anxiety and other adverse consequences. CVD risk communication serves as a powerful tool in enhancing comprehension and supporting informed decisions regarding the clinical management of CVD. This review examines the impact of CVD risk communication on cardiovascular outcomes, exploring diverse strategies for conveying information about cardiovascular risks and preventive measures. The effectiveness of these strategies in influencing patient behavior and health outcomes is thoroughly assessed. Furthermore, gaps in current approaches are discussed, and future directions are proposed for enhancing CVD risk communication and improving patient education, engagement, and overall cardiovascular health.

Infographics on risks associated with COVID-19 and the willingness to get the AstraZeneca vaccine: two randomized online experiments

BACKGROUND

Germans hesitated to get vaccinated with AstraZeneca in the COVID-19 pandemic after reports of blood clots.

METHODS

In two preregistered online experiments with stratified randomization (Study 1 N = 824, Study 2: N = 1,056), we tested whether providing evidence-based benefit-risk information reduces the perceived risk of the AstraZeneca vaccine and the perceived probability of blood clots due to the AstraZeneca vaccine and increases the vaccination intention. In Study 1, participants saw no infographic (control) or one of two infographics (low vs. high exposure risk varied by the underlying incidence rates). Study 2 additionally varied the infographic design displaying the risk information (presented as table, circle icons, or manikin-like icons).

RESULTS

The infographic decreased the risk perception of the vaccine compared to no infographic (Study 1: Cohens d = 0.31, 95% CI [0.14, 0.48]; Study 2: Cohens d = 0.34, 95% CI [0.06, 0.62]), but it did not influence the perceived probability of blood clots due to the AstraZeneca vaccine (Study 2: Cohens d = 0.05, 95% CI [-0.23, 0.33]). Also, the infographic design did not affect the perceived probability of blood clots (Study 2). The vaccination intention was not affected by viewing the infographic (Study 1: Cohens d = 0.04, 95% CI [-0.13, 0.21]; Study 2: Cohens d = 0.04, 95% CI [-0.24, 0.32]) nor the presented infection rate (Study 1: Cohens d = 0.07, 95% CI [-0.09, 0.24], Study 2: Cohens d = 0.01, 95% CI [-0.12, 0.15]) but by risk perceptions, sociodemographic characteristics, confidence in the AstraZeneca vaccine, and preference for alternative vaccines.

CONCLUSIONS

The evidence-based benefit-risk information helped putting the risk of vaccinations into perspective. Nevertheless, objective risk information alone did not affect vaccination intention that was low due to the preexisting lacking vaccine confidence.

A pilot test of an infographic-based health communication intervention to enhance patient education among Latino persons with HIV

OBJECTIVE

To pilot test an infographic-based health communication intervention that our team rigorously designed and explore whether its implementation leads to better health outcomes among Latino persons with HIV (PWH).

MATERIALS AND METHODS

Latino PWH (N = 30) living in New York City received the intervention during health education sessions at 3 study visits that occurred approximately 3 months apart. At each visit, participants completed baseline or follow-up assessments and laboratory data were extracted from patient charts. We assessed 6 outcomes (HIV-related knowledge, self-efficacy to manage HIV, adherence to antiretroviral therapy, CD4 count, viral load, and current and overall health status) selected according to a conceptual model that describes pathways through which communication influences health outcomes. We assessed changes in outcomes over time using quantile and generalized linear regression models controlling for the coronavirus disease 2019 (COVID-19) research pause and new patient status (new/established) at the time of enrollment.

RESULTS

Most participants were male (60%) and Spanish-speaking (60%); 40% of participants identified as Mixed Race/Mestizo, 13.3% as Black, 13.3% as White, and 33.3% as "other" race. Outcome measures generally improved after the second intervention exposure. Following the third intervention exposure (after the COVID-19 research pause), only the improvements in HIV-related knowledge and current health status were statistically significant.

DISCUSSION AND CONCLUSION

Our infographic-based health communication intervention may lead to better health outcomes among Latino PWH, but larger trials are needed to establish efficacy. From this work, we contribute suggestions for effective infographic use for patient-provider communication to enhance patient education in clinical settings.

Hand Hygiene Messaging Design in the Workplace: Views From the Workforce-Introduction

AIMS

The study aimed to (1) discover workers' attitudes toward the use of novel video screens to improve hand sanitization in the workplace and (2) discover what workers' preferences are for hand hygiene (HH) messaging style and tone and reasons for their preferences.

BACKGROUND

Practicing good HH in non-medical office settings is vital to curb the spread of a range of common and infectious diseases. Despite this, workers are rarely consulting in the construction of HH messages. The qualitative views of users can provide us with the "why" rather than the "what" and can highlight areas of cynicism, concern and overall attitudes to HH.

METHODS

A survey was completed by 520 UK workers concerning attitudes and views toward HH messaging and the use of a video-based hand sanitizer unit. Analysis consisted of both qualitative and quantitative methods.

RESULTS

Workers were skeptical toward the use of digital technologies within HH interventions, and there were misgivings about the role that video could play. Results demonstrated a strong preference for positive and supportive messages. Educational and trustworthy qualities were well rated. Messages that emphasized surveillance, previously successful in a clinical setting, or guilt, were not well received. Visual approaches that utilized serious illustration were valued.

CONCLUSION

This study highlights how consulting workers before the design of HH initiatives is important in guiding the design process. The resultant user-centered criteria promotes the use of positive, motivational, thought-provoking, surprising, and visual approaches to HH messaging.

Numerical and Visual Representations of Uncertainty Lead to Different Patterns of Decision Making

Although visualizations are a useful tool for helping people to understand information, they can also have unintended effects on human cognition. This is especially true for uncertain information, which is difficult for people to understand. Prior work has found that different methods of visualizing uncertain information can produce different patterns of decision making from users. However, uncertainty can also be represented via text or numerical information, and few studies have systematically compared these types of representations to visualizations of uncertainty. We present two experiments that compared visual representations of risk (icon arrays) to numerical representations (natural frequencies) in a wildfire evacuation task. Like prior studies, we found that different types of visual cues led to different patterns of decision making. In addition, our comparison of visual and numerical representations of risk found that people were more likely to evacuate when they saw visualizations than when they saw numerical representations. These experiments reinforce the idea that design choices are not neutral: seemingly minor differences in how information is represented can have important impacts on human risk perception and decision making.

Effect of different visual presentations on the public's comprehension of prognostic information using acute and chronic condition scenarios: two online randomised controlled trials

OBJECTIVES

To assess the effectiveness of bar graph, pictograph and line graph compared with text-only, and to each other, for communicating prognosis to the public.

DESIGN

Two online four-arm parallel-group randomised controlled trials. Statistical significance was set at p<0.016 to allow for three-primary comparisons.

PARTICIPANTS AND SETTING

Two Australian samples were recruited from members registered at Dynata online survey company. In trial A: 470 participants were randomised to one of the four arms, 417 were included in the analysis. In trial B: 499 were randomised and 433 were analysed.

INTERVENTIONS

In each trial four visual presentations were tested: bar graph, pictograph, line graph and text-only. Trial A communicated prognostic information about an acute condition (acute otitis media) and trial B about a chronic condition (lateral epicondylitis). Both conditions are typically managed in primary care where 'wait and see' is a legitimate option.

MAIN OUTCOME

Comprehension of information (scored 0-6).

SECONDARY OUTCOMES

Decision intention, presentation satisfaction and preferences.

RESULTS

In both trials, the mean comprehension score was 3.7 for the text-only group. None of the visual presentations were superior to text-only. In trial A, the adjusted mean difference (MD) compared with text-only was: 0.19 (95% CI -0.16 to 0.55) for bar graph, 0.4 (0.04 to 0.76) for pictograph and 0.06 (-0.32 to 0.44) for line graph. In trial B, the adjusted MD was: 0.1 (-0.27 to 0.47) for bar graph), 0.38 (0.01 to 0.74) for pictograph and 0.1 (-0.27 to 0.48) for line graph. Pairwise comparisons between the three graphs showed all were clinically equivalent (95% CIs between -1.0 and 1.0). In both trials, bar graph was the most preferred presentation (chosen by 32.9% of trial A participants and 35.6% in trial B).

CONCLUSIONS

Any of the four visual presentations tested may be suitable to use when discussing quantitative prognostic information.

TRIAL REGISTRATION NUMBER

Australian New Zealand Clinical Trials Registry (ACTRN12621001305819).

Communicating health information with visual displays

Well-designed visual displays have the power to convey health messages in clear, effective ways to non-experts, including journalists, patients and policymakers. Poorly designed visual displays, however, can confuse and alienate recipients, undermining health messages. In this Perspective, we propose a structured framework for effective visual communication of health information, using case examples of three common communication tasks: comparing treatment options, interpreting test results, and evaluating risk scenarios. We also show simple, practical ways to evaluate a design's success and guide improvements. The proposed framework is grounded in research on health risk communication, visualization and decision science, as well as our experience in communicating health data.

The Use of Visualizations to Improve Bayesian Reasoning: A Literature Review

Decisions are often made under uncertainty. The most that one can do is use prior knowledge (e.g., base rates, prior probabilities, etc.) and make the most probable choice given the information we have. Unfortunately, most people struggle with Bayesian reasoning. Poor performance within Bayesian reasoning problems has led researchers to investigate ways to improve Bayesian reasoning. Many have found success in using natural frequencies instead of probabilities to frame problems. Beyond the quantitative format, there is growing literature on the use of visualizations or visual representations to improve Bayesian reasoning, which will be the focus of this review. In this review, we discuss studies that have found visualizations to be effective for improving Bayesian reasoning in a lab or classroom setting and discuss the considerations for using visualizations, paying special attention to individual differences. In addition, we will review the factors that influence Bayesian reasoning, such as natural frequencies vs. probabilities, problem format, individual differences, and interactivity. We also provide general and specific suggestions for future research.

Designing for patient decision-making: Design challenges generated by patients with atrial fibrillation during evaluation of a decision aid prototype

Shared decision-making (SDM) empowers patients and care teams to determine the best treatment plan in alignment with the patient's preferences and goals. Decision aids are proven tools to support high quality SDM. Patients with atrial fibrillation (AF), the most common cardiac arrhythmia, struggle to identify optimal rhythm and symptom management strategies and could benefit from a decision aid. In this Brief Research Report, we describe the development and preliminary evaluation of an interactive decision-making aid for patients with AF. We employed an iterative, user-centered design method to develop prototypes of the decision aid. Here, we describe multiple iterations of the decision aid, informed by the literature, expert feedback, and mixed-methods design sessions with AF patients. Results highlight unique design requirements for this population, but overall indicate that an interactive decision aid with visualizations has the potential to assist patients in making AF treatment decisions. Future work can build upon these design requirements to create and evaluate a decision aid for AF rhythm and symptom management.

Probablement, Wahrscheinlich, Likely? A Cross-Language Study of How People Verbalize Probabilities in Icon Array Visualizations

Visualizations today are used across a wide range of languages and cultures. Yet the extent to which language impacts how we reason about data and visualizations remains unclear. In this paper, we explore the intersection of visualization and language through a cross-language study on estimative probability tasks with icon-array visualizations. Across Arabic, English, French, German, and Mandarin, n=50 participants per language both chose probability expressions - e.g. likely, probable - to describe icon-array visualizations (Vis-to-Expression), and drew icon-array visualizations to match a given expression (Expression-to-Vis). Results suggest that there is no clear one-to-one mapping of probability expressions and associated visual ranges between languages. Several translated expressions fell significantly above or below the range of the corresponding English expressions. Compared to other languages, French and German respondents appear to exhibit high levels of consistency between the visualizations they drew and the words they chose. Participants across languages used similar words when describing scenarios above 80% chance, with more variance in expressions targeting mid-range and lower values. We discuss how these results suggest potential differences in the expressiveness of language as it relates to visualization interpretation and design goals, as well as practical implications for translation efforts and future studies at the intersection of languages, culture, and visualization. Experiment data, source code, and analysis scripts are available at the following repository: https://osf.io/g5d4r/.

Development of Complementary Encounter and Patient Decision Aids for Shared Decision Making about Stroke Prevention in Atrial Fibrillation

Introduction

Decision aids (DAs) are helpful instruments used to support shared decision making (SDM). Patients with atrial fibrillation (AF) face complex decisions regarding stroke prevention strategies. While a few DAs have been made for AF stroke prevention, an encounter DA (EDA) and patient DA (PDA) have not been created to be used in conjunction with each other before.

Design

Using iterative user-centered design, we developed 2 DAs for anticoagulation choice and stroke prevention in AF. Prototypes were created, and we elicited feedback from patients and experts via observations of encounters, usability testing, and semistructured interviews.

Results

User testing was done with 33 experts (in AF and SDM) and 51 patients from 6 institutions. The EDA and PDA underwent 1 and 4 major iterations, respectively. Major differences between the DAs included AF pathophysiology and a preparation to meet with the clinician in the PDA as well as different language throughout. Content areas included personalized stroke risk, differences between anticoagulants, and risks of bleeding. Based on user feedback, developers 1) addressed feelings of isolation with AF, 2) improved navigation options, 3) modified content and flow for users new to AF and those experienced with AF, 4) updated stroke risk pictographs, and 5) added structure to the preparation for decision making in the PDA.

Limitations

These DAs focus only on anticoagulation for stroke prevention and are online, which may limit participation for those less comfortable with technology.

Conclusions

Designing complementary DAs for use in tandem or separately is a new method to support SDM between patients and clinicians. Extensive user testing is essential to creating high-quality tools that best meet the needs of those using them.

Highlights

First-time complementary encounter and patient decision aids have been designed to work together or separately.User feedback led to greater structure and different experiences for patients naïve or experienced with anticoagulants in patient decision aids.Online tools allow for easier dissemination, use in telehealth visits, and updating as new evidence comes out.

Designing With Pictographs: Envision Topics Without Sacrificing Understanding

Past studies have shown that when a visualization uses pictographs to encode data, they have a positive effect on memory, engagement, and assessment of risk. However, little is known about how pictographs affect one's ability to understand a visualization, beyond memory for values and trends. We conducted two crowdsourced experiments to compare the effectiveness of using pictographs when showing part-to-whole relationships. In Experiment 1, we compared pictograph arrays to more traditional bar and pie charts. We tested participants' ability to generate high-level insights following Bloom's taxonomy of educational objectives via 6 free-response questions. We found that accuracy for extracting information and generating insights did not differ overall between the two versions. To explore the motivating differences between the designs, we conducted a second experiment where participants compared charts containing pictograph arrays to more traditional charts on 5 metrics and explained their reasoning. We found that some participants preferred the way that pictographs allowed them to envision the topic more easily, while others preferred traditional bar and pie charts because they seem less cluttered and faster to read. These results suggest that, at least in simple visualizations depicting part-to-whole relationships, the choice of using pictographs has little influence on sensemaking and insight extraction. When deciding whether to use pictograph arrays, designers should consider visual appeal, perceived comprehension time, ease of envisioning the topic, and clutteredness.

Investigating the presentation of uncertainty in an icon array: A randomized trial

BACKGROUND

Clinicians are often advised to use pictographs to communicate risk, but whether they offer benefits when communicating risk imprecision (e.g., 65%-79%) is unknown.

PURPOSE

To test whether any of three approaches to visualizing imprecision would more effectively communicate breast and ovarian cancer risk for BRCA1 pathogenic variant carriers.

METHODS

1,300 UK residents were presented with a genetic report with information about BRCA1-related risks, with random assignment to one of four formats: no visualization (text alone), or a pictograph using shaded icons, a gradient, or arrows marking range endpoints. We also tested pictographs in two layouts. Analysis of variance (ANOVA) and regression was employed.

RESULTS

There was no effect of format. Participants shown pictographs vs. text alone had better uptake of breast cancer risk messages (p < .05, η ² = 0.003). Pictographs facilitated memory for the specific amount of risk (p < 0.001, η ² = 0.019), as did the tabular layout. Individuals not having completed upper secondary education may benefit most.

CONCLUSIONS

We found weak evidence in favor of using simple pictographs with ranges to communicate BRCA risk (versus text alone), and of the tabular layout.

INNOVATION

Testing different ways of communicating imprecision within pictographs is a novel and promising line of research.

Health Literacy and eHealth: Challenges and Strategies

Given the impact of health literacy (HL) on patients' outcomes, limited health literacy is a major barrier to improve cancer care globally. HL refers to the degree in which an individual is able to acquire, process, and comprehend information in a way to be actively involved in their health decisions. Previous research found that almost half of the population in developed countries have difficulties in understanding health-related information. With the gradual shift toward the shared decision making process and digital transformation in oncology, the need for addressing low HL issues is crucial. Decision making in oncology is often accompanied by considerable consequences on patients' lives, which requires patients to understand complex information and be able to compare treatment methods by considering their own values. How health information is perceived by patients is influenced by various factors including patients' characteristics and the way information is presented to patients. Currently, identifying patients with low HL and simple data visualizations are the best practice to help patients and clinicians in dealing with limited health literacy. Furthermore, using eHealth, as well as involving HL mediators, supports patients to make sense of complex information.

Development of a Patient-Centered Preference Tool for Patients With Hematologic Malignancies: Protocol for a Mixed Methods Study

BACKGROUND

The approval of novel therapies for patients diagnosed with hematologic malignancies have improved survival outcomes but increased the challenge of aligning chemotherapy choices with patient preferences. We previously developed paper versions of a discrete choice experiment (DCE) and a best-worst scaling (BWS) instrument to quantify the treatment outcome preferences of patients with hematologic malignancies to inform shared decision making.

OBJECTIVE

We aim to develop an electronic health care tool (EHT) to guide clinical decision making that uses either a BWS or DCE instrument to capture patient preferences. The primary objective of this study is to use both qualitative and quantitative methods to evaluate the perceived usability, cognitive workload (CWL), and performance of electronic prototypes that include the DCE and BWS instrument.

METHODS

This mixed methods study includes iterative co-design methods that will involve healthy volunteers, patient-caregiver pairs, and health care workers to evaluate the perceived usability, CWL, and performance of tasks within distinct prototypes. Think-aloud sessions and semistructured interviews will be conducted to collect qualitative data to develop an affinity diagram for thematic analysis. Validated assessments (Post-Study System Usability Questionnaire [PSSUQ] and the National Aeronautical and Space Administration's Task Load Index [NASA-TLX]) will be used to evaluate the usability and CWL required to complete tasks within the prototypes. Performance assessments of the DCE and BWS will include the evaluation of tasks using the Single Easy Questionnaire (SEQ), time to complete using the prototype, and the number of errors. Additional qualitative assessments will be conducted to gather participants' feedback on visualizations used in the Personalized Treatment Preferences Dashboard that provides a representation of user results after completing the choice tasks within the prototype.

RESULTS

Ethical approval was obtained in June 2021 from the Institutional Review Board of the University of North Carolina at Chapel Hill. The DCE and BWS instruments were developed and incorporated into the PRIME (Preference Reporting to Improve Management and Experience) prototype in early 2021 and prototypes were completed by June 2021. Heuristic evaluations were conducted in phase 1 and completed by July 2021. Recruitment of healthy volunteers began in August 2021 and concluded in September 2021. In December 2021, our findings from phase 2 were accepted for publication. Phase 3 recruitment began in January 2022 and is expected to conclude in September 2022. The data analysis from phase 3 is expected to be completed by November 2022.

CONCLUSIONS

Our findings will help differentiate the usability, CWL, and performance of the DCE and BWS within the prototypes. These findings will contribute to the optimization of the prototypes, leading to the development of an EHT that helps facilitate shared decision making. This evaluation will inform the development of EHTs to be used clinically with patients and health care workers.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/39586.

Cardiovascular risk communication strategies in primary prevention. A systematic review with narrative synthesis

AIM

To evaluate the effectiveness of cardiovascular risk communication strategies to improve understanding and promote risk factor modification.

DESIGN

Systematic review with narrative synthesis.

DATA SOURCES

A comprehensive database search for quantitative and qualitative studies was conducted in five databases, Cumulative Index to Nursing and Allied health Literature (CINAHL), Medical Literature Analysis and Retrieval System Online (MEDLINE), EMBASE, Applied Social Sciences Index and Abstracts (ASSIA) and Web of Science. The searches were conducted between 1980 and July 2019.

REVIEW METHODS

The systematic review was conducted in accordance with Cochrane review methods. Data were extracted and a narrative synthesis of quantitative and qualitative results was undertaken.

RESULTS

The abstracts of 16,613 articles were assessed and 210 underwent in-depth review, with 31 fulfilling the inclusion criteria. We observed significant heterogeneity across study designs and outcomes. Nine communication strategies were identified including numerical formats, graphical formats, qualitative information, infographics, avatars, game interactions, timeframes, genetic risk scores and cardiovascular imaging. Strategies that used cardiovascular imaging had the biggest impact on health behaviour change and risk factor modification. Improvements were seen in diet, exercise, smoking, risk scores, cholesterol and intentions to take preventive medication.

CONCLUSION

A wide range of cardiovascular risk communication strategies has been evaluated, with those that employ personalized and visual evidence of current cardiovascular health status more likely to promote action to reduce risk.

IMPACT

Future risk communication strategies should incorporate methods to provide individuals with evidence of their current cardiovascular health status.

"Will it work for me?" Developing patient-friendly graphical displays of posttraumatic stress disorder treatment effectiveness

The goal of this study was to create simple visual displays to help patients understand the benefits of evidence-based treatment for posttraumatic stress disorder (PTSD). We reviewed randomized trials of the most effective individual, trauma-focused psychotherapies and first-line antidepressants for adults with PTSD. The analytic sample included 65 treatment arms from 41 trials. We used binomial logistic regression to estimate the proportion of participants who lost their PTSD diagnosis at posttreatment and created a sample icon array to display these estimates. We provide a range of estimates (0-100) based on varying the percentage of the sample with a military affiliation. The percentage of participants who no longer met the diagnostic criteria for PTSD among civilian populations was 64.3% for trauma-focused treatment, 56.9% for SSRI/SNRI, and 16.7% for waitlist/minimal attention. For military populations, the proportions of participants who no longer met the diagnostic criteria were 44.2%, 36.7%, and 8.1%, respectively. We present icon arrays for 0%, 7%, 50%, and 100% military affiliation displaying 100 icons, a portion of which were shaded to indicate the number of participants that no longer met the PTSD criteria following treatment. After evidence-based treatment, between one third and two thirds of participants no longer met the PTSD criteria. Providers can use the icon array developed in this study with patients to facilitate communication regarding PTSD treatment effectiveness.

Decision making about anti-TNF therapy: A pilot trial of a shared decision-making intervention

OBJECTIVE

We conducted a pre-post pilot trial to determine the feasibility and acceptability of a multi-component intervention (pre-clinic letter, shared decision making cards and follow-up phone call) designed to facilitate SDM in pediatric inflammatory bowel disease (IBD).

METHODS

We recruited physicians (n = 11) caring for IBD patients and families (n = 36) expected to discuss anti-tumor necrosis treatment. We measured feasibility and acceptability of the intervention, observed SDM, perceived SDM, decision conflict, and regret. Medical records were used to assess clinical outcomes, time to decision and adherence. We compared all outcomes between the usual care and intervention study arms.

RESULTS

Two out of three intervention components were feasible. Visit length increased significantly in the intervention arm. Parents and patients rated the intervention as acceptable, as did most physicians. The intervention was associated with a higher-level of observed SDM. There was no difference perceived SDM, decision conflict, regret or quality of life outcomes between arms. Physician global assessment improved over time in the intervention arm.

CONCLUSIONS

This pilot trial provides important guidance for developing a larger scale trial of a modified intervention.

PRACTICE IMPLICATIONS

Overall, our intervention shows promise in supporting SDM and engaging both parents and patients in pediatric IBD decisions.

Applying Insights on Categorisation, Communication, and Dynamic Decision-Making: A Case Study of a ‘Simple’ Maritime Military Decision

A complete understanding of decision-making in military domains requires gathering insights from several fields of study. To make the task tractable, here we consider a specific example of short-term tactical decisions under uncertainty made by the military at sea. Through this lens, we sketch out relevant literature from three psychological tasks each underpinned by decision-making processes: categorisation, communication and choice. From the literature, we note two general cognitive tendencies that emerge across all three stages: the effect of cognitive load and individual differences. Drawing on these tendencies, we recommend strategies, tools and future research that could improve performance in military domains – but, by extension, would also generalise to other high-stakes contexts. In so doing, we show the extent to which domain general properties of high order cognition are sufficient in explaining behaviours in domain specific contexts.

An Objective Measure of Decisional Clarity to Assess Decision Aid Effectiveness in Situations with Equipoise: A Randomized Trial

BACKGROUND

Decision aids can help patients make medical decisions, which is especially advantageous in situations with equipoise. However, when there is no correct answer, it is difficult to assess whether a decision aid is helpful. The goal of this research is to propose and validate an objective method for measuring decision aid effectiveness by quantifying the clarity participants achieved when making decisions.

DESIGN

The measure of decisional clarity was tested in a convenience sample of 131 college-aged students making hypothetical decisions about 2 treatment options for depression and anxiety. The treatments varied with respect to potential benefits and harms. Information was presented numerically or with an accompanying data visualization (an icon array) that is known to aid decision making.

RESULTS

Decisional clarity was better with the icon arrays. Furthermore, the results showed that decisional clarity can be used to identify situations for which patients will be more likely to struggle making their decision. These included situations for which financial considerations were relevant to the decision and situations for which the probabilities of potential benefits were higher.

LIMITATIONS

The measure of decisional clarity and the situations identified as lacking clarity should be validated with a larger, more representative sample.

CONCLUSIONS

These findings demonstrate that decisional clarity can be used to both empirically evaluate the effectiveness of a decision aid as well as test factors that can cloud clarity and disrupt medical decision making.

IMPLICATIONS

Researchers and medical providers interested in developing decision aids for situations with equipoise can use decisional clarity as an objective measure to assess the effectiveness of their decision aid. Financial considerations and higher probabilities may also cloud judgments.

HIGHLIGHTS

An objective measure of decisional clarity is supported.Decisional clarity can be used to evaluate decision aids in the context of equipoise for which there is no objectively correct choice.Decisional clarity can also be used to identify scenarios for which patients are likely to struggle to make a medical decision.

Effects of icon arrays to communicate risk in a repeated risky decision-making task

In two experiments, participants decided on each of several trials whether or not to take a risk. If they chose to take the risk, they had a relatively high probability (from 75% to 95%) of winning a small number of points and a relatively low probability (5% to 25%) of losing a large number of points. The loss amounts varied so that the expected value of taking the risk was positive on some trials, zero on others, and negative on the rest. The main independent variable was whether the probability of losing was communicated using numerical percentages or icon arrays. Both experiments included random icon arrays, in which the icons representing losses were randomly distributed throughout the array. Experiment 2 also included grouped icon arrays, in which the icons representing losses were grouped at the bottom of the array. Neither type of icon array led to better performance in the task. However, the random icon arrays led to less risk taking than the numerical percentages or the grouped icon arrays, especially at the higher loss probabilities. In a third experiment, participants made direct judgments of the percentages and probabilities represented by the icon arrays from Experiment 2. The results supported the idea that random arrays lead to less risk taking because they are perceived to represent greater loss probabilities. These results have several implications for the study of icon arrays and their use in risk communication.

Improving Diagnostic Efficiency with Frequency Double-Trees and Frequency Nets in Bayesian Reasoning

Background. Medical students often have problems with Bayesian reasoning situations. Representing statistical information as natural frequencies (instead of probabilities) and visualizing them (e.g., with double-trees or net diagrams) leads to higher accuracy in solving these tasks. However, double-trees and net diagrams (which already contain the correct solution of the task, so that the solution could be read of the diagrams) have not yet been studied in medical education. This study examined the influence of information format (probabilities v. frequencies) and visualization (double-tree v. net diagram) on the accuracy and speed of Bayesian judgments. Methods. A total of 142 medical students at different university medical schools (Munich, Kiel, Goettingen, Erlangen, Nuremberg, Berlin, Regensburg) in Germany predicted posterior probabilities in 4 different medical Bayesian reasoning tasks, resulting in a 3-factorial 2 × 2 × 4 design. The diagnostic efficiency for the different versions was represented as the median time divided by the percentage of correct inferences. Results. Frequency visualizations led to a significantly higher accuracy and faster judgments than did probability visualizations. Participants solved 80% of the tasks correctly in the frequency double-tree and the frequency net diagram. Visualizations with probabilities also led to relatively high performance rates: 73% in the probability double-tree and 70% in the probability net diagram. The median time for a correct inference was fastest with the frequency double tree (2:08 min) followed by the frequency net diagram and the probability double-tree (both 2:26 min) and probability net diagram (2:33 min). The type of visualization did not result in a significant difference. Discussion. Frequency double-trees and frequency net diagrams help answer Bayesian tasks more accurately and also more quickly than the respective probability visualizations. Surprisingly, the effect of information format (probabilities v. frequencies) on performance was higher in previous studies: medical students seem also quite capable of identifying the correct solution to the Bayesian task, among other probabilities in the probability visualizations.

Behavioural Challenges Associated With Risk-Adapted Cancer Screening

Cancer screening programmes have a major role in reducing cancer incidence and mortality. Traditional internationally-adopted protocols have been to invite all 'eligible individuals' for the same test at the same frequency. However, as highlighted in Cancer Research UK's 2020 strategic vision, there are opportunities to increase effectiveness and cost-effectiveness, and reduce harms of screening programmes, by making recommendations on the basis of personalised estimates of risk. In some respects, this extends current approaches of providing more intensive levels of care outside screening programmes to individuals at very high risk due to their family history or underlying conditions. However, risk-adapted colorectal cancer screening raises a wide range of questions, not only about how best to change existing programmes but also about the psychological and behavioural effects that these changes might have. Previous studies in other settings provide some important information but remain to be tested and explored further in the context of colorectal screening. Conducting behavioural science research in parallel to clinical research will ensure that risk-adapted screening is understood and accepted by the population that it aims to serve.

The Science of Visual Data Communication: What Works

Effectively designed data visualizations allow viewers to use their powerful visual systems to understand patterns in data across science, education, health, and public policy. But ineffectively designed visualizations can cause confusion, misunderstanding, or even distrust-especially among viewers with low graphical literacy. We review research-backed guidelines for creating effective and intuitive visualizations oriented toward communicating data to students, coworkers, and the general public. We describe how the visual system can quickly extract broad statistics from a display, whereas poorly designed displays can lead to misperceptions and illusions. Extracting global statistics is fast, but comparing between subsets of values is slow. Effective graphics avoid taxing working memory, guide attention, and respect familiar conventions. Data visualizations can play a critical role in teaching and communication, provided that designers tailor those visualizations to their audience.

Clinician Use of HIV-Related Infographics During Clinic Visits in the Dominican Republic is Associated with Lower Viral Load and Other Improvements in Health Outcomes

We designed an infographic intervention to help clinicians provide health information to persons living with HIV. In this study, we assessed the extent to which our intervention may improve objectively and subjectively measured health outcomes (CD4 count, viral load, and engagement with clinician among others) when integrated into routine visits in the Dominican Republic. In this pretest-posttest study, we followed participants for 9 months at 3-month intervals. Physicians administered the intervention during participants' first 3 visits. Outcome measures, selected using a conceptual model, were assessed at 4 time points. We assessed changes in outcomes over time with general linear regressions and Wilcoxon Signed-Rank tests. Participants (N = 50) were mostly female (56%) and had been living with HIV for a mean of 6.3 years (SD = 6.1). All outcomes, except CD4 count, demonstrated statistically significant improvements by study end. This provides preliminary evidence our intervention may improve outcomes, but further testing is needed.

Exploring Cancer Survivor Needs and Preferences for Communicating Personalized Cancer Statistics From Registry Data: Qualitative Multimethod Study

Background

Disclosure of cancer statistics (eg, survival or incidence rates) based on a representative group of patients can help increase cancer survivors’ understanding of their own diagnostic and prognostic situation, and care planning. More recently, there has been an increasing interest in the use of cancer registry data for disclosing and communicating personalized cancer statistics (tailored toward personal and clinical characteristics) to cancer survivors and relatives.

Objective

The aim of this study was to explore breast cancer (BCa) and prostate cancer (PCa) survivor needs and preferences for disclosing (what) and presenting (how) personalized statistics from a large Dutch population-based data set, the Netherlands Cancer Registry (NCR).

Methods

To elicit survivor needs and preferences for communicating personalized NCR statistics, we created different (non)interactive tools visualizing hypothetical scenarios and adopted a qualitative multimethod study design. We first conducted 2 focus groups (study 1; n=13) for collecting group data on BCa and PCa survivor needs and preferences, using noninteractive sketches of what a tool for communicating personalized statistics might look like. Based on these insights, we designed a revised interactive tool, which was used to further explore the needs and preferences of another group of cancer survivors during individual think-aloud observations and semistructured interviews (study 2; n=11). All sessions were audio-recorded, transcribed verbatim, analyzed using thematic (focus groups) and content analysis (think-aloud observations), and reported in compliance with qualitative research reporting criteria.

Results

In both studies, cancer survivors expressed the need to receive personalized statistics from a representative source, with especially a need for survival and conditional survival rates (ie, survival rate for those who have already survived for a certain period). Personalized statistics adjusted toward personal and clinical factors were deemed more relevant and useful to know than generic or average-based statistics. Participants also needed support for correctly interpreting the personalized statistics and putting them into perspective, for instance by adding contextual or comparative information. Furthermore, while thinking aloud, participants experienced a mix of positive (sense of hope) and negative emotions (feelings of distress) while viewing the personalized survival data. Overall, participants preferred simplicity and conciseness, and the ability to tailor the type of visualization and amount of (detailed) statistical information.

Conclusions

The majority of our sample of cancer survivors wanted to receive personalized statistics from the NCR. Given the variation in patient needs and preferences for presenting personalized statistics, designers of similar information tools may consider potential tailoring strategies on multiple levels, as well as effective ways for providing supporting information to make sure that the personalized statistics are properly understood. This is encouraging for cancer registries to address this unmet need, but also for those who are developing or implementing personalized data-driven information tools for patients and relatives.

Natural frequency trees improve diagnostic efficiency in Bayesian reasoning

When physicians are asked to determine the positive predictive value from the a priori probability of a disease and the sensitivity and false positive rate of a medical test (Bayesian reasoning), it often comes to misjudgments with serious consequences. In daily clinical practice, however, it is not only important that doctors receive a tool with which they can correctly judge-the speed of these judgments is also a crucial factor. In this study, we analyzed accuracy and efficiency in medical Bayesian inferences. In an empirical study we varied information format (probabilities vs. natural frequencies) and visualization (text only vs. tree only) for four contexts. 111 medical students participated in this study by working on four Bayesian tasks with common medical problems. The correctness of their answers was coded and the time spent on task was recorded. The median time for a correct Bayesian inference is fastest in the version with a frequency tree (2:55 min) compared to the version with a probability tree (5:47 min) or to the text only versions based on natural frequencies (4:13 min) or probabilities (9:59 min).The score diagnostic efficiency (calculated by: median time divided by percentage of correct inferences) is best in the version with a frequency tree (4:53 min). Frequency trees allow more accurate and faster judgments. Improving correctness and efficiency in Bayesian tasks might help to decrease overdiagnosis in daily clinical practice, which on the one hand cause cost and on the other hand might endanger patients' safety.

Parental Risk Literacy is Related to Quality of Life in Spanish Families of Children with Autism Spectrum Disorder

Families of children with autism spectrum disorder (ASD) often experience much more negative perceptions of their family quality of life (FQoL). To investigate key factors that may shape these experiences, we conducted a case-control study of sixty-one Spanish families (29 with a child with ASD) using a broad psychosocial assessment (e.g., ASD severity, social support, demographics), including the first direct test of the relationship between FQoL and parental risk literacy (i.e., the ability to evaluate and understand risk, as measured by numeracy). Results revealed that numeracy was associated with differences in perceived FQoL among families of children with ASD (R² = .10), a finding that held across several models statistically controlling for the influence of other variables. Findings suggest that parental risk literacy skills may generally be associated with differences in decision making vulnerabilities (e.g., risk evaluation and interpretation) that influence family outcomes including FQoL.

Testing a best practices risk result format to communicate genetic risks

OBJECTIVE

To investigate the effect of a genetic report format using risk communication "best-practices" on risk perceptions, in part to reduce risk overestimates.

METHODS

Adults (N = 470) from the Coriell Personalized Medicine Collaborative (CPMC) were randomized to a 2 × 2 experimental design to receive a hypothetical "personalized" genetic risk result for leukemia (relative risk = 1.5 or 2.5) through either the standard CPMC report (N = 232) or an enriched report informed by best practices (N = 238). A one-time, online survey assessed numeracy and risk perceptions including "feelings of risk" and a numerical estimate.

RESULTS

Regardless of numeracy, participants who received the enriched report had fewer overestimates of their lifetime risk estimate (LRE; odds ratio = 0.19, p < .001) and lower feelings of risk on two of three measures (p < .001). Participants with higher numeracy scores had fewer overestimates of LRE (OR = 0.66, p < .001) and lower feelings of risk on two out of three measures (p ≤ .01); the interaction between numeracy and report format was non-significant.

CONCLUSION

The enriched report produced more accurate LRE and lower risk perceptions regardless of numeracy level, suggesting the enriched format was helpful to individuals irrespective of numeracy ability.

PRACTICE IMPLICATIONS

Best practice elements in risk reports may help individuals form more accurate risk perceptions.

Tversky and Kahneman's Cognitive Illusions: Who Can Solve Them, and Why?

In the present paper we empirically investigate the psychometric properties of some of the most famous statistical and logical cognitive illusions from the "heuristics and biases" research program by Daniel Kahneman and Amos Tversky, who nearly 50 years ago introduced fascinating brain teasers such as the famous Linda problem, the Wason card selection task, and so-called Bayesian reasoning problems (e.g., the mammography task). In the meantime, a great number of articles has been published that empirically examine single cognitive illusions, theoretically explaining people's faulty thinking, or proposing and experimentally implementing measures to foster insight and to make these problems accessible to the human mind. Yet these problems have thus far usually been empirically analyzed on an individual-item level only (e.g., by experimentally comparing participants' performance on various versions of one of these problems). In this paper, by contrast, we examine these illusions as a group and look at the ability to solve them as a psychological construct. Based on an sample of N = 2,643 Luxembourgian school students of age 16-18 we investigate the internal psychometric structure of these illusions (i.e., Are they substantially correlated? Do they form a reflexive or a formative construct?), their connection to related constructs (e.g., Are they distinguishable from intelligence or mathematical competence in a confirmatory factor analysis?), and the question of which of a person's abilities can predict the correct solution of these brain teasers (by means of a regression analysis).

Visual analogies, not graphs, increase patients' comprehension of changes in their health status

OBJECTIVES

Patients increasingly use patient-reported outcomes (PROs) to self-monitor their health status. Visualizing PROs longitudinally (over time) could help patients interpret and contextualize their PROs. The study sought to assess hospitalized patients' objective comprehension (primary outcome) of text-only, non-graph, and graph visualizations that display longitudinal PROs.

MATERIALS AND METHODS

We conducted a clinical research study in 40 hospitalized patients comparing 4 visualization conditions: (1) text-only, (2) text plus visual analogy, (3) text plus number line, and (4) text plus line graph. Each participant viewed every condition, and we used counterbalancing (systematic randomization) to control for potential order effects. We assessed objective comprehension using the International Organization for Standardization protocol. Secondary outcomes included response times, preferences, risk perceptions, and behavioral intentions.

RESULTS

Overall, 63% correctly comprehended the text-only condition and 60% comprehended the line graph condition, compared with 83% for the visual analogy and 70% for the number line (P = .05) conditions. Participants comprehended the visual analogy significantly better than the text-only (P = .02) and line graph (P = .02) conditions. Of participants who comprehended at least 1 condition, 14% preferred a condition that they did not comprehend. Low comprehension was associated with worse cognition (P < .001), lower education level (P = .02), and fewer financial resources (P = .03).

CONCLUSIONS

The results support using visual analogies rather than text to display longitudinal PROs but caution against relying on graphs, which is consistent with the known high prevalence of inadequate graph literacy. The discrepancies between comprehension and preferences suggest factors other than comprehension influence preferences, and that future researchers should assess comprehension rather than preferences to guide presentation decisions.

Effectiveness of pictographs in improving patient education outcomes: a systematic review

The objective of this review was to investigate process of pictograph development and the effectiveness of pictographs in patient education. We conducted searches in Medline/PubMed, CINAHL with full text, PsycInfo, ERIC and Cochrane Library with keywords: (pictograph or pictorial) AND (patient education) NOT (children or adolescent or youth or child or teenagers). After excluding manuscripts that did not meet inclusion criteria, 56 articles were included between the time of the last review on this topic (January 2008) and May 2019. There are 17 descriptive studies, 27 randomized control trial studies, 9 quasi-experimental studies and 2 unique literatures in the systematic review. Major goals of the studies are pictograph development or validation. The majority of manuscripts (n = 48) supported the approach. However, six studies did not find significant differences in the outcome. Differences in patient population, pictograph designs and author-developed outcome measurements made it difficult to compare the findings. There is a lack of evidence on validating information outcome measurements. This review demonstrated that implementing pictographs into patient education is a promising approach for better information understanding and health management. Pictographic interventions need to be carefully developed and validated with both the targeted patient population and the clinical experts.

Current Challenges When Using Numbers in Patient Decision Aids: Advanced Concepts

BACKGROUND

Decision aid developers have to convey complex task-specific numeric information in a way that minimizes bias and promotes understanding of the options available within a particular decision. Whereas our companion paper summarizes fundamental issues, this article focuses on more complex, task-specific aspects of presenting numeric information in patient decision aids.

METHODS

As part of the International Patient Decision Aids Standards third evidence update, we gathered an expert panel of 9 international experts who revised and expanded the topics covered in the 2013 review working in groups of 2 to 3 to update the evidence, based on their expertise and targeted searches of the literature. The full panel then reviewed and provided additional revisions, reaching consensus on the final version.

RESULTS

Five of the 10 topics addressed more complex task-specific issues. We found strong evidence for using independent event rates and/or incremental absolute risk differences for the effect size of test and screening outcomes. Simple visual formats can help to reduce common judgment biases and enhance comprehension but can be misleading if not well designed. Graph literacy can moderate the effectiveness of visual formats and hence should be considered in tool design. There is less evidence supporting the inclusion of personalized and interactive risk estimates.

DISCUSSION

More complex numeric information. such as the size of the benefits and harms for decision options, can be better understood by using incremental absolute risk differences alongside well-designed visual formats that consider the graph literacy of the intended audience. More research is needed into when and how to use personalized and/or interactive risk estimates because their complexity and accessibility may affect their feasibility in clinical practice.

Development and testing of a frailty-focused communication (FCOM) aid for older adults

The concept of frailty as it pertains to aging, health and well-being is poorly understood by older adults and the public-at-large. We developed an aging and frailty education tool designed to improve layperson understanding of frailty and promote behavior change to prevent and/or delay frailty. We subsequently tested the education tool among adults who attended education sessions at 16 community sites. Specific aims were to: 1) determine acceptability (likeability, understandability) of content, and 2) assess the likelihood of behavior change after exposure to education tool content. Results: Over 90% of participants "liked" or "loved" the content and found it understandable. Eighty-five percent of participants indicated that the content triggered a desire to "probably" or "definitely" change behavior. The desire to change was particularly motivated by information about aging, frailty and energy production. Eight focus areas for proactive planning were rated as important or extremely important by over 90% of participants.

Receptivity of Hospitalized Older Adults and Family Caregivers to Prognostic Information about Aging, Injury, and Frailty: A Qualitative Study

BACKGROUND

Frailty is the leading prognosticator for poor outcomes and palliative care among older adults. Delivery of negative prognostic information entails potentially difficult conversations about decline and death.

OBJECTIVE

The study aims were to: 1) examine hospitalized older adults' and family caregivers' receptivity to general (vs. individualized) prognostic information about frailty, injury, and one-year outcomes; and 2) determine information needs based on prognostic information.

DESIGN

Provision of general prognostic information followed by semi-structured interview questions. We deductively analyzed qualitative data within the context of problematic integration theory.

SETTING

An academic medical center in the Southeast region of the U.S.

PARTICIPANTS

Purposive sampling was utilized to obtain a distribution of patients across the frailty continuum (non-frail [N=10], pre-frail [N=9], frail [9=6]). Twenty-five older adults (≥ age 65) hospitalized for a primary injury (e.g. fall) and 15 family caregivers of hospitalized patients were enrolled.

METHODS

Hospitalized older patients and family caregivers were shown prognostic information about one-year outcomes of injured older adults in the form of simple pictographs. Semi-structured interview questions were administered immediately afterwards. The interviews were audio-recorded, transcribed, and analyzed using qualitative content analysis. Demographic and medical information data were used to contextualize the responses during analysis.

RESULTS

Overall, participants (patients [56%], caregivers [73%]) were open to receiving prognostic information. A small number of family caregivers (N=3) expressed reservations about the frankness of the information and suggested delivery through a softer approach or not at all. Qualitative data was coded using categories and constructs of problematic integration theory. Four codes (personalizing the evidence, vivid understanding, downhill spiral, realities of aging) reflected probabilistic and evaluative orientation categories of problematic integration theory. One code (fatalism vs. hope) represented manifestations of ambivalence and ambiguity in the theory; and another code (exceptionalism) represented divergence and impossibility. Two codes (role of thought processes, importance of faith) reflected forms of resolutions as described in problematic integration theory. Information needs based on prognostic information revealed four additional codes: give it to me straight, what can I do? what can I expect? and how can I prevent decline? A consistently reported desire of both patients and caregivers was for honesty and hope from providers.

CONCLUSION

This study supports the use of general prognostic information in conversations about aging, injury, frailty and patient outcomes. Incorporating prognostic information into communication aids can facilitate shared decision making before end-of-life is imminent.

A New Visualization for Probabilistic Situations Containing Two Binary Events: The Frequency Net

In teaching statistics in secondary schools and at university, two visualizations are primarily used when situations with two dichotomous characteristics are represented: 2 × 2 tables and tree diagrams. Both visualizations can be depicted either with probabilities or with frequencies. Visualizations with frequencies have been shown to help students significantly more in Bayesian reasoning problems than probability visualizations do. Because tree diagrams or double-trees (which are largely unknown in school) are node-branch structures, these two visualizations (in contrast to the 2 × 2 table) can even simultaneously display probabilities on branches and frequencies inside the nodes. This is a teaching advantage as it allows the frequency concept to be used to better understand probabilities. However, 2 × 2 tables and (double-)trees have a decisive disadvantage: While joint probabilities [e.g., P(A∩B)] are represented in 2 × 2 tables but no conditional probabilities [e.g., P(A|B)], it is exactly the other way around with (double-)trees. Therefore, a visualization that is equally suitable for the representation of joint probabilities and conditional probabilities is desirable. In this article, we present a new visualization—the frequency net—in which all absolute frequencies and all types of probabilities can be depicted. In addition to a detailed theoretical analysis of the frequency net, we report the results of a study with 249 university students that shows that “net diagrams” can improve reasoning without previous instruction to a similar extent as 2 × 2 tables and double-trees. Regarding questions about conditional probabilities, frequency visualizations (2 × 2 table, double-tree, or net diagram with absolute frequencies) are consistently superior to probability visualizations, and the frequency net performs as well as the frequency double-tree. Only the 2 × 2 table with frequencies—the one visualization that participants were already familiar with—led to higher performance rates. If, on the other hand, a question about a joint probability had to be answered, all implemented visualizations clearly supported participants’ performance, but no uniform format effect becomes visible. Here, participants reached the highest performance in the versions with probability 2 × 2 tables and probability net diagrams. Furthermore, after conducting a detailed error analysis, we report interesting error shifts between the two information formats and the different visualizations and give recommendations for teaching probability.

Probability Size Matters: The Effect of Foreground-Only versus Foreground+Background Graphs on Risk Aversion Diminishes with Larger Probabilities

Graphs are increasingly recommended for improving decision-making and promoting risk-avoidant behaviors. Graphs that depict only the number of people affected by a risk ("foreground-only" displays) tend to increase perceived risk and risk aversion (e.g., willingness to get vaccinated), as compared to graphs that also depict the number of people at risk for harm ("foreground+background" displays). However, previous research examining these "foreground-only effects" has focused on relatively low-probability risks (<10%), limiting generalizability to communications about larger risks. In two experiments, we systematically investigated the moderating role of probability size on foreground-only effects, using a wide range of probability sizes (from 0.1% to 40%). Additionally, we examined the moderating role of the size of the risk reduction, that is, the extent to which a protective behavior reduces the risk. Across both experiments, foreground-only effects on perceived risk and risk aversion were weaker for larger probabilities. Experiment 2 also revealed that foreground-only effects were weaker for smaller risk reductions, while foreground-only displays decreased understanding of absolute risk magnitudes independently of probability size. These findings suggest that the greater effectiveness of foreground-only versus foreground+background displays for increasing perceived risk and risk aversion diminishes with larger probability sizes and smaller risk reductions. Moreover, if the goal is to promote understanding of absolute risk magnitudes, foreground+background displays should be used rather than foreground-only displays regardless of probability size. Our findings also help to refine and extend existing theoretical accounts of foreground-only effects to situations involving a wide range of probability sizes.

Illustrating Cancer Risk: Patient Risk Communication Preferences and Interest regarding a Novel BRCA1/2 Genetic Risk Modifier Test

INTRODUCTION

Genetic risk modifier testing (GRMT), an emerging form of genetic testing based on common single nucleotide polymorphisms and polygenic risk scores, has the potential to refine estimates of BRCA1/2 mutation carriers' breast cancer risks. However, for women to benefit from GRMT, effective approaches for communicating this novel risk information are needed.

OBJECTIVE

To evaluate patient preferences regarding risk communication materials for GRMT.

METHODS

We developed four separate presentations (panel of genes, icon array, verbal risk estimate, graphical risk estimate) of hypothetical GRMT results, each using varying risk communication strategies to convey different information elements including number of risk modifier variants present, variant prevalence among BRCA1/2 carriers, and implications and uncertainties of test results for cancer risk. Thirty BRCA1/2 carriers evaluated these materials (randomized to low, moderate, or high breast cancer risk versions). Qualitative and quantitative data were obtained through in-person interviews.

RESULTS

Across risk versions, participants preferred the presentation of the graphical risk estimate, often in combination with the verbal risk estimate. Interest in GRMT was high; 76.7% of participants wanted their own GRMT. Participants valued the potential for GRMT to clarify their cancer susceptibility and provide actionable information. Many (65.5%) anticipated that GRMT would make risk management decisions easier.

CONCLUSIONS

Women with BRCA1/2 mutations could be highly receptive to GRMT, and the minimal amount of necessary information to be included in result risk communication materials includes graphical and verbal estimates of future cancer risk. Findings will inform clinical translation of GRMT in a manner consistent with patients' preferences.

A New Video Aid for Communicating Risk in the Treatment of Pediatric Inflammatory Bowel Disease

Balancing risks of immune suppressive medications against risk of chronic disease is challenging for clinicians and families. Available aids commonly lack comparative information needed to inform treatment decisions. We developed a simple video aid to illustrate competing risks associated with medications and underlying disease in context of pediatric inflammatory bowel disease. Those who viewed the video aid had more realistic risk perceptions than those who did not view it. The video aid is adaptable for other conditions. It required only commonly accessible software and little cost, thereby making an aid of this style an attractive option for health care professionals interested in communicating comparative risk data to patients.

Usability and feasibility of consumer-facing technology to reduce unsafe medication use by older adults

BACKGROUND

Mobile health technology can improve medication safety for older adults, for instance, by educating patients about the risks associated with anticholinergic medication use.

OBJECTIVE

This study's objective was to test the usability and feasibility of Brain Buddy, a consumer-facing mobile health technology designed to inform and empower older adults to consider the risks and benefits of anticholinergics.

METHODS

Twenty-three primary care patients aged ≥60 years and using anticholinergic medications participated in summative, task-based usability testing of Brain Buddy. Self-report usability was assessed by the System Usability Scale and performance-based usability data were collected for each task through observation. A subset of 17 participants contributed data on feasibility, assessed by self-reported attitudes (feeling informed) and behaviors (speaking to a physician), with confirmation following a physician visit.

RESULTS

Overall usability was acceptable or better, with 100% of participants completing each Brain Buddy task and a mean System Usability Scale score of 78.8, corresponding to "Good" to "Excellent" usability. Observed usability issues included higher rates of errors, hesitations, and need for assistance on three tasks, particularly those requiring data entry. Among participants contributing to feasibility data, 100% felt better informed after using Brain Buddy and 94% planned to speak to their physician about their anticholinergic related risk. On follow-up, 82% reported having spoken to their physician, a rate independently confirmed by physicians.

CONCLUSION

Consumer-facing technology can be a low-cost, scalable intervention to improve older adults' medication safety, by informing and empowering patients. User-centered design and evaluation with demographically heterogeneous clinical samples uncovers correctable usability issues and confirms the value of interventions targeting consumers as agents in shared decision making and behavior change.

Development and pilot-testing of a colorectal cancer screening decision aid for individuals with varying health literacy levels

OBJECTIVE

Making an informed decision about colorectal cancer screening requires health literacy. Our aim was to develop and pilot-test a computer-based decision aid to support informed decision making about whether or not to participate in colorectal cancer screening for individuals with varying health literacy levels in the Netherlands.

METHODS

First, we designed and adapted the decision aid prototype among 25 individuals with low (n = 15) and adequate (n = 10) health literacy. Second, we used a before/after study to assess changes in knowledge, attitude, intention, decisional conflict, deliberation, anxiety and risk perception in an online survey among 81 individuals eligible for colorectal cancer screening with low (n = 35) and adequate (n = 46) health literacy.

RESULTS

The decision aid was acceptable, comprehensible, reduced decisional conflict, increased deliberation and improved knowledge about colorectal cancer screening, but not about colorectal cancer, among individuals with adequate and low health literacy. Usability was slightly higher for participants with adequate health literacy compared to those with low health literacy.

CONCLUSION

The decision aid is promising in supporting informed decision making about colorectal cancer screening, also among individuals with lower health literacy.

PRACTICE IMPLICATIONS

Further refinement of interactive features, such as videos, animations and the values clarification exercise, is needed to increase the usability of the decision aid.

Development of Pictograms for an Interactive Web Application to Help Hispanic Caregivers Learn About the Functional Stages of Dementia

Caregivers of persons with dementia need anticipatory guidance about the stages of dementia in order to prepare for the caregiving situations they will face. The study objective was to develop a set of pictograms representing the functional stages of dementia for eventual inclusion in a tailored, educational web application. We used a hybrid iterative participatory design process. A graphic designer prepared prototypes in a flat, minimalistic style. These were then culled and refined based on feedback from 16 Hispanic caregivers in six design sessions in English and Spanish. The resulting 19 pictograms representing the functional stages and substages of dementia were acceptable to and easily comprehended by participants. Short, plain-language captions support comprehension and aid discrimination between similar scenarios. Our participants preferred candid depictions of all aspects of dementia, including bodily functions, but acceptability may vary by population so further testing is warranted prior to deployment with a new population.