Graphics help patients distinguish between urgent and non-urgent deviations in laboratory test results

Enhancing Patient Understanding of Laboratory Test Results: Systematic Review of Presentation Formats and Their Impact on Perception, Decision, Action, and Memory

BACKGROUND

Direct access of patients to their web-based patient portal, including laboratory test results, has become increasingly common. Numeric laboratory results can be challenging to interpret for patients, which may lead to anxiety, confusion, and unnecessary doctor consultations. Laboratory results can be presented in different formats, but there is limited evidence regarding how these presentation formats impact patients' processing of the information.

OBJECTIVE

This study aims to synthesize the evidence on effective formats for presenting numeric laboratory test results with a focus on outcomes related to patients' information processing, including affective perception, perceived magnitude, cognitive perception, perception of communication, decision, action, and memory.

METHODS

The search was conducted in 3 databases (PubMed, Web of Science, and Embase) from inception until May 31, 2023. We included quantitative, qualitative, and mixed methods articles describing or comparing formats for presenting diagnostic laboratory test results to patients. Two reviewers independently extracted and synthesized the characteristics of the articles and presentation formats used. The quality of the included articles was assessed by 2 independent reviewers using the Mixed Methods Appraisal Tool.

RESULTS

A total of 18 studies were included, which were heterogeneous in terms of study design and primary outcomes used. The quality of the articles ranged from poor to excellent. Most studies (n=16, 89%) used mock test results. The most frequently used presentation formats were numerical values with reference ranges (n=12), horizontal line bars with colored blocks (n=12), or a combination of horizontal line bars with numerical values (n=8). All studies examined perception as an outcome, while action and memory were studied in 1 and 3 articles, respectively. In general, participants' satisfaction and usability were the highest when test results were presented using horizontal line bars with colored blocks. Adding reference ranges or personalized information (eg, goal ranges) further increased participants' perception. Additionally, horizontal line bars significantly decreased participants' tendency to search for information or to contact their physician, compared with numerical values with reference ranges.

CONCLUSIONS

In this review, we synthesized available evidence on effective presentation formats for laboratory test results. The use of horizontal line bars with reference ranges or personalized goal ranges increased participants' cognitive perception and perception of communication while decreasing participants' tendency to contact their physicians. Action and memory were less frequently studied, so no conclusion could be drawn about a single preferred format regarding these outcomes. Therefore, the use of horizontal line bars with reference ranges or personalized goal ranges is recommended to enhance patients' information processing of laboratory test results. Further research should focus on real-life settings and diverse presentation formats in combination with outcomes related to patients' information processing.

Harmonizing the post-analytical phase: focus on the laboratory report

The final, post-analytical, phase of laboratory testing is increasingly recognized as a fundamental step in maximizing quality and effectiveness of laboratory information. There is a need to close the loop of the total testing cycle by improving upon the laboratory report, and its notification to users. The harmonization of the post-analytical phase is somewhat complicated, mainly because it calls for communication that involves parties speaking different languages, including laboratorians, physicians, information technology specialists, and patients. Recently, increasing interest has been expressed in integrated diagnostics, defined as convergence of imaging, pathology, and laboratory tests with advanced information technology (IT). In particular, a common laboratory, radiology and pathology diagnostic reporting system that integrates text, sentinel images and molecular diagnostic data to an integrated, coherent interpretation enhances management decisions and improves quality of care.

"R" you getting this? Factors contributing to the public's understanding, evaluation, and use of basic reproduction numbers for infectious diseases

BACKGROUND

We (1) examined the effects of evaluative labels and visual aids on people's understanding, evaluation, and use of the COVID-19 reproduction number (or "r-number"), (2) examined whether people's perceived susceptibility and (intended) adherence to preventive measures changed after being exposed to the r-number, and (3) explored whether these effects and changes depended on people's numeracy skills.

METHODS

In an online experiment, participants from a large Dutch representative sample (N = 1,168) received information about the COVID-19 r-number displayed on the corona dashboard of the Dutch Ministry of Health, Welfare and Sport. The r-number was either presented with or without a categorical line display (i.e., evaluative label) and with or without an icon-based tree diagram (i.e., visual aid) explaining how the number works. Regarding people's use of the statistic, we measured perceived susceptibility to COVID-19 and adherence (intention) to five preventive measures before and after exposure to the r-number. After exposure, we also measured participants' understanding, perceived usefulness, affective and cognitive evaluation, and objective numeracy.

RESULTS

About 56% of participants correctly interpreted the r-number, with highly numerate people having better understanding than less numerate people. Information about the r-number was perceived as more useful when presented with a visual aid. There were no differences across experimental conditions in people's understanding, affective, and cognitive evaluations. Finally, independent of experimental conditions, intention to adhere to preventive measures was higher after seeing the r-number, but only among highly numerate people.

CONCLUSIONS

Although evaluative labels and visual aids did not facilitate people's understanding and evaluation of the r-number, our results show that the statistic is perceived as useful and may be used to stimulate adherence to preventive measures. Policy makers and public health communicators are advised to clearly explain why they are giving these numbers to - especially - the less numerate people, but also how people could use them for behavior change to combat the spread of virus during a pandemic.

Patient experiences with patient-led, home-based follow-up after curative treatment for colorectal cancer: a qualitative study

OBJECTIVES

The number of patients with colorectal cancer (CRC) in need of oncological follow-up is growing. As a response, patient-led, home-based follow-up (PHFU) was developed, implemented and assessed. The aim of this study was to investigate how patients experienced PHFU.

DESIGN

A qualitative study with individual semistructured interviews. Interviews were transcribed verbatim, and thematically analysed through an inductive, double-coding approach.

SETTING

A university medical centre in the Netherlands.

PARTICIPANTS

12 curatively treated patients with CRC who received PHFU were included after purposive sampling.

RESULTS

Overall, participants (N=12) were satisfied with PHFU. The time and cost-saving aspects for patient and hospital were evidently valued. PHFU was experienced as a shared effort, but patients felt like the primary responsibility remained in the hospital. Patients mentioned a decreased personal interaction with their healthcare provider (HCP) and felt a higher threshold to ask for help. However, all major questions were still addressed. Patients felt sufficiently competent to interpret their individual test results but experienced difficulty in interpreting repeated increases in carcinoembryonic antigen levels within the normal range. Educational status, age and a complicated disease course were seen as factors limiting the applicability of PHFU, and it was expressed that PHFU should be offered as an alternative instead of a novel standard of care.

CONCLUSIONS

According to patients, PHFU has great potential. However, PHFU may not be suitable for every CRC patient, and factors such as educational status, age and disease course should be taken into consideration. Patient and HCP have a shared responsibility to help successfully organise PHFU in practice.

A survey on perceived medication guide reading and comprehension ease among US adults

Medication guides (MGs) provide patients with important information about certain prescription drugs to help them take these drugs safely. We surveyed US residents about their perceptions of MG readability and understandability. We randomly sampled 5204 US residents (age 18+) from Ipsos's KnowledgePanel to complete a two-part survey. Only respondents who reported receiving an MG with their prescription drugs (n = 3852) completed part 2, which included two key items: How easy to [(1)read/(2)understand] are the MGs that you have received from a pharmacy along with your prescription medicines? (1 = Very easy, 5 = Very difficult; reverse-coded). Health literacy (HL) and demographic data were also collected. After weighting our data, we found that 85% of respondents who reported receiving an MG perceived this information as 'very easy' (27.3%), 'somewhat easy' (28.3%) or 'about average' (29.3%) to read. Eighty-seven percent of respondents who reported receiving an MG perceived it as 'very easy' (27.6%), 'somewhat easy' (30.2%) or 'about average' (29.5%) to understand. ANOVAs revealed higher average perceived MG reading and comprehension ease scores among respondents presumed to have adequate versus inadequate HL (ps ≤ 0.0006). Younger or less-educated respondents and non-Hispanic Blacks perceived MGs as easier to read and understand, on average, than their counterparts (ps ≤ 0.0001). Many of these relationships remained intact in models predicting perceived MG reading and comprehension ease (ps ≤ 0.001). Adjusted R2 values across models were small, however (≤0.06). Our findings suggest most US residents (18+) who received MGs perceived them to be 'about average' to 'very easy' to read and understand.

Visualizing machine learning-based predictions of postpartum depression risk for lay audiences

OBJECTIVES

To determine if different formats for conveying machine learning (ML)-derived postpartum depression risks impact patient classification of recommended actions (primary outcome) and intention to seek care, perceived risk, trust, and preferences (secondary outcomes).

MATERIALS AND METHODS

We recruited English-speaking females of childbearing age (18-45 years) using an online survey platform. We created 2 exposure variables (presentation format and risk severity), each with 4 levels, manipulated within-subject. Presentation formats consisted of text only, numeric only, gradient number line, and segmented number line. For each format viewed, participants answered questions regarding each outcome.

RESULTS

Five hundred four participants (mean age 31 years) completed the survey. For the risk classification question, performance was high (93%) with no significant differences between presentation formats. There were main effects of risk level (all P < .001) such that participants perceived higher risk, were more likely to agree to treatment, and more trusting in their obstetrics team as the risk level increased, but we found inconsistencies in which presentation format corresponded to the highest perceived risk, trust, or behavioral intention. The gradient number line was the most preferred format (43%).

DISCUSSION AND CONCLUSION

All formats resulted high accuracy related to the classification outcome (primary), but there were nuanced differences in risk perceptions, behavioral intentions, and trust. Investigators should choose health data visualizations based on the primary goal they want lay audiences to accomplish with the ML risk score.

Recentering responsible and explainable artificial intelligence research on patients: implications in perinatal psychiatry

In the setting of underdiagnosed and undertreated perinatal depression (PD), Artificial intelligence (AI) solutions are poised to help predict and treat PD. In the near future, perinatal patients may interact with AI during clinical decision-making, in their patient portals, or through AI-powered chatbots delivering psychotherapy. The increase in potential AI applications has led to discussions regarding responsible AI and explainable AI (XAI). Current discussions of RAI, however, are limited in their consideration of the patient as an active participant with AI. Therefore, we propose a patient-centered, rather than a patient-adjacent, approach to RAI and XAI, that identifies autonomy, beneficence, justice, trust, privacy, and transparency as core concepts to uphold for health professionals and patients. We present empirical evidence that these principles are strongly valued by patients. We further suggest possible design solutions that uphold these principles and acknowledge the pressing need for further research about practical applications to uphold these principles.

Do you want to promote recall, perceptions, or behavior? The best data visualization depends on the communication goal

Data visualizations can be effective and inclusive means for helping people understand health-related data. Yet numerous high-quality studies comparing data visualizations have yielded relatively little practical design guidance because of a lack of clarity about what communicators want their audience to accomplish. When conducting rigorous evaluations of communication (eg, applying the ISO 9186 method), describing the process simply as evaluating "comprehension" or "interpretation" of visualizations fails to do justice to the true range of outcomes being studied. We present newly developed taxonomies of outcome measures and tasks that are guiding a large-scale systematic review of the health numbers communication literature. Using these taxonomies allows a designer to determine whether a specific data presentation format or feature supports or inhibits the desired audience cognitions, feelings, or behaviors. We argue that taking a granular, outcomes-based approach to designing and evaluating information visualization research is essential to deriving practical, actionable knowledge from it.

Annotation and Information Extraction of Consumer-Friendly Health Articles for Enhancing Laboratory Test Reporting

Viewing laboratory test results is patients' most frequent activity when accessing patient portals, but lab results can be very confusing for patients. Previous research has explored various ways to present lab results, but few have attempted to provide tailored information support based on individual patient's medical context. In this study, we collected and annotated interpretations of textual lab result in 251 health articles about laboratory tests from AHealthyMe.com. Then we evaluated transformer-based language models including BioBERT, ClinicalBERT, RoBERTa, and PubMedBERT for recognizing key terms and their types. Using BioPortal's term search API, we mapped the annotated terms to concepts in major controlled terminologies. Results showed that PubMedBERT achieved the best F1 on both strict and lenient matching criteria. SNOMED CT had the best coverage of the terms, followed by LOINC and ICD-10-CM. This work lays the foundation for enhancing the presentation of lab results in patient portals by providing patients with contextualized interpretations of their lab results and individualized question prompts that they can, in turn, refer to during physician consults.

Evaluating the Landscape of Personal Health Records in Korea: Results of the National Health Informatization Survey

OBJECTIVES

This study examined the adoption and utilization of personal health records (PHR) across Korean medical institutions using data from the 2020 National Health and Medical Informatization Survey.

METHODS

Spearheaded by the Ministry of Health and Welfare and prominent academic societies, this study surveyed PHR utilization in 574 medical institutions.

RESULTS

Among these institutions, 84.9% (487 hospitals) maintained medical portals. However, just 14.1% (81 hospitals) had web-based or mobile PHRs, with 66.7% (28 of 42) of tertiary care hospitals adopting them. Tertiary hospitals led in PHR services: 87.8% offered certification issuance, 51.2% provided educational information, 63.4% supported online payment, and 95.1% managed appointment reservations. In contrast, general and smaller hospitals had lower rates. Online medical information viewing was prominent in tertiary hospitals (64.3%). Most patients accessed test results via PHRs, but other data types were less frequent, and only a few allowed downloads. Despite the widespread access to medical data through PHRs, integration with wearables and biometric data transfers to electronic medical records remained low, with limited plans for expansion in the coming three years.

CONCLUSIONS

Approximately two-thirds of the surveyed medical institutions provided PHRs, but hospitals and clinics in charge of community care had very limited PHR implementation. Government-led leadership is required to invigorate the use of PHRs in medical institutions.

Consumers' Needs for Laboratory Results Portals: Questionnaire Study

BACKGROUND

Over the last decade, there has been an increase in the number of health care consumers (ie, patients, citizens, and laypeople) with access to their laboratory results through portals. However, many portals are not designed with the consumer in mind, which can limit communication effectiveness and consumer empowerment.

OBJECTIVE

We aimed to study design facilitators and barriers affecting consumer use of a laboratory results portal. We sought to identify modifiable design attributes to inform future interface specifications and improve patient safety.

METHODS

A web-based questionnaire with open- and closed-ended items was distributed to consumers in British Columbia, Canada. Open-ended items with affinity diagramming and closed-ended questions with descriptive statistics were analyzed.

RESULTS

Participants (N=30) preferred reviewing their laboratory results through portals rather than waiting to see their provider. However, respondents were critical of the interface design (ie, interface usability, information completeness, and display clarity). Scores suggest there are display issues impacting communication that require urgent attention.

CONCLUSIONS

There are modifiable usability, content, and display issues associated with laboratory results portals that, if addressed, could arguably improve communication effectiveness, patient empowerment, and health care safety.

A RE-AIM Evaluation of a Visualization-Based Electronic Patient-Reported Outcome System

OBJECTIVES

Health care systems are primarily collecting patient-reported outcomes (PROs) for research and clinical care using proprietary, institution- and disease-specific tools for remote assessment. The purpose of this study was to conduct a Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) evaluation of a scalable electronic PRO (ePRO) reporting and visualization system in a single-arm study.

METHODS

The "mi.symptoms" ePRO system was designed using gerontechnological design principles to ensure high usability among older adults. The system enables longitudinal reporting of disease-agnostic ePROs and includes patient-facing PRO visualizations. We conducted an evaluation of the implementation of the system guided by the RE-AIM framework. Quantitative data were analyzed using basic descriptive statistics, and qualitative data were analyzed using directed content analysis.

RESULTS

Reach-the total reach of the study was 70 participants (median age: 69, 31% female, 17% Black or African American, 27% reported not having enough financial resources). Effectiveness-half (51%) of participants completed the 2-week follow-up survey and 36% completed all follow-up surveys. Adoption-the desire for increased self-knowledge, the value of tracking symptoms, and altruism motivated participants to adopt the tool. Implementation-the predisposing factor was access to, and comfort with, computers. Three enabling factors were incorporation into routines, multimodal nudges, and ease of use. Maintenance-reinforcing factors were perceived usefulness of viewing symptom reports with the tool and understanding the value of sustained symptom tracking in general.

CONCLUSION

Challenges in ePRO reporting, particularly sustained patient engagement, remain. Nonetheless, freely available, scalable, disease-agnostic systems may pave the road toward inclusion of a more diverse range of health systems and patients in ePRO collection and use.

The European Register of Specialists in Clinical Chemistry and Laboratory Medicine: code of conduct, version 3 - 2023

Whilst version 2 focussed on the professional conduct expected of a Specialist in Laboratory Medicine, version 3 builds on the responsibilities for ethical conduct from point of planning to point of care. Particular responsibilities that are outlined include: - The need for evidence when planning a new service, providing assurance that a new test does not do harm - Maintaining respect for patient confidentiality, their religious/ethnic beliefs, the need for informed consent to test, agreement on retrospective use of samples as part of governance envelopes in the pre-analytical phase - Ensuring respect for patient autonomy in the response to untoward results generated in the analytical phase - Supporting the safety of patients in the post-analytical phase through knowledge-based interpretation and presentation of results - The duty of candour to disclose and respond to error across the total testing process - Leading initiatives to harmonise and standardise pre-analytical, analytical and post-analytical phases to ensure more consistent clinical decision making with utilisation of demand management to ensure more equitable access to scarce resources - Working with emerging healthcare providers beyond the laboratory to ensure consistent application of high standards of clinical care In identifying opportunities for wider contributions to resolving ethical challenges across healthcare the need is also highlighted for more external quality assurance schemes and ethics-based quality indicators that span the total testing process.

Taxonomies for synthesizing the evidence on communicating numbers in health: Goals, format, and structure

Many people, especially those with low numeracy, are known to have difficulty interpreting and applying quantitative information to health decisions. These difficulties have resulted in a rich body of research about better ways to communicate numbers. Synthesizing this body of research into evidence-based guidance, however, is complicated by inconsistencies in research terminology and researcher goals. In this article, we introduce three taxonomies intended to systematize terminology in the literature, derived from an ongoing systematic literature review. The first taxonomy provides a systematic nomenclature for the outcome measures assessed in the studies, including perceptions, decisions, and actions. The second taxonomy is a nomenclature for the data formats assessed, including numbers (and different formats for numbers) and graphics. The third taxonomy describes the quantitative concepts being conveyed, from the simplest (a single value at a single point in time) to more complex ones (including a risk-benefit trade-off and a trend over time). Finally, we demonstrate how these three taxonomies can be used to resolve ambiguities and apparent contradictions in the literature.

A Physical Therapy Mobility Checkup for Older Adults: Feasibility and Participant Preferences From a Discrete Choice Experiment

PURPOSE

Physical performance measures, like walking speed, identify and predict preclinical mobility disability but are rarely used in routine medical care. A preventive model of care called Mobility Checkup is being designed to reduce mobility disability in older adults. This study had two purposes: 1) determine feasibility and outcomes of the Mobility Checkup, and 2) identify preferences of older adults regarding this model of care using a discrete choice experiment.

METHODS

Adults over 55 years of age were recruited from the community. In the study's first phase, participants completed a Mobility Checkup, with feasibility evaluated using 6 criteria. In the second phase, a new sample of older adults (>55 years old) were educated about the Mobility Checkup and then completed a discrete choice experiment to determine their preferences regarding 4 attributes of this care model: cost, visit duration, desired education topic, and style of educational graphic.

RESULTS

Each study phase was completed by 31 participants. Of the 6 feasibility criteria, 5 were met. Visit duration exceeded the 60-minute criteria for 13 of the 31 participants. Still, 91% of participants were very satisfied with the Mobility Checkup. Ability to transition positions identified preclinical mobility disability most frequently. A 30-minute visit with no out-of-pocket cost was deemed preferred.

CONCLUSIONS

Older adults value knowing what physical performance measurements predict about their general health. Transitions should be evaluated as part of a Mobility Checkup for older adults. Clearly conveyed cost of health care service is important to older adult consumers.

User-Centered System Design for Communicating Clinical Laboratory Test Results: Design and Evaluation Study

Background

Personal clinical data, such as laboratory test results, are increasingly being made available to patients via patient portals. However, laboratory test results are presented in a way that is difficult for patients to interpret and use. Furthermore, the indications of laboratory test results may vary among patients with different characteristics and from different medical contexts. To date, little is known about how to design patient-centered technology to facilitate the interpretation of laboratory test results.

Objective

The aim of this study is to explore design considerations for supporting patient-centered communication and comprehension of laboratory test results, as well as discussions between patients and health care providers.

Methods

We conducted a user-centered, multicomponent design research consisting of user studies, an iterative prototype design, and pilot user evaluations, to explore design concepts and considerations that are useful for supporting patients in not only viewing but also interpreting and acting upon laboratory test results.

Results

The user study results informed the iterative design of a system prototype, which had several interactive features: using graphical representations and clear takeaway messages to convey the concerning nature of the results; enabling users to annotate laboratory test reports; clarifying medical jargon using nontechnical verbiage and allowing users to interact with the medical terms (eg, saving, favoriting, or sorting); and providing pertinent and reliable information to help patients comprehend test results within their medical context. The results of a pilot user evaluation with 8 patients showed that the new patient-facing system was perceived as useful in not only presenting laboratory test results to patients in a meaningful way but also facilitating in situ patient-provider interactions.

Conclusions

We draw on our findings to discuss design implications for supporting patient-centered communication of laboratory test results and how to make technology support informative, trustworthy, and empathetic.

Patients' perceptions of using artificial intelligence (AI)-based technology to comprehend radiology imaging data

Results of radiology imaging studies are not typically comprehensible to patients. With the advances in artificial intelligence (AI) technology in recent years, it is expected that AI technology can aid patients' understanding of radiology imaging data. The aim of this study is to understand patients' perceptions and acceptance of using AI technology to interpret their radiology reports. We conducted semi-structured interviews with 13 participants to elicit reflections pertaining to the use of AI technology in radiology report interpretation. A thematic analysis approach was employed to analyze the interview data. Participants have a generally positive attitude toward using AI-based systems to comprehend their radiology reports. AI is perceived to be particularly useful in seeking actionable information, confirming the doctor's opinions, and preparing for the consultation. However, we also found various concerns related to the use of AI in this context, such as cyber-security, accuracy, and lack of empathy. Our results highlight the necessity of providing AI explanations to promote people's trust and acceptance of AI. Designers of patient-centered AI systems should employ user-centered design approaches to address patients' concerns. Such systems should also be designed to promote trust and deliver concerning health results in an empathetic manner to optimize the user experience.

Effect of AI Explanations on Human Perceptions of Patient-Facing AI-Powered Healthcare Systems

Ongoing research efforts have been examining how to utilize artificial intelligence technology to help healthcare consumers make sense of their clinical data, such as diagnostic radiology reports. How to promote the acceptance of such novel technology is a heated research topic. Recent studies highlight the importance of providing local explanations about AI prediction and model performance to help users determine whether to trust AI's predictions. Despite some efforts, limited empirical research has been conducted to quantitatively measure how AI explanations impact healthcare consumers' perceptions of using patient-facing, AI-powered healthcare systems. The aim of this study is to evaluate the effects of different AI explanations on people's perceptions of AI-powered healthcare system. In this work, we designed and deployed a large-scale experiment (N = 3,423) on Amazon Mechanical Turk (MTurk) to evaluate the effects of AI explanations on people's perceptions in the context of comprehending radiology reports. We created four groups based on two factors-the extent of explanations for the prediction (High vs. Low Transparency) and the model performance (Good vs. Weak AI Model)-and randomly assigned participants to one of the four conditions. Participants were instructed to classify a radiology report as describing a normal or abnormal finding, followed by completing a post-study survey to indicate their perceptions of the AI tool. We found that revealing model performance information can promote people's trust and perceived usefulness of system outputs, while providing local explanations for the rationale of a prediction can promote understandability but not necessarily trust. We also found that when model performance is low, the more information the AI system discloses, the less people would trust the system. Lastly, whether human agrees with AI predictions or not and whether the AI prediction is correct or not could also influence the effect of AI explanations. We conclude this paper by discussing implications for designing AI systems for healthcare consumers to interpret diagnostic report.

Visual analogies, not graphs, increase patients' comprehension of changes in their health status

OBJECTIVES

Patients increasingly use patient-reported outcomes (PROs) to self-monitor their health status. Visualizing PROs longitudinally (over time) could help patients interpret and contextualize their PROs. The study sought to assess hospitalized patients' objective comprehension (primary outcome) of text-only, non-graph, and graph visualizations that display longitudinal PROs.

MATERIALS AND METHODS

We conducted a clinical research study in 40 hospitalized patients comparing 4 visualization conditions: (1) text-only, (2) text plus visual analogy, (3) text plus number line, and (4) text plus line graph. Each participant viewed every condition, and we used counterbalancing (systematic randomization) to control for potential order effects. We assessed objective comprehension using the International Organization for Standardization protocol. Secondary outcomes included response times, preferences, risk perceptions, and behavioral intentions.

RESULTS

Overall, 63% correctly comprehended the text-only condition and 60% comprehended the line graph condition, compared with 83% for the visual analogy and 70% for the number line (P = .05) conditions. Participants comprehended the visual analogy significantly better than the text-only (P = .02) and line graph (P = .02) conditions. Of participants who comprehended at least 1 condition, 14% preferred a condition that they did not comprehend. Low comprehension was associated with worse cognition (P < .001), lower education level (P = .02), and fewer financial resources (P = .03).

CONCLUSIONS

The results support using visual analogies rather than text to display longitudinal PROs but caution against relying on graphs, which is consistent with the known high prevalence of inadequate graph literacy. The discrepancies between comprehension and preferences suggest factors other than comprehension influence preferences, and that future researchers should assess comprehension rather than preferences to guide presentation decisions.

The potential for overdiagnosis and underdiagnosis because of blood pressure variability: a comparison of the 2017 ACC/AHA, 2018 ESC/ESH and 2019 NICE hypertension guidelines

OBJECTIVE

To estimate the extent that BP measurement variability may drive over- and underdiagnosis of 'hypertension' when measurements are made according to current guidelines.

METHODS

Using data from the National Health and Nutrition Examination Survey and empirical estimates of within-person variability, we simulated annual SBP measurement sets for 1 000 000 patients over 5 years. For each measurement set, we used an average of multiple readings, as recommended by guidelines.

RESULTS

The mean true SBP for the simulated population was 118.8 mmHg with a standard deviation of 17.5 mmHg. The proportion overdiagnosed with 'hypertension' after five sets of office or nonoffice measurements using the 2017 American College of Cardiology guideline was 3-5% for people with a true SBP less than 120 mmHg, and 65-72% for people with a true SBP 120-130 mmHg. These proportions were less than 1% and 14-33% using the 2018 European Society of Hypertension and 2019 National Institute for Health and Care Excellence guidelines (true SBP <120 and 120-130 mmHg, respectively). The proportion underdiagnosed with 'hypertension' was less than 3% for people with true SBP at least 140 mmHg after one set of office or nonoffice measurements using the 2017 American College of Cardiology guideline, and less than 18% using the other two guidelines.

CONCLUSION

More people are at risk of overdiagnosis under the 2017 American College of Cardiology guideline than the other two guidelines, even if nonoffice measurements are used. Making clinical decisions about cardiovascular prediction based primarily on absolute risk, minimizes the impact of blood pressure variability on overdiagnosis.

Interventions to increase patient portal use in vulnerable populations: a systematic review

BACKGROUND

More than 100 studies document disparities in patient portal use among vulnerable populations. Developing and testing strategies to reduce disparities in use is essential to ensure portals benefit all populations.

OBJECTIVE

To systematically review the impact of interventions designed to: (1) increase portal use or predictors of use in vulnerable patient populations, or (2) reduce disparities in use.

MATERIALS AND METHODS

A librarian searched Ovid MEDLINE, EMBASE, CINAHL, and Cochrane Reviews for studies published before September 1, 2018. Two reviewers independently selected English-language research articles that evaluated any interventions designed to impact an eligible outcome. One reviewer extracted data and categorized interventions, then another assessed accuracy. Two reviewers independently assessed risk of bias.

RESULTS

Out of 18 included studies, 15 (83%) assessed an intervention's impact on portal use, 7 (39%) on predictors of use, and 1 (6%) on disparities in use. Most interventions studied focused on the individual (13 out of 26, 50%), as opposed to facilitating conditions, such as the tool, task, environment, or organization (SEIPS model). Twelve studies (67%) reported a statistically significant increase in portal use or predictors of use, or reduced disparities. Five studies (28%) had high or unclear risk of bias.

CONCLUSION

Individually focused interventions have the most evidence for increasing portal use in vulnerable populations. Interventions affecting other system elements (tool, task, environment, organization) have not been sufficiently studied to draw conclusions. Given the well-established evidence for disparities in use and the limited research on effective interventions, research should move beyond identifying disparities to systematically addressing them at multiple levels.

Numbers, graphs and words - do we really understand the lab test results accessible via the patient portals?

BACKGROUND

The heavy reliance on remote patient care (RPC) during the COVID-19 health crisis may have expedited the emergence of digital health tools that can contribute to safely and effectively moving the locus of care from the hospital to the community. Understanding how laypersons interpret the personal health information accessible to them via electronic patient records (EPRs) is crucial to healthcare planning and the design of services. Yet we still know little about how the format in which personal medical information is presented in the EPR (numerically, verbally, or graphically) affects individuals' understanding of the information, their assessment of its gravity, and the course of action they choose in response.

METHODS

We employed an online questionnaire to assess respondents' reactions to 10 medical decision-making scenarios, where the same information was presented using different formats. In each scenario, respondents were presented with real (anonymized) patient lab results using either numeric expressions, graphs, or verbal expressions. Participants were asked to assess the gravity of the hypothetical patient's condition and the course of action they would follow if they were that patient. The questionnaire was distributed to more than 300 participants, of whom 225 submitted usable responses.

RESULTS

Laypersons were more likely to overestimate the gravity of the information when it was presented either numerically or graphically compared to the narrative format. High perceived gravity was most likely to produce an inclination to actively seek medical attention, even when unwarranted. "Don't know" responses were most likely to produce an inclination to either search the Internet or wait for the doctor to call.

POLICY RECOMMENDATIONS

We discuss the study's implications for the effective design of lab results in the patient portals. We suggest (1) that graphs, tables, and charts would be easier to interpret if coupled with a brief verbal explanation; (2) that highlighting an overall level of urgency may be more helpful than indicating a diversion from the norm; and (3) that statements of results should include the type of follow-up required.

Understanding What Information Is Valued By Research Participants, And Why

There is growing public demand that research participants receive all of their results, regardless of whether clinical action is indicated. Instead of the standard practice of returning only actionable results, we propose a reconceptualization called "return of value" to encompass the varied ways in which research participants value specific results and more general information they receive beyond actionable results. Our proposal is supported by a national survey of a diverse sample, which found that receiving research results would be valuable to most (78.5 percent) and would make them more likely to trust researchers (70.3 percent). Respondents highly valued results revealing genetic effects on medication response and predicting disease risk, as well as information about nearby clinical trials and updates on how their data were used. The information most valued varied by education, race/ethnicity, and age. Policies are needed to enable return of information in ways that recognize participants' differing informational needs and values.

The national health information technology human factors and ergonomics agenda

Health information technology (IT) implementation has encompassed much of the United States health care system over the past decade, and user frustration with health IT has steadily increased. Human factors and ergonomics (HFE) methods and approaches can improve the design, implementation, and use of health IT for clinicians and consumers. To better understand the effect of federal HFE in health IT research funding, the authors conducted a review of several key, specific initiatives. The review focused on the goals and accomplishments of these initiatives. Findings to date show that HFE is improving the usefulness of health IT, but additional research and new methods are needed. Corresponding research funding and policy priorities are identified. New HFE work and innovative approaches are needed to capitalize on HFE knowledge, principles, and methods to improve the design, implementation, and use of health IT at a broader scale.

Older Adults Can Successfully Monitor Symptoms Using an Inclusively Designed Mobile Application

OBJECTIVES

Patient-Reported Outcomes Measurement Information System (PROMIS) measures can monitor patients with chronic illnesses outside of healthcare settings. Unfortunately, few applications that collect electronic PROMIS measures are designed using inclusive design principles that ensure wide accessibility and usability, thus limiting use by older adults with chronic illnesses. Our aim was to establish the feasibility of using an inclusively designed mobile application tailored to older adults to report PROMIS measures by examining (1) PROMIS scores collected with the application, (2) patient-reported usability of the application, and (3) differences in usability by age.

DESIGN

Cross-sectional feasibility study.

SETTING

Inpatient and outpatient cardiac units at an urban academic medical center.

PARTICIPANTS

A total of 168 English- and Spanish-speaking older adults with heart failure.

INTERVENTION

Participants used an inclusively designed mobile application to self-report PROMIS measures.

MEASUREMENTS

Eleven PROMIS Short-Form questionnaires (Anxiety, Ability to Participate in Social Roles and Activities, Applied Cognition-Abilities, Depression, Emotional Distress-Anger, Fatigue, Global Mental Health, Global Physical Health; Pain Interference, Physical Function, Sleep Disturbance), and a validated health technology usability survey measuring Perceived Ease-of-Use and Usefulness of the application.

RESULTS

Overall, 27% of participants were between 65 and 74 years of age, 10% were 75 years or older, 63% were male, 32% were white, and 96% had two or more medical conditions. There was no missing PROMIS data, and mean PROMIS scores showed the greatest burden of pain, fatigue, and physical function in the sample. Usability scores were high and not associated with age (Perceived Ease-of-Use P = .77; Perceived Usefulness P = .91).

CONCLUSION

It is feasible for older adults to use an inclusively designed application to report complete PROMIS data with high perceived usability. To ensure data completeness and the opportunity to study multiple domains of physical, mental, and social health, future work should use inclusive design principles for applications collecting PROMIS measures among older adults. J Am Geriatr Soc 68:1313-1318, 2020.

Are we teaching our students visual communication? Evaluation of writing assignments in public health

Visuals are an important means through which public health data can be communicated to diverse audiences, yet many public health students are not trained to develop effective visuals. We evaluated writing assignments from courses taught in public health schools and programmes accredited by the Council on Education for Public Health during the 2016-2017 academic year to identify whether they mentioned a visual element, whether the assignment explained how to create the visual, and if the visual element was worth points. Only 13 of 44 writing assignments mentioned a visual element and only two provided some instructions about how to create the visual element(s). Five assignments awarded points for visual elements. The lack of emphasis on visual elements in writing assignments is significant since visual communication is a key skill needed by practitioners to accompany writing to convey important public health information. Visual communication requires a critical thinking process and therefore time to develop the skills to create effective visuals is necessary. Thus, there is a crucial need for dedicated instruction for public health students to establish competence in visual communication.

Presenting self-monitoring test results for consumers: the effects of graphical formats and age

Objective

To examine the effects of graphical formats and age on consumers' comprehension and perceptions of the use of self-monitoring test results.

Methods

Participants (36 older and 36 young adults) were required to perform verbatim comprehension and value interpretation tasks with hypothetical self-monitoring test results. The test results were randomly presented by four reference range number lines: basic, color enhanced, color/text enhanced, and personalized information enhanced formats. We measured participants' task performance and eye movement data during task completion, and their perceptions and preference of the graphical formats.

Results

The 4 graphical formats yielded comparable task performance, while text/color and personalized information enhanced formats were believed to be easier and more useful in information comprehension, and led to increased confidence in correct comprehension of test results, compared with other formats (all p's < .05). Perceived health risk increased as the formats applied more information cues (p = .008). There were age differences in task performance and visual attention (all p's < .01), while young and older adults had similar perceptions for the 4 formats. Personalized information enhanced format was preferred by both groups.

Conclusions

Text/color and personalized information cues appear to be useful for comprehending test results. Future work can be directed to improve the design of graphical formats especially for older adults, and to assess the formats in clinical settings.

Communicating laboratory results to patients and families

People are increasingly able to access their laboratory results via patient portals. The potential benefits provided by such access, such as reductions in patient burden and improvements in patient satisfaction, disease management, and medical decision making, also come with potentially valid concerns about such results causing confusion or anxiety among patients. However, it is possible to clearly convey the meaning of results and, when needed, indicate required action by designing systems to present laboratory results adapted to the people who will use them. Systems should support people in converting the potentially meaningless data of results into meaningful information and actionable knowledge. We offer 10 recommendations toward this goal: (1) whenever possible, provide a clear takeaway message for each result. (2) Signal whether differences are meaningful or not. (3) When feasible, provide thresholds for concern and action. (4) Individualize the frame of reference by allowing custom reference ranges. (5) Ensure the system is accessible. (6) Provide conversion tools along with results. (7) Design in collaboration with users. (8) Design for both new and experienced users. (9) Make it easy for people use the data as they wish. (10) Collaborate with experts from relevant fields. Using these 10 methods and strategies renders access to laboratory results into meaningful and actionable communication. In this way, laboratories and medical systems can support patients and families in understanding and using their laboratory results to manage their health.

Report formatting in laboratory medicine - a call for harmony

The results of medical laboratory testing are only useful if they lead to appropriate actions by medical practitioners and/or patients. An underappreciated component of the medical testing process is the transfer of the information from the laboratory report into the reader's brain. The format of laboratory reports can be determined by the testing laboratory, which may issue a formatted report, or by electronic systems receiving information from laboratories and controlling the report format. As doctors can receive information from many laboratories, interpreting information from reports in a safe and rapid manner is facilitated by having similar report layouts and formats. Using Australia as an example, there is a wide variation in report formats in spite of a body of work to define standards for reporting. In addition to standardising of report formats, consideration needs to be given to optimisation of report formatting to facilitate rapid and unambiguous reading of the report and also interpretation of the data. Innovative report formats have been developed by some laboratories; however, wide adoption has not followed. The need to balance uniformity of reporting with appropriate innovation is a challenge for safe reporting of laboratory results. This paper discusses the current status and opportunity for improvement in safety and efficiency of the reading of laboratory reports, using current practise and developments in Australia as examples.

A Systematic Review of Patient-Facing Visualizations of Personal Health Data

OBJECTIVES

As personal health data are being returned to patients with increasing frequency and volume, visualizations are garnering excitement for their potential to facilitate patient interpretation. Evaluating these visualizations is important to ensure that patients are able to understand and, when appropriate, act upon health data in a safe and effective manner. The objective of this systematic review was to review and evaluate the state of the science of patient-facing visualizations of personal health data.

METHODS

We searched five scholarly databases (PubMed, Embase, Scopus, ACM Digital Library [Association for Computing Machinery Digital Library], and IEEE Computational Index [Institute of Electrical and Electronics Engineers Computational Index]) through December 1, 2018 for relevant articles. We included English-language articles that developed or tested one or more patient-facing visualizations for personal health data. Three reviewers independently assessed quality of included articles using the Mixed methods Appraisal Tool. Characteristics of included articles and visualizations were extracted and synthesized.

RESULTS

In 39 articles included in the review, there was heterogeneity in the sample sizes and methods for evaluation but not sample demographics. Few articles measured health literacy, numeracy, or graph literacy. Line graphs were the most common visualization, especially for longitudinal data, but number lines were used more frequently in included articles over past 5 years. Article findings suggested more patients understand the number lines and bar graphs compared with line graphs, and that color is effective at communicating risk, improving comprehension, and increasing confidence in interpretation.

CONCLUSION

In this review, we summarize types and components of patient-facing visualizations and methodologies for development and evaluation in the reviewed articles. We also identify recommendations for future work relating to collecting and reporting data, examining clinically actionable boundaries for diverse data types, and leveraging data science. This work will be critically important as patient access of their personal health data through portals and mobile devices continues to rise.

Helping Hispanic Family Caregivers of Persons With Dementia "Get the Picture" About Health Status Through Tailored Infographics

BACKGROUND AND OBJECTIVES

Caregivers need to understand their health status and the disabilities of the care recipient to engage in effective health management. Infographics tailored with personal health data are a promising approach to facilitating comprehension, particularly for individuals with low health literacy/limited English proficiency. Such approaches may be especially important for dementia caregivers given the high care burden.

RESEARCH DESIGN AND METHODS

Guided by the Health Belief Model and the Data-Frame Theory of Sensemaking, we conducted iterative participatory design sessions with Hispanic family caregivers (N = 16) of persons with dementia. We created multiple prototype infographic designs to display scores on validated instruments of topics such as caregiving burden, overall health, and psychological distress. We retained and refined designs participants judged to be easily comprehensible. Analysis focused on identifying the graphical elements that contributed to the comprehensibility of designs and on evaluating participants' reactions to the designs.

RESULTS

Successful infographics used intuitive scaling consistent with caregivers' perspective of dementia as inevitable decline. Participants reacted to infographics by describing the self-management actions they would take to address the health issue at hand.

DISCUSSION AND IMPLICATIONS

Tailored infographics supported caregivers' comprehension of their health status and served as cues to engaging in self-management. As such, they should be presented in the context of informational support that can facilitate selection of appropriate next steps. This can mitigate the potential mental and physical health consequences of caregiving and enable caregivers to continue to care for their relatives with dementia with less damage to their own well-being.

Design and Comprehension Testing of Tailored Asthma Control Infographics for Adults with Persistent Asthma

BACKGROUND

Adherence to daily inhaled corticosteroid medication is important for asthma control but low health literacy is a barrier to comprehension of control status and may contribute to medication nonadherence. Infographics tailored with patients' own data can support comprehension of health status, but these have not been applied to asthma successfully.

OBJECTIVES

This two-phased study developed and tested tailored infographics of (1) scores on the Asthma Control Questionnaire (ACQ), a self-report measure of symptom burden, and (2) pulmonary function test (PFT) results. The infographics are intended for use as communication and adherence-promotion tools in clinical interactions.

METHODS

For both phases, participants (18+ years, English- or Spanish-speaking, persistent asthma) were recruited through two primary care clinics. In Phase I, we used a hybrid iterative participatory design process to refine prototype designs. In Phase II, we conducted individual comprehension assessment interviews with the finalized designs. Infographics were hand-tailored for each participant using their ACQ score and PFT results collected at the start of the interview. Two independent raters scored interview transcripts for gist and verbatim comprehension based on a predetermined rubric.

RESULTS

The five Phase I design sessions led to final prototypes that participants (n = 21) considered appealing and easy to comprehend. All Phase II participants (n = 10) demonstrated complete gist and verbatim comprehension. Participants reacted favorably to receiving their information via infographics and expressed intentions to engage in self-management behaviors (e.g., medication adherence, smoking cessation, weight loss, and review of their care plan) in response to the information.

CONCLUSION

This study provides preliminary evidence that infographics can support comprehension of asthma control status and promote self-management intentions among adults with persistent asthma. Infographics can be programmed into electronic health records and/or standalone applications to allow for instant tailoring at the point of care.

Parental Perceptions of Displayed Patient Data in a PICU: An Example of Unintentional Empowerment

OBJECTIVES

To explore the perceptions of parents of pediatric patients in a PICU regarding real-time open electronic health record data displayed in patient rooms.

DESIGN

Cross-sectional qualitative interview study.

SETTING

PICU in a large Midwestern tertiary-care children's hospital.

SUBJECTS

Parents of patients in a PICU (n = 33).

MEASUREMENTS AND MAIN RESULTS

Qualitative data were collected through in-person semi-structured, individual, and small-group interviews. Data were collected from March 2016 to July 2016, with approval from the study hospital's institutional review board. Data were analyzed using inductive thematic analysis. Results included positive effects of accessing real-time open electronic health record data on family empowerment, situation awareness, potential error detection, understanding of medical data, and facilitating discussions during rounds. Concerns were reported regarding privacy of information as well as potential misinterpretation of displayed data. We identified several ways to improve this collaborative technology to make it more family-centered.

CONCLUSIONS

This study suggests that a new health information technology system providing continuous access to open electronic health record data may be an effective way to empower and engage parents in the PICU, but potential drawbacks were also noted. The results also provide insights into the collaborative use of health information technology in the PICU setting.

Reference range number line format preferred by adults for display of asthma control status

Objective: Optimal asthma self-management requires an accurate understanding of one's asthma control status. Tailored infographics are a promising way of conveying status information but little is known about which formats are effective at supporting comprehension while also being appealing to adults with asthma.Methods: In this focus group study, we compared two formats to display Asthma Control Questionnaire (ACQ) scores: a stoplight graphic and a reference range number line (RRNL).Results: Both formats supported comprehension but the RRNL was strongly preferred for its informativeness and for cueing participants to consider the self-management strategies they should undertake to improve their asthma control.Conclusions: The RRNL format may have broad appeal and can be adapted to numerous clinical variables for low health literacy patient-facing displays, as in patient portals. However, until viewers are familiar with the format, use as a communication tool in the context of a clinical visit is recommended to forestall undue alarm over abnormal/out-of-range values.

Helping People Know Whether Measurements Have Good or Bad Implications: Increasing the Evaluability of Health and Science Data Communications

Patients, policy makers, and the public have access to many types of health and scientific data relevant to various individual and societal decisions. Yet, these audiences often struggle with the meaning and the potential usefulness of those data, so they may choose not to engage with the data at all. Scientific and health data are generally difficult to interpret, yet presentations often implicitly assume that the recipient has the necessary contextual knowledge to identify the data’s meaning. To address this problem, designers of data communications should go beyond considering audience characteristics (e.g., numeracy) and focus more on increasing information evaluability (a concept from the judgment and decision-making literatures). The challenge is understanding which data characteristics guide people’s ability to extract meaning from data in a given situation. Prioritizing use-relevant contextual information (e.g., by defining action thresholds, comparison standards, meaningful categories, and/or significant differences) is the single best thing experts can do to improve data communication effectiveness. Doing so increases the chances that the patient, public, or policy maker audience does not just know what their numbers are but also what they mean.

Effects of presentation formats on consumers' performance and perceptions in the use of personal health records among older and young adults

OBJECTIVE

To examine the effects of presentation formats on consumers' performance and perceptions in the use of personal health records (PHRs) and to compare the effects between older and young adults.

METHODS

A two-factor, mixed design experiment was conducted, where 36 older and 36 young participants were presented with hypothetical PHRs. The PHRs were randomly presented by six presentation formats: three tables and three line graphs, varying by visual cues. Participants' performance and perceptions in the use of PHRs were measured.

RESULTS

Presentation formats affected participants' performance and perceptions. Visual cue-enhanced line graphs and tables yielded less time and fewer errors, were considered easier and more useful in information comprehension, and resulted in higher confidence in correct comprehension of PHRs (all p's < 0.01), compared with their basic counterparts. There were age-related differences in task performance (all p's < 0.05), while young and older adults had similar perceptions for the six formats. Line graph with colored background was most preferred by both groups.

CONCLUSION

Visual cue-enhanced presentation formats appear effective in facilitating comprehension and eliciting favorable perceptions of PHRs for both young and older adults.

PRACTICE IMPLICATIONS

Consumer-facing displays of PHRs could use visual cue-enhanced presentation formats to facilitate comprehension.

Digital networks for laboratory data: potentials, barriers and current initiatives

Medical care is increasingly delivered by multiple providers across healthcare sectors and specialties, leading to a fragmentation of the electronic patient record across organizations and vendor IT systems. The rapid uptake of wearables and connected diagnostic devices adds another source of densely collected data by the patients themselves. Integration of these data sources opens up several potentials: a longitudinal view of laboratory findings would close the gaps between individual provider visits and allow to more closely follow disease progression. Adding non-laboratory data (e.g. diagnoses, procedures) would add context and support clinical interpretation of findings. Case-based reasoning and disease-modelling approaches would allow to identify similar patient groups and classify endotypes. Realization of these potentials is, however, subject to several barriers, including legal and ethical prerequisites of data access, syntactic and semantic integration, comparability of items and user-centered presentation. The German Medical Informatics Initiative is presented as a current undertaking that strives to address these issues by establishing a national infrastructure for the secondary use of routine clinical data.

Testing a novel audit and feedback method for hand hygiene compliance: A multicenter quality improvement study

OBJECTIVE

Although most hospitals report very high levels of hand hygiene compliance (HHC), the accuracy of these overtly observed rates is questionable due to the Hawthorne effect and other sources of bias. In the study, we aimed (1) to compare HHC rates estimated using the standard audit method of overt observation by a known observer and a new audit method that employed a rapid (&lt;15 minutes) "secret shopper" method and (2) to pilot test a novel feedback tool.

DESIGN

Quality improvement project using a quasi-experimental stepped-wedge design.

SETTING

This study was conducted in 5 acute-care hospitals (17 wards, 5 intensive care units) in the Midwestern United States.

METHODS

Sites recruited a hand hygiene observer from outside the acute-care units to rapidly and covertly observe entry and exit HHC during the study period, October 2016-September 2017. After 3 months of observations, sites received a monthly feedback tool that communicated HHC information from the new audit method.

RESULTS

The absolute difference in HHC estimates between the standard and new audit methods was ~30%. No significant differences in HHC were detected between the baseline and feedback phases (OR, 0.92; 95% CI, 0.84-1.01), but the standard audit method had significantly higher estimates than the new audit method (OR, 9.83; 95% CI, 8.82-10.95).

CONCLUSIONS

HHC estimates obtained using the new audit method were substantially lower than estimates obtained using the standard audit method, suggesting that the rapid, secret-shopper method is less subject to bias. Providing feedback using HHC from the new audit method did not seem to impact HHC behaviors.

Improving the Understanding of Test Results by Substituting (Not Adding) Goal Ranges: Web-Based Between-Subjects Experiment

BACKGROUND

Most displays of laboratory test results include a standard reference range. For some patients (eg, those with chronic conditions), however, getting a result within the standard range may be unachievable, inappropriate, or even harmful.

OBJECTIVE

The objective of our study was to test the impact of including clinically appropriate goal ranges outside the standard range in the visual displays of laboratory test results.

METHODS

Participants (N=6776) from a demographically diverse Web-based panel viewed hypothetical glycated hemoglobin (HbA1c) test results (HbA1c either 6.2% or 8.2%) as part of a type 2 diabetes management scenario. Test result visual displays included either a standard range (4.5%-5.7%) only, a goal range (6.5%-7.5%) added to the standard range, or the goal range only. The results were displayed in 1 of the following 3 display formats: (1) a table; (2) a simple, two-colored number line (simple line); or (3) a number line with diagnostic categories indicated via colored blocks (block line). Primary outcome measures were comprehension of and negative reactions to test results.

RESULTS

While goal range information did not influence the understanding of HbA1c=8.2% results, the goal range only display produced higher levels of comprehension and decreased negative reactions to HbA1c=6.2% test results compared with the no goal range and goal range added conditions. Goal range information was less helpful in the block line condition versus the other formats.

CONCLUSIONS

Replacing the standard range with a clinically appropriate goal range could help patients better understand how their test results relate to their personal targets.

A Patient-Facing Diabetes Dashboard Embedded in a Patient Web Portal: Design Sprint and Usability Testing

Background

Health apps and Web-based interventions designed for patients with diabetes offer novel and scalable approaches to engage patients and improve outcomes. However, careful attention to the design and usability of these apps and Web-based interventions is essential to reduce the barriers to engagement and maximize use.

Objective

The aim of this study was to apply design sprint methodology paired with mixed-methods, task-based usability testing to design and evaluate an innovative, patient-facing diabetes dashboard embedded in an existing patient portal and integrated into an electronic health record.

Methods

We applied a 5-day design sprint methodology developed by Google Ventures (Alphabet Inc, Mountain View, CA) to create our initial dashboard prototype. We identified recommended strategies from the literature for using patient-facing technologies to enhance patient activation and designed a dashboard functionality to match each strategy. We then conducted a mixed-methods, task-based usability assessment of dashboard prototypes with individual patients. Measures included validated metrics of task performance on 5 common and standardized tasks, semistructured interviews, and a validated usability satisfaction questionnaire. After each round of usability testing, we revised the dashboard prototype in response to usability findings before the next round of testing until the majority of participants successfully completed tasks, expressed high satisfaction, and identified no new usability concerns (ie, stop criterion was met).

Results

The sample (N=14) comprised 5 patients in round 1, 3 patients in round 2, and 6 patients in round 3, at which point we reached our stop criterion. The participants’ mean age was 63 years (range 45-78 years), 57% (8/14) were female, and 50% (7/14) were white. Our design sprint yielded an initial patient-facing diabetes dashboard prototype that displayed and summarized 5 measures of patients’ diabetes health status (eg, hemoglobin A_1c). The dashboard used graphics to visualize and summarize health data and reinforce understanding, incorporated motivational strategies (eg, social comparisons and gamification), and provided educational resources and secure-messaging capability. More than 80% of participants were able to successfully complete all 5 tasks using the final prototype. Interviews revealed usability concerns with design, the efficiency of use, and content and terminology, which led to improvements. Overall satisfaction (0=worst and 7=best) improved from the initial to the final prototype (mean 5.8, SD 0.4 vs mean 6.7, SD 0.5).

Conclusions

Our results demonstrate the utility of the design sprint methodology paired with mixed-methods, task-based usability testing to efficiently and effectively design a patient-facing, Web-based diabetes dashboard that is satisfying for patients to use.

Methods for Patient-Centered Interface Design of Test Result Display in Online Portals

OBJECTIVES

Patients have unique information needs to help them interpret and make decisions about laboratory test results they receive on web-based portals. However, current portals are not designed in a patient-centered way and little is known on how best to harness patients' information needs to inform user-centered interface design of portals. We designed a patient-facing laboratory test result interface prototype based on requirement elicitation research and used a mixed-methods approach to evaluate this interface.

METHODS

After designing an initial test result display prototype, we used multiple evaluation methods, including focus group review sessions, expert consultation, and user testing, to make iterative design changes. For the user testing component, we recruited 14 patient-users to collect and analyze three types of data: comments made during testing sessions, responses to post-session questionnaires, and system usability scores.

RESULTS

Our initial patient-centered interface design included visual ranges of laboratory values, nontechnical descriptions of the test and result, and access to features to help patients interpret and make decisions about their results. Findings from our evaluation resulted in 6 design iterations of the interface. Results from user testing indicate that the later versions of the interface fulfilled patient's information needs, were perceived as usable, and provided access to information and techniques that facilitated patient's ability to derive meaning from each test result.

CONCLUSIONS

Requirement elicitation studies can inform the design of a patient-facing test result interface, but considerable user-centered design efforts are necessary to create an interface that patients find useful. To promote patient engagement, health information technology designers and developers can use similar approaches to enhance user-centered software design in patient portals.

Methods for Patient-Centered Interface Design of Test Result Display in Online Portals

Objectives:

Patients have unique information needs to help them interpret and make decisions about laboratory test results they receive on web-based portals. However, current portals are not designed in a patient-centered way and little is known on how best to harness patients’ information needs to inform user-centered interface design of portals. We designed a patient-facing laboratory test result interface prototype based on requirement elicitation research and used a mixed-methods approach to evaluate this interface.

Methods:

After designing an initial test result display prototype, we used multiple evaluation methods, including focus group review sessions, expert consultation, and user testing, to make iterative design changes. For the user testing component, we recruited 14 patient-users to collect and analyze three types of data: comments made during testing sessions, responses to post-session questionnaires, and system usability scores.

Results:

Our initial patient-centered interface design included visual ranges of laboratory values, nontechnical descriptions of the test and result, and access to features to help patients interpret and make decisions about their results. Findings from our evaluation resulted in 6 design iterations of the interface. Results from user testing indicate that the later versions of the interface fulfilled patient’s information needs, were perceived as usable, and provided access to information and techniques that facilitated patient’s ability to derive meaning from each test result.

Conclusions:

Requirement elicitation studies can inform the design of a patient-facing test result interface, but considerable user-centered design efforts are necessary to create an interface that patients find useful. To promote patient engagement, health information technology designers and developers can use similar approaches to enhance user-centered software design in patient portals.

Methods for Patient-Centered Interface Design of Test Result Display in Online Portals

OBJECTIVES

Patients have unique information needs to help them interpret and make decisions about laboratory test results they receive on web-based portals. However, current portals are not designed in a patient-centered way and little is known on how best to harness patients' information needs to inform user-centered interface design of portals. We designed a patient-facing laboratory test result interface prototype based on requirement elicitation research and used a mixed-methods approach to evaluate this interface.

METHODS

After designing an initial test result display prototype, we used multiple evaluation methods, including focus group review sessions, expert consultation, and user testing, to make iterative design changes. For the user testing component, we recruited 14 patient-users to collect and analyze three types of data: comments made during testing sessions, responses to post-session questionnaires, and system usability scores.

RESULTS

Our initial patient-centered interface design included visual ranges of laboratory values, nontechnical descriptions of the test and result, and access to features to help patients interpret and make decisions about their results. Findings from our evaluation resulted in 6 design iterations of the interface. Results from user testing indicate that the later versions of the interface fulfilled patient's information needs, were perceived as usable, and provided access to information and techniques that facilitated patient's ability to derive meaning from each test result.

CONCLUSIONS

Requirement elicitation studies can inform the design of a patient-facing test result interface, but considerable user-centered design efforts are necessary to create an interface that patients find useful. To promote patient engagement, health information technology designers and developers can use similar approaches to enhance user-centered software design in patient portals.

Supporting Collaborative Health Tracking in the Hospital: Patients' Perspectives

The hospital setting creates a high-stakes environment where patients' lives depend on accurate tracking of health data. Despite recent work emphasizing the importance of patients' engagement in their own health care, less is known about how patients track their health and care in the hospital. Through interviews and design probes, we investigated hospitalized patients' tracking activity and analyzed our results using the stage-based personal informatics model. We used this model to understand how to support the tracking needs of hospitalized patients at each stage. In this paper, we discuss hospitalized patients' needs for collaboratively tracking their health with their care team. We suggest future extensions of the stage-based model to accommodate collaborative tracking situations, such as hospitals, where data is collected, analyzed, and acted on by multiple people. Our findings uncover new directions for HCI research and highlight ways to support patients in tracking their care and improving patient safety.

Role of laboratory medicine in collaborative healthcare

Healthcare delivery and responsibility is changing. Patient-centered care is gaining international acceptance with the patient taking greater responsibility for his/her health and sharing decision making for the diagnosis and management of illness. Laboratory medicine must embrace this change and work in a tripartite collaboration with patients and with the clinicians who use clinical laboratory services. Improved communication is the key to participation, including the provision of educational information and support. Knowledge management should be targeted to each stakeholder group. As part of collaborative healthcare clinical laboratory service provision needs to be more flexible and available, with implications for managers who oversee the structure and governance of the service. Increased use of managed point of care testing will be essential. The curriculum content of laboratory medicine training programs will require trainees to undertake practice-based learning that facilitates interaction with patients, clinicians and managers. Continuing professional development for specialists in laboratory medicine should also embrace new sources of information and opportunities for collaborative healthcare.

Patient perceptions of receiving test results via online portals: a mixed-methods study

Objective

Online portals provide patients with access to their test results, but it is unknown how patients use these tools to manage results and what information is available to promote understanding. We conducted a mixed-methods study to explore patients' experiences and preferences when accessing their test results via portals.

Materials and Methods

We conducted 95 interviews (13 semistructured and 82 structured) with adults who viewed a test result in their portal between April 2015 and September 2016 at 4 large outpatient clinics in Houston, Texas. Semistructured interviews were coded using content analysis and transformed into quantitative data and integrated with the structured interview data. Descriptive statistics were used to summarize the structured data.

Results

Nearly two-thirds (63%) did not receive any explanatory information or test result interpretation at the time they received the result, and 46% conducted online searches for further information about their result. Patients who received an abnormal result were more likely to experience negative emotions (56% vs 21%; P = .003) and more likely to call their physician (44% vs 15%; P = .002) compared with those who received normal results.

Discussion

Study findings suggest that online portals are not currently designed to present test results to patients in a meaningful way. Patients experienced negative emotions often with abnormal results, but sometimes even with normal results. Simply providing access via portals is insufficient; additional strategies are needed to help patients interpret and manage their online test results.

Conclusion

Given the absence of national guidance, our findings could help strengthen policy and practice in this area and inform innovations that promote patient understanding of test results.