Visual Analytic Tools and Techniques in Population Health and Health Services Research: Scoping Review

VisualSphere: a Web-based Interactive Visualization System for Clinical Research Data

Clinical research data visualization is integral to making sense of biomedical research and healthcare data. The complexity and diversity of data, along with the need for solid programming skills, can hinder advances in clinical research data visualization. To overcome these challenges, we introduce VisualSphere, a web-based interactive visualization system that directly interfaces with clinical research data repositories, streamlining and simplifying the visualization workflow. VisualSphere is founded on three primary component modules: Connection, Configuration, and Visualization. An end-user can set up connections to the data repositories, create charts by selecting the desired tables and variables, and render visualization dashboards generated by Plotly and R/Shiny. We performed a preliminary evaluation of VisualSphere, which achieved high user satisfaction. VisualSphere has the potential to serve as a versatile tool for various clinical research data repositories, enabling researchers to explore and interact with clinical research data efficiently and effectively.

National Public Health Dashboards: Protocol for a Scoping Review

BACKGROUND

The COVID-19 pandemic highlighted the importance of robust public health data systems and the potential utility of data dashboards for ensuring access to critical public health data for diverse groups of stakeholders and decision makers. As dashboards are becoming ubiquitous, it is imperative to consider how they may be best integrated with public health data systems and the decision-making routines of diverse audiences. However, additional progress on the continued development, improvement, and sustainability of these tools requires the integration and synthesis of a largely fragmented scholarship regarding the purpose, design principles and features, successful implementation, and decision-making supports provided by effective public health data dashboards across diverse users and applications.

OBJECTIVE

This scoping review aims to provide a descriptive and thematic overview of national public health data dashboards including their purpose, intended audiences, health topics, design elements, impact, and underlying mechanisms of use and usefulness of these tools in decision-making processes. It seeks to identify gaps in the current literature on the topic and provide the first-of-its-kind systematic treatment of actionability as a critical design element of public health data dashboards.

METHODS

The scoping review follows the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews) guidelines. The review considers English-language, peer-reviewed journal papers, conference proceedings, book chapters, and reports that describe the design, implementation, and evaluation of a public health dashboard published between 2000 and 2023. The search strategy covers scholarly databases (CINAHL, PubMed, Medline, and Web of Science) and gray literature sources and uses snowballing techniques. An iterative process of testing for and improving intercoder reliability was implemented to ensure that coders are properly trained to screen documents according to the inclusion criteria prior to beginning the full review of relevant papers.

RESULTS

The search process initially identified 2544 documents, including papers located via databases, gray literature searching, and snowballing. Following the removal of duplicate documents (n=1416), nonrelevant items (n=839), and items classified as literature reviews and background information (n=73), 216 documents met the inclusion criteria: US case studies (n=90) and non-US case studies (n=126). Data extraction will focus on key variables, including public health data characteristics; dashboard design elements and functionalities; intended users, usability, logistics, and operation; and indicators of usefulness and impact reported.

CONCLUSIONS

The scoping review will analyze the goals, design, use, usefulness, and impact of public health data dashboards. The review will also inform the continued development and improvement of these tools by analyzing and synthesizing current practices and lessons emerging from the literature on the topic and proposing a theory-grounded and evidence-informed framework for designing, implementing, and evaluating public health data dashboards.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/52843.

Roles of Health Literacy in Relation to Social Determinants of Health and Recommendations for Informatics-Based Interventions: Systematic Review

BACKGROUND

Health literacy (HL) is the ability to make informed decisions using health information. As health data and information availability increase due to online clinic notes and patient portals, it is important to understand how HL relates to social determinants of health (SDoH) and the place of informatics in mitigating disparities.

OBJECTIVE

This systematic literature review aims to examine the role of HL in interactions with SDoH and to identify feasible HL-based interventions that address low patient understanding of health information to improve clinic note-sharing efficacy.

METHODS

The review examined 2 databases, Scopus and PubMed, for English-language articles relating to HL and SDoH. We conducted a quantitative analysis of study characteristics and qualitative synthesis to determine the roles of HL and interventions.

RESULTS

The results (n=43) were analyzed quantitatively and qualitatively for study characteristics, the role of HL, and interventions. Most articles (n=23) noted that HL was a result of SDoH, but other articles noted that it could also be a mediator for SdoH (n=6) or a modifiable SdoH (n=14) itself.

CONCLUSIONS

The multivariable nature of HL indicates that it could form the basis for many interventions to combat low patient understandability, including 4 interventions using informatics-based solutions. HL is a crucial, multidimensional skill in supporting patient understanding of health materials. Designing interventions aimed at improving HL or addressing poor HL in patients can help increase comprehension of health information, including the information contained in clinic notes shared with patients.

Assessing a Digital Scorecard on Global Immunization Progress: Stakeholder Views and Implications for Enhancing Performance and Accountability

Global health agencies and regional and national stakeholders collaborated to develop the Immunization Agenda 2030 Scorecard, a digital data visualization platform displaying global, regional, and country-level immunization progress. The scorecard serves to focus attention and enable strategic actions around the measures visualized. To assess the scorecard's usability, appropriateness, and context for use, we interviewed 15 immunization officers working across five global regions. To further understand the implementation context, we also reviewed the characteristics of 15 public platforms visualizing population health data. We integrated thematic findings across both methods. Many platforms highlight service gaps and enable comparisons between geographies to foster political pressure for service improvements. We observed heterogeneity regarding the platforms' focus areas and participants' leading concerns, which were management capacity and resourcing. Furthermore, one-third of platforms were out of date. Results yielded recommendations for the scorecard, which participants felt was well suited to focus the attention of decision makers on key immunization data. A simpler design coupled with implementation strategies that more actively engage policymakers would better align the scorecard with other public platforms engaging intended users. For population health platforms to serve as effective accountability mechanisms, studying implementation determinants, including usability testing, is vital to meet stakeholder needs.

Assessing the Quality of YouTube's Incontinence Information after Cancer Surgery: An Innovative Graphical Analysis

BACKGROUND

Prostate and colorectum cancers rank among the most common cancers, and incontinence is a significant postsurgical issue affecting the physical and psychological well-being of cancer survivors. Social media, particularly YouTube, has emerged as a vital source of health information. While YouTube offers valuable content, users must exercise caution due to potential misinformation.

OBJECTIVE

This study aims to assess the quality of publicly available YouTube videos related to incontinence after pelvic cancer surgery.

METHODS

A search on YouTube related to "Incontinence after cancer surgery" was performed, and 108 videos were analyzed. Multiple quality assessment tools (DISCERN, GQS, JAMA, PEMAT, and MQ-VET) and statistical analyses (descriptive statistics and intercorrelation tests) were used to evaluate the characteristics and popularity, educational value, quality, and reliability of these videos, relying on novel graphical representation techniques such as Sankey and Chord diagrams.

RESULTS

Strong positive correlations were found among quality rating scales, emphasizing agreement. The performed graphical analysis reinforced the reliability and validity of quality assessments.

CONCLUSIONS

This study found strong correlations among five quality scales, suggesting their effectiveness in assessing health information quality. The evaluation of YouTube videos consistently revealed "high" quality content. Considering the source is mandatory when assessing quality, healthcare and academic institutions are reliable sources. Caution is advised with ad-containing videos. Future research should focus on policy improvements and tools to aid patients in finding high-quality health content.

Use of Epic Electronic Health Record System for Health Care Research: Scoping Review

BACKGROUND

Electronic health records (EHRs) enable health data exchange across interconnected systems from varied settings. Epic is among the 5 leading EHR providers and is the most adopted EHR system across the globe. Despite its global reach, there is a gap in the literature detailing how EHR systems such as Epic have been used for health care research.

OBJECTIVE

The objective of this scoping review is to synthesize the available literature on use cases of the Epic EHR for research in various areas of clinical and health sciences.

METHODS

We used established scoping review methods and searched 9 major information repositories, including databases and gray literature sources. To categorize the research data, we developed detailed criteria for 5 major research domains to present the results.

RESULTS

We present a comprehensive picture of the method types in 5 research domains. A total of 4669 articles were screened by 2 independent reviewers at each stage, while 206 articles were abstracted. Most studies were from the United States, with a sharp increase in volume from the year 2015 onwards. Most articles focused on clinical care, health services research and clinical decision support. Among research designs, most studies used longitudinal designs, followed by interventional studies implemented at single sites in adult populations. Important facilitators and barriers to the use of Epic and EHRs in general were identified. Important lessons to the use of Epic and other EHRs for research purposes were also synthesized.

CONCLUSIONS

The Epic EHR provides a wide variety of functions that are helpful toward research in several domains, including clinical and population health, quality improvement, and the development of clinical decision support tools. As Epic is reported to be the most globally adopted EHR, researchers can take advantage of its various system features, including pooled data, integration of modules and developing decision support tools. Such research opportunities afforded by the system can contribute to improving quality of care, building health system efficiencies, and conducting population-level studies. Although this review is limited to the Epic EHR system, the larger lessons are generalizable to other EHRs.

Grouping Public Health Skills to Facilitate Workforce Development: A Factor Analysis of PH WINS

OBJECTIVES

This study examined whether distinct factors exist among public health skills, measured through the Public Health Workforce Interests and Needs Survey (PH WINS). Understanding how workforce training needs group is important for developing targeted and appropriate public health workforce training sessions.

DESIGN

Exploratory factor analysis was used to examine public health skills among tier 1 staff (nonmanagers) and a combined group of tier 2 and 3 staff (managers and executives).

SETTING

Data for this study come from the 2017 PH WINS, which assessed public health workforce perceptions of training needs, workplace environment, job satisfaction, perceptions about national trends, and demographics. The analysis included 22 items.

PARTICIPANTS

All public health staff in participating agencies were eligible to complete the survey. The national data set included participants from 47 state health agencies, 26 large local health departments (LHDs), and 71 mid-sized LHDs across all 10 Health and Human Services regions in the United States (including LHDs from all states). The analytic sample was n = 9630 in tier 1, n = 4829 in tier 2, and n = 714 in tier 3 staff.

MAIN OUTCOME MEASURE

Three factors were identified within the skills portion of PH WINS, using exploratory factor analysis. To interpret retained factors, the following parameters were used: factor loadings greater than 0.4, factor cross-loadings less than 0.4 or higher than loadings on other factors, and communalities greater than 0.5.

RESULTS

Factors included (1) data and systems thinking, (2) planning and management, and (3) community collaboration, with slight variation in item loadings between tier 1 and tier 2 and 3 staff analyses.

CONCLUSION

This study was the first known factor analysis of the training needs and workforce skills portion of PH WINS in the published literature. This study advances our conceptualization of public health workforce skills and has the potential to shape future critical workforce training development.

User experience of a hepatitis c population management dashboard in the Department of Veterans Affairs

BACKGROUND

The Veterans Health Administration (VA) is the largest integrated healthcare organization in the US and cares for the largest cohort of individuals with hepatitis C (HCV). A national HCV population management dashboard enabled rapid identification and treatment uptake with direct acting antiviral agents across VA hospitals. We describe the HCV dashboard (HCVDB) and evaluate its use and user experience.

METHODS

A user-centered design approach created the HCVDB to include reports based on the HCV care continuum: 1) 1945-1965 birth cohort high-risk screening, 2) linkage to care and treatment of chronic HCV, 3) treatment monitoring, 4) post-treatment to confirm cure (i.e., sustained virologic response), and 5) special populations of unstably housed Veterans. We evaluated frequency of usage and user experience with the System Usability Score (SUS) and Unified Theory of Acceptance and Use of Technology 2 (UTAUT2) instruments.

RESULTS

Between November 2016 and July 2021, 1302 unique users accessed the HCVDB a total of 163,836 times. The linkage report was used most frequently (71%), followed by screening (13%), sustained virologic response (11%), on-treatment (4%), and special populations (<1%). Based on user feedback (n = 105), the mean SUS score was 73±16, indicating a good user experience. Overall acceptability was high with the following UTAUT2 rated from highest to least: Price Value, Performance Expectancy, Social Influence, and Facilitating Conditions.

CONCLUSIONS

The HCVDB had rapid and widespread uptake, met provider needs, and scored highly on user experience measures. Collaboration between clinicians, clinical informatics, and population health experts was essential for dashboard design and sustained use. Population health management tools have the potential for large-scale impacts on care timeliness and efficiency.

The DASH model: Data for addressing social determinants of health in local health departments

Recent frameworks, models, and reports highlight the critical need to address social determinants of health for achieving health equity in the United States and around the globe. In the United States, data play an important role in better understanding community-level and population-level disparities particularly for local health departments. However, data-driven decision-making-the use of data for public health activities such as program implementation, policy development, and resource allocation-is often presented theoretically or through case studies in the literature. We sought to develop a preliminary model that identifies the factors that contribute to data-driven decision-making in US local health departments and describe relationships between them. Guided by implementation science literature, we examined organizational-level capacity and individual-level factors contributing to using data for decision-making related to social determinants of health and the reduction of county-level disparities. This model has the potential to improve implementation of public health interventions and programs aimed at upstream structural factors, by elucidating the factors critical to incorporating data in decision-making.

Identifying the landscape of developmental toxicity new approach methodologies

BACKGROUND

The dynamics and complexities of in utero fetal development create significant challenges in transitioning from lab animal-centric developmental toxicity testing methods to assessment strategies based on new approach methodologies (NAMs). Nevertheless, considerable progress is being made, stimulated by increased research investments and scientific advances, such as induced pluripotent stem cell-derived models. To help identify developmental toxicity NAMs for toxicity screening and potential funding through the American Chemistry Council's Long-Range Research Initiative, a systematic literature review was conducted to better understand the current landscape of developmental toxicity NAMs.

METHODS

Scoping review tools were used to systematically survey the literature (2010-2021; ~18,000 references identified), results and metadata were then extracted, and a user-friendly interactive dashboard was created.

RESULTS

The data visualization dashboard, developed using Tableau® software, is provided as a free, open-access web tool. This dashboard enables straightforward interactive queries and visualizations to identify trends and to distinguish and understand areas or NAMs where research has been most, or least focused.

CONCLUSIONS

Herein, we describe the approach and methods used, summarize the benefits and challenges of applying the systematic-review techniques, and highlight the types of questions and answers for which the dashboard can be used to explore the many different facets of developmental toxicity NAMs.

Interactive Visualization Applications in Population Health and Health Services Research: Systematic Scoping Review

BACKGROUND

Simple visualizations in health research data, such as scatter plots, heat maps, and bar charts, typically present relationships between 2 variables. Interactive visualization methods allow for multiple related facets such as numerous risk factors to be studied simultaneously, leading to data insights through exploring trends and patterns from complex big health care data. The technique presents a powerful tool that can be used in combination with statistical analysis for knowledge discovery, hypothesis generation and testing, and decision support.

OBJECTIVE

The primary objective of this scoping review is to describe and summarize the evidence of interactive visualization applications, methods, and tools being used in population health and health services research (HSR) and their subdomains in the last 15 years, from January 1, 2005, to March 30, 2019. Our secondary objective is to describe the use cases, metrics, frameworks used, settings, target audience, goals, and co-design of applications.

METHODS

We adapted standard scoping review guidelines with a peer-reviewed search strategy: 2 independent researchers at each stage of screening and abstraction, with a third independent researcher to arbitrate conflicts and validate findings. A comprehensive abstraction platform was built to capture the data from diverse bodies of literature, primarily from the computer science and health care sectors. After screening 11,310 articles, we present findings from 56 applications from interrelated areas of population health and HSR, as well as their subdomains such as epidemiologic surveillance, health resource planning, access, and use and costs among diverse clinical and demographic populations.

RESULTS

In this companion review to our earlier systematic synthesis of the literature on visual analytics applications, we present findings in 6 major themes of interactive visualization applications developed for 8 major problem categories. We found a wide application of interactive visualization methods, the major ones being epidemiologic surveillance for infectious disease, resource planning, health service monitoring and quality, and studying medication use patterns. The data sources included mostly secondary administrative and electronic medical record data. In addition, at least two-thirds of the applications involved participatory co-design approaches while introducing a distinct category, embedded research, within co-design initiatives. These applications were in response to an identified need for data-driven insights into knowledge generation and decision support. We further discuss the opportunities stemming from the use of interactive visualization methods in studying global health; inequities, including social determinants of health; and other related areas. We also allude to the challenges in the uptake of these methods.

CONCLUSIONS

Visualization in health has strong historical roots, with an upward trend in the use of these methods in population health and HSR. Such applications are being fast used by academic and health care agencies for knowledge discovery, hypotheses generation, and decision support.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.2196/14019.

Sex-specific analysis of traumatic brain injury events: applying computational and data visualization techniques to inform prevention and management

BACKGROUND

The interplay of host, agent, and environment implicated in traumatic brain injury (TBI) events is difficult to account for in hypothesis-driven research. Data-driven analysis of injury data can enable insight into injury events in novel ways. This research dissected complex and multidimensional data at the time of the TBI event by exploiting data mining and information visualization methods.

METHODS

We drew upon population-based decade-long health administrative data collected through the routine operation of the publicly funded health system in Ontario, Canada. We applied a computational approach to categorize health records of 235,003 patients with TBI versus the same number of reference patients without TBI, individually matched based on sex, age, place of residence, and neighbourhood income quantile. We adopted the basic concepts of the Haddon Matrix (host, agent, environment) to organize emerging factors significantly related to TBI versus non-TBI events. To explore sex differences, the data of male and female patients with TBI were plotted on heatmaps and clustered using hierarchical clustering algorithms.

RESULTS

Based on detected similarities, the computational technique yielded 34 factors on which individual TBI-event codes were loaded, allowing observation of a set of definable patterns within the host, the agent, and the environment. Differences in the patterns of host, agent and environment were found between male and female patients with TBI, which are currently not identified based on data from injury surveillance databases. The results were internally validated.

CONCLUSIONS

The study outlines novel areas for research relevant to TBI and offers insight into how computational and visual techniques can be applied to advance the understanding of TBI event. Results highlight unique aspects of sex differences of the host and agent at the injury event, as well as differences in exposure to adverse social and environmental circumstances, which can be a function of gender, aiding in future studies of injury prevention and gender-transformative care.