A Human-Centered Platform for HIV Infection Reduction in New York: Development and Usage Analysis of the Ending the Epidemic (ETE) Dashboard

Development and application of Breadth-Depth-Context (BDC), a conceptual framework for measuring technology engagement with a qualified clinical data registry

Objectives

Despite the proliferation of dashboards that display performance data derived from Qualified Clinical Data Registries (QCDR), the degree to which clinicians and practices engage with such dashboards has not been well described. We aimed to develop a conceptual framework for assessing user engagement with dashboard technology and to demonstrate its application to a rheumatology QCDR.

Materials and Methods

We developed the BDC (Breadth-Depth-Context) framework, which included concepts of breadth (derived from dashboard sessions), depth (derived from dashboard actions), and context (derived from practice characteristics). We demonstrated its application via user log data from the American College of Rheumatology's Rheumatology Informatics System for Effectiveness (RISE) registry to define engagement profiles and characterize practice-level factors associated with different profiles.

Results

We applied the BDC framework to 213 ambulatory practices from the RISE registry in 2020-2021, and classified practices into 4 engagement profiles: not engaged (8%), minimally engaged (39%), moderately engaged (34%), and most engaged (19%). Practices with more patients and with specific electronic health record vendors (eClinicalWorks and eMDs) had a higher likelihood of being in the most engaged group, even after adjusting for other factors.

Discussion

We developed the BDC framework to characterize user engagement with a registry dashboard and demonstrated its use in a specialty QCDR. The application of the BDC framework revealed a wide range of breadth and depth of use and that specific contextual factors were associated with nature of engagement.

Conclusion

Going forward, the BDC framework can be used to study engagement with similar dashboards.

Developing public health surveillance dashboards: a scoping review on the design principles

BACKGROUND

Public Health Dashboards (PHDs) facilitate the monitoring and prediction of disease outbreaks by continuously monitoring the health status of the community. This study aimed to identify design principles and determinants for developing public health surveillance dashboards.

METHODOLOGY

This scoping review is based on Arksey and O'Malley's framework as included in JBI guidance. Four databases were used to review and present the proposed principles of designing PHDs: IEEE, PubMed, Web of Science, and Scopus. We considered articles published between January 1, 2010 and November 30, 2022. The final search of articles was done on November 30, 2022. Only articles in the English language were included. Qualitative synthesis and trend analysis were conducted.

RESULTS

Findings from sixty-seven articles out of 543 retrieved articles, which were eligible for analysis, indicate that most of the dashboards designed from 2020 onwards were at the national level for managing and monitoring COVID-19. Design principles for the public health dashboard were presented in five groups, i.e., considering aim and target users, appropriate content, interface, data analysis and presentation types, and infrastructure.

CONCLUSION

Effective and efficient use of dashboards in public health surveillance requires implementing design principles to improve the functionality of these systems in monitoring and decision-making. Considering user requirements, developing a robust infrastructure for improving data accessibility, developing, and applying Key Performance Indicators (KPIs) for data processing and reporting purposes, and designing interactive and intuitive interfaces are key for successful design and development.

Integrating human-centered design in public health data dashboards: lessons from the development of a data dashboard of sexually transmitted infections in New York State

OBJECTIVE

The increased availability of public data and accessible visualization technologies enhanced the popularity of public health data dashboards and broadened their audience from professionals to the general public. However, many dashboards have not achieved their full potential due to design complexities that are not optimized to users' needs.

MATERIAL AND METHODS

We used a 4-step human-centered design approach to develop a data dashboard of sexually transmitted infections for the New York State Department of Health: (1) stakeholder requirements gathering, (2) an expert review of existing data dashboards, (3) a user evaluation of existing data dashboards, and (4) an usability evaluation of the prototype dashboard with an embedded experiment about visualizing missing race and ethnicity data.

RESULTS

Step 1 uncovered data limitations and software requirements that informed the platform choice and measures included. Step 2 yielded a checklist of general principles for dashboard design. Step 3 revealed user preferences that influenced the chart types and interactive features. Step 4 uncovered usability problems resulting in features such as prompts, data notes, and displaying imputed values for missing race and ethnicity data.

DISCUSSION

Our final design was accepted by program stakeholders. Our modifications to traditional human-centered design methodologies to minimize stakeholders' time burden and collect data virtually enabled project success despite barriers to meeting participants in-person and limited public health agency staff capacity during the COVID-19 pandemic.

CONCLUSION

Our human-centered design approach and the final data dashboard architecture could serve as a template for designing public health data dashboards elsewhere.

A mixed methods evaluation assessing the feasibility of implementing a PrEP data dashboard in the Southeastern United States

BACKGROUND

Alabama is one of seven priority states for the National Ending the HIV Epidemic Initiative due to a disproportionate burden of rural infections. To reverse growing infection rates, the state must increase its focus on prevention efforts, including novel strategies. One such approach is to utilize dashboards that visualize real-time data on the pre-exposure prophylaxis (PrEP) care continuum to assist in prioritizing evidence-based preventative care for those most vulnerable for HIV infection.

METHODS

We conducted a mixed methods evaluation to ascertain stakeholders' perceptions on the acceptability, feasibility, appropriateness, and usability of a PrEP care continuum dashboard, as well as gain insight on ways to improve the activities necessary to sustain it. Clinicians, administrators, and data personnel from participating sites in Alabama completed surveys (n = 9) and participated in key informant interviews (n = 10) to better understand their experiences with the prototype data dashboard and to share feedback on how it can be modified to best fit their needs.

RESULTS

Surveys and interviews revealed that all participants find the pilot data dashboard to be an acceptable, feasible, and appropriate intervention for clinic use. Overall, stakeholders find the pilot dashboard to be usable and helpful in administrative efforts, such as report and grant writing; however, additional refining is needed in order to reduce burden and optimize usefulness. Participants voiced concerns about their site's abilities to sustain the dashboard, including the lack of systematized PrEP protocols and limited funds and staff time dedicated to PrEP data collection, cleaning, and upload.

CONCLUSION

Study participants from clinics providing HIV prevention services, including PrEP, in Alabama voiced interest in sustaining and refining a data dashboard that tracks clients across the PrEP care continuum. Despite viewing the platform itself as an acceptable, feasible, and appropriate intervention, participants agreed that efforts need to be focused on standardizing PrEP data collection protocols in order to ensure consistent, accurate data capture and that limited funds and staff time are barriers to the sustained implementation of the dashboard in practice.

Using Implementation Mapping to Ensure the Success of PrEP Optimization Through Enhanced Continuum Tracking (PrOTECT) AL-A Structural Intervention to Track the Statewide PrEP Care Continuum in Alabama

INTRODUCTION

Ending the HIV Epidemic initiatives provide a unique opportunity to use implementation scientific methods to guide implementation of evidence-based practices and evaluate their effectiveness in real-word settings to improve HIV inequities. This report demonstrates our use of Implementation Mapping (IM) to engage participating county health departments, AIDS services organizations, and community-based organizations in the development of a data dashboard to track the PrEP care continuum for the state of Alabama, an Ending the HIV Epidemic hotspot.

METHODS

Our project is guided by an overarching Implementation Research Logic Model and by the tenets of IM, a 5-step approach to support researchers and community partners in the systematic selection, development, and/or tailoring of implementation strategies to increase program adoption, implementation, and sustainability.

RESULTS

Step 1, the needs assessment, established baseline data elements for a PrEP care continuum for participating community-based organizations, AIDS services organizations, and the state health department as well as investigated their desire for data visualization and willingness to share data to inform initiatives to improve PrEP access. Step 2 identified adaptability, relative advantage, and complexity as determinants of intervention adoption. Based on findings from steps 1 and 2, the investigators and community partners determined to move forward with development of a data dashboard. Step 3 identified the following implementation strategies to support a dashboard, including development of educational materials, synchronous and asynchronous training, technical assistance, and improved record systems.

DISCUSSION

Using IM supports community-engaged researchers in designing strategies to end the epidemic that are context-specific and more impactful in real-word settings.

Designing and Evaluating a Personalized, Human-Centered Dietary Decision Support System for Use Among People With Diabetes in an Indian Setting: Protocol for a Quasi-Experimental Study

Background

Human-centered dietary decision support systems are fundamental to diabetes management, and they address the limitations of existing diet management systems.

Objective

The objective of the proposed study is to evaluate the use of an interactive, telephone-linked, personalized, human-centered decision support system for facilitating the delivery of personalized nutrition care for patients with diabetes.

Methods

A quasi-experimental trial was conducted between the period of June and December 2018. Study participants were recruited from Community Health Center, Dharamshala, Kangra (urban population), and Model Rural Health Unit, Haroli Block, Una (rural population). Eligible participants included adults aged ≥30 years with controlled or uncontrolled diabetes, those who agreed to participate in the study, those who were available for follow-up interviews, and those with a telephone or computer at home. Diabetic status was determined via a physician’s diagnosis. Individuals with mental or physical challenges that affected their ability to use an electronic diet record, those who were not available for a telephone follow-up, and those who were involved in other protocols related to dietary assessments were excluded. The study participants were randomized into the following two groups: the intervention group (telephone-linked dietary decision support system) and the control group (paper-based diet record). Study participants in the intervention group recorded their daily dietary intake by using a telephone-linked, personalized, human-centered dietary decision support system and received personalized feedback and diet education via SMS text messaging. Study participants in the control group were provided with only a paper-based diet record for documenting their daily dietary intake. Follow-up visits were conducted at 3 and 6 months from the baseline in both groups. Differences in diabetes knowledge, attitudes, and practices will be measured across groups.

Results

The collection of baseline data from 800 study participants in both the intervention (n=400) and control groups (n=400), which were stratified by urban (control group: n=200; intervention group: n=200) and rural settings (control group: n=200; intervention group: n=200), has been completed. Follow-up data collection for months 3 and 6 is ongoing and is expected to be completed by October 2019.

Conclusions

We anticipate that the intervention group will show significant changes in nutrition knowledge, attitudes, and practices; satisfaction with care; and overall diabetes management. We also expect to see urban-rural differences across the groups. The uniqueness of our nutrient data capture process is demonstrated by its cultural and contextually relevant features—diet capture in both English and Hindi, diet conversion into caloric components, sustained diet data collection and participant adherence through telephone-linked care, and auto-generated reminders.

International Registered Report Identifier (IRRID)

DERR1-10.2196/13635

Developing Dashboards to Address Children's Health Disparities in Ohio

OBJECTIVES

Social determinants of health (SDoH) can be measured at the geographic level to convey information about neighborhood deprivation. The Ohio Children's Opportunity Index (OCOI) is a composite area-level opportunity index comprised of eight health domains. Our research team has documented the design, development, and use cases of a dashboard solution to visualize OCOI.

METHODS

The OCOI is a multidomain index spanning the following eight domains: (1) family stability, (2) infant health, (3) children's health, (4) access, (5) education, (6) housing, (7) environment, and (8) criminal justice. Information on these eight domains is derived from the American Community Survey and other administrative datasets. Our team used the Tableau Desktop visualization software and applied a user-centered design approach to developing the two OCOI dashboards-main OCOI dashboard and OCOI-race dashboard. We also performed convergence analysis to visualize the census tracts where different health indicators simultaneously exist at their worst levels.

RESULTS

The OCOI dashboard has multiple, interactive components as follows: a choropleth map of Ohio displaying OCOI scores for a specific census tract, graphs presenting OCOI or domain scores to compare relative positions for tracts, and a sortable table to visualize scores for specific county and census tracts. A case study using the two dashboards for convergence analysis revealed census tracts in neighborhoods with low infant health scores and a high proportion of minority population.

CONCLUSION

The OCOI dashboards could assist health care leaders in making decisions that enhance health care delivery and policy decision-making regarding children's health particularly in areas where multiple health indicators exist at their worst levels.

COVID-19 and global equity for health: The good, the bad, and the wicked

Elvin Geng and co-authors discuss monitoring and achieving equity in provision of vaccines for COVID-19.

Development, Implementation, and User Evaluation of COVID-19 Dashboard in a Third-Level Hospital in Iran

INTRODUCTION

The implementation of a dashboard enables managers to make informed and evidence-based decisions through data visualization and graphical presentation of information. This study aimed to design and implement a COVID-19 management dashboard in a third-level hospital in Mashhad, Iran.

MATERIALS AND METHODS

This descriptive developmental applied study was conducted in the second half of 2020 in three stages, using user-centered design methodology in four phases: (1) specification of the application context, (2) specification of requirements, (3) creation of design solutions, and (4) evaluation of designs. Data collection in each phase was performed through holding group discussions with the main users, nominal group techniques, interviews, and questioners. The dashboard prototype for the data display was designed using the Power BI Desktop software. Subsequently, users' comments were obtained using the focus group method and included in the dashboard.

RESULTS

In total, 25 indicators related to input, process, and output areas were identified based on the findings of the first stage. Moreover, eight items were introduced by participants as dashboard requirements. The dashboard was developed based on users' feedback and suggestions, such as the use of colors, reception of periodic and specific reports based on key performance indicators, and rearrangement of the components visible on the page. The result of the user satisfaction survey indicated their satisfaction with the developed dashboard.

CONCLUSION

The selection of proper criteria for the implementation of an effective dashboard is critical for the health care organization since they are designed with a high-tech and content-based environment. The dashboard in the present study was a successful combination of clinical and managerial indicators. Future studies should focus on the design and development of dashboards, as well as benchmarking by using data from several hospitals.

Using community engagement to implement evidence-based practices for opioid use disorder: A data-driven paradigm & systems science approach

Community-driven responses are essential to ensure the adoption, reach and sustainability of evidence-based practices (EBPs) to prevent new cases of opioid use disorder (OUD) and reduce fatal and non-fatal overdoses. Most organizational approaches for selecting and implementing EBPs remain top-down and individually oriented without community engagement (CE). Moreover, few CE approaches have leveraged systems science to integrate community resources, values and priorities. This paper provides a novel CE paradigm that utilizes a data-driven and systems science approach; describes the composition, functions, and roles of researchers in CE; discusses unique ethical considerations that are particularly salient to CE research; and provides a description of how systems science and data-driven approaches to CE may be employed to select a range of EBPs that collectively address community needs. Finally, we conclude with scientific recommendations for the use of CE in research. Greater investment in CE research is needed to ensure contextual, equitable, and sustainable access to EBPs, such as medications for OUD (MOUD) in communities heavily impacted by the opioid epidemic. A data-driven approach to CE research guided by systems science has the potential to ensure adequate saturation and sustainability of EBPs that could significantly reduce opioid overdose and health inequities across the US.

Community dashboards to support data-informed decision-making in the HEALing communities study

BACKGROUND

With opioid misuse, opioid use disorder (OUD), and opioid overdose deaths persisting at epidemic levels in the U.S., the largest implementation study in addiction research-the HEALing Communities Study (HCS)-is evaluating the impact of the Communities That Heal (CTH) intervention on reducing opioid overdose deaths in 67 disproportionately affected communities from four states (i.e., "sites"). Community-tailored dashboards are central to the CTH intervention's mandate to implement a community-engaged and data-driven process. These dashboards support a participating community's decision-making for selection and monitoring of evidence-based practices to reduce opioid overdose deaths.

METHODS/DESIGN

A community-tailored dashboard is a web-based set of interactive data visualizations of community-specific metrics. Metrics include opioid overdose deaths and other OUD-related measures, as well as drivers of change of these outcomes in a community. Each community-tailored dashboard is a product of a co-creation process between HCS researchers and stakeholders from each community. The four research sites used a varied set of technical approaches and solutions to support the scientific design and CTH intervention implementation. Ongoing evaluation of the dashboards involves quantitative and qualitative data on key aspects posited to shape dashboard use combined with website analytics.

DISCUSSION

The HCS presents an opportunity to advance how community-tailored dashboards can foster community-driven solutions to address the opioid epidemic. Lessons learned can be applied to inform interventions for public health concerns and issues that have disproportionate impact across communities and populations (e.g., racial/ethnic and sexual/gender minorities and other marginalized individuals).

TRIAL REGISTRATION

ClinicalTrials.gov (NCT04111939).

Respected as a Client, Cared for as a Patient: Evidence of Heuristic Decision-Making from Yelp Reviews of Obstetrician-Gynecologists

Previous literature has demonstrated a gap between what health care consumers say they want to know about their physicians and the publicly available information the health care industry provides. This systematic analysis of Yelp reviews from the 25 most populous U.S. metropolitan areas is predicated on the assumptions that patients who post online physician reviews include information they would find useful when choosing a physician, and that this information represents an ecologically valid sample for making inferences regarding patients' decision making process. Obstetrician gynecologists are twice as likely to be reviewed as other physicians, but this is, to our knowledge, the first study examining online reviews of obstetrician-gynecologists specifically. This study contributes to the literature on medical decision making, demonstrating that the physician choice decision is made using a heuristic tallying model, in which only two, nearly equally weighted parameters are meaningful: patient (which, within the reviews, incorporates physician interpersonal manner and physician knowledge and skills) and office management. Yelp reviews of obstetrician-gynecologists follow patterns previously established in scholarship: ratings are bimodal, and approximately two-thirds are positive. In the absence of objective, user-friendly physician-level information, patients will turn to review sites like Yelp when choosing physicians. Rather than resisting this trend, physicians and hospital systems would be better served by working with review sites, or creating their own, to emphasize aspects of the experience patients are qualified to evaluate: the physician's interpersonal manner and office management.

Designing and Disseminating Metrics to Support Jurisdictional Efforts to End the Public Health Threat Posed by HIV Epidemics

The US Department of Health and Human Services has launched a large-scale plan that aims to "End the HIV Epidemic" (EtHE) in America, including ambitious goals and targets over the next 5 to 10 years.To be successful, the EtHE Plan will require timely dissemination of relevant metrics to inform the broad array of stakeholders who are in a position to act in support of the plan's goals. Metrics should include both population health outcome metrics and implementation metrics that track the deployment and uptake of specific intervention delivery strategies. In addition to the usual HIV care continuum metrics that include all people living with HIV in the denominator, metrics dedicated to those not yet reached (i.e., as the denominator) are essential to help target EtHE implementation efforts. Special attention is required around metrics and targets that inform and drive action on HIV-related health disparities.Well-chosen metrics and a well-designed dissemination system can serve as important tools to assess the progress of the EtHE Plan, and to identify and disseminate lessons learned quickly within and across jurisdictions aiming to end HIV as a local public health threat.

The QualiRede intervention: improving the performance of care continuum in HIV, congenital syphilis, and hepatitis C in health regions

INTRODUCTION

Care continuum models have supported recent strategies against sexually transmitted diseases, such as HIV and Hepatitis C (HCV).

METHODS

HIV, HCV, and congenital syphilis care continuum models were developed, including all stages of care, from promotion/prevention to clinical control/cure. The models supported the intervention QualiRede, developed by a University-Brazilian National Health System (SUS) partnership focused on managers and other professionals from six priority health regions in São Paulo and Santa Catarina. Indicators were selected for each stage of the care continuum from the SUS information systems and from the Qualiaids and QualiAB facility's process evaluation questionnaires. The indicators acted as the technical basis of two workshops with professionals and managers in each region: the first one to identify problems and to create a Regional Technical Group; and the second one to design action plans for improving regional performance.

RESULTS

The indicators are available at www.qualirede.org. The workshops took place in the regions of Alto Tietê, Baixada Santista, Grande ABC, and Registro (São Paulo) and of Foz do Rio Itajaí (Santa Catarina), which resulted in regional action plans in São Paulo, but not in Santa Catarina. A lack of awareness was observed regarding the new HIV and HCV protocols, as well as an incipient use of indicators in routine practices.

CONCLUSION

Improving the performance of the care continuum requires appropriation of performance indicators and coordination of care flows at local, regional, and state levels of management.

"Okay, We Get It. You Vape": An Analysis of Geocoded Content, Context, and Sentiment regarding E-Cigarettes on Twitter

The current study examined conversations on Twitter related to use and perceptions of e-cigarettes in the United States. We employed the Social Media Analytic and Research Testbed (SMART) dashboard, which was used to identify and download (via a public API) e-cigarette-related geocoded tweets. E-cigarette-related tweets were collected continuously using customized geo-targeted Twitter APIs. A total of 193,051 tweets were collected between October 2015 and February 2016. Of these tweets, a random sample of 973 geocoded tweets were selected and manually coded for information regarding source, context, and message characteristics. Our findings reveal that although over half of tweets were positive, a sizeable portion was negative or neutral. We also found that, among those tweets mentioning a stigma of e-cigarettes, most confirmed that a stigma does exist. Conversely, among tweets mentioning the harmfulness of e-cigarettes, most denied that e-cigarettes were a health hazard. These results suggest that current efforts have left the public with ambiguity regarding the potential dangers of e-cigarettes. Consequently, it is critical to communicate the public health stance on this issue to inform the public and provide counterarguments to the positive sentiments presently dominating conversations about e-cigarettes on social media. The lack of awareness and need to voice a public health position on e-cigarettes represents a vital opportunity to continue winning gains for tobacco control and prevention efforts through health communication interventions targeting e-cigarettes.