Design and evaluation of a dashboard to support the comprehension of the progression of patients with dementia in day centers

A Geospatial Drug Abuse Risk Assessment and Monitoring Dashboard Tailored for School Students: Development Study With Requirement Analysis and Acceptance Evaluation

BACKGROUND

The enormous consequences of drugs include suicides, traffic accidents, and violence, affecting the individual, family, society, and country. Therefore, it is necessary to constantly identify and monitor the drug abuse rate among school-going youth. A geospatial dashboard is vital for the monitoring of drug abuse and related crime incidence in a decision support system.

OBJECTIVE

This paper mainly focuses on developing MyAsriGeo, a geospatial drug abuse risk assessment and monitoring dashboard tailored for school students. It introduces innovative functionality, seamlessly orchestrating the assessment of drug abuse usage patterns and risks using multivariate student data.

METHODS

A geospatial drug abuse dashboard for monitoring and analysis was designed and developed in this study based on agile methodology and prototyping. Using focus group and interviews, we first examined and gathered the requirements, feedback, and user approval of the MyAsriGeo dashboard. Experts and stakeholders such as the National Anti-Drugs Agency, police, the Federal Department of Town and Country Planning, school instructors, students, and researchers were among those who responded. A total of 20 specialists were involved in the requirement analysis and acceptance evaluation of the pilot and final version of the dashboard. The evaluation sought to identify various user acceptance aspects, such as ease of use and usefulness, for both the pilot and final versions, and 2 additional factors based on the Post-Study System Usability Questionnaire and Task-Technology Fit models were enlisted to assess the interface quality and dashboard sufficiency for the final version.

RESULTS

The MyAsriGeo geospatial dashboard was designed to meet the needs of all user types, as identified through a requirement gathering process. It includes several key functions, such as a geospatial map that shows the locations of high-risk areas for drug abuse, data on drug abuse among students, tools for assessing the risk of drug abuse in different areas, demographic information, and a self-problem test. It also includes the Alcohol, Smoking, and Substance Involvement Screening Test and its risk assessment to help users understand and interpret the results of student risk. The initial prototype and final version of the dashboard were evaluated by 20 experts, which revealed a significant improvement in the ease of use (P=.047) and usefulness (P=.02) factors and showed a high acceptance mean scores for ease of use (4.2), usefulness (4.46), interface quality (4.29), and sufficiency (4.13).

CONCLUSIONS

The MyAsriGeo geospatial dashboard is useful for monitoring and analyzing drug abuse among school-going youth in Malaysia. It was developed based on the needs of various stakeholders and includes a range of functions. The dashboard was evaluated by a group of experts. Overall, the MyAsriGeo geospatial dashboard is a valuable resource for helping stakeholders understand and respond to the issue of drug abuse among youth.

Dashboards to Support Implementation of the Quebec Alzheimer Plan: Evaluation Study With Regional and Professional Considerations

BACKGROUND

Health organizations face the critical task of executing and overseeing comprehensive health care. To address the challenges associated with this task, evidence-based dashboards have emerged as valuable tools. Since 2016, the regional health organizations of Quebec, Canada, have been responsible for ensuring implementation of the Quebec Alzheimer Plan (QAP), a provincial plan that aims to reinforce the capacity of primary care services to detect, diagnose, and treat persons with dementia. Despite the provincial scope of the QAP, the diverse material and human resources across regions introduce variability in the interest, utility, and specific needs associated with these dashboards.

OBJECTIVE

The aim of this study was to assess the interest and utility of dashboards to support the QAP implementation, as well as to determine the needs for improving these aspects according to the perspectives of various types of professionals involved across regions.

METHODS

An evaluative study using qualitative methods was conducted within a collaborative research approach involving different stakeholders, including the ministerial advisor and the four project managers responsible for supporting the implementation of the QAP, as well as researchers/scientific advisors. To support these organizations, we developed tailored, 2-page paper dashboards, detailing quantitative data on the prevalence of dementia, the use of health services by persons with dementia, and achievements and challenges of the QAP implementation in each organization's jurisdiction. We then conducted 23 focus groups with the managers and leading clinicians involved in the implementation of the QAP of each regional health organization. Real-time notes were taken using a structured observation grid. Content analysis was conducted according to different regions (organizations with university mandates or nearby organizations, labeled "university/peripheral"; organizations for which only part of the territory is in rural areas, labeled "mixed"; and organizations in remote or isolated areas, labeled "remote/isolated") and according to different types of participants (managers, leading clinicians, and other participants).

RESULTS

Participants from organizations in all regions expressed interest in these dashboards and found them useful in several ways. However, they highlighted the need for indicators on orphan patients and other health care providers. Differences between regions were observed, particularly in the interest in continuity of care in university/peripheral regions and the need for diagnostic tools adapted to the culture in remote/isolated regions.

CONCLUSIONS

These dashboards support the implementation of an Alzheimer Plan and contribute to the emergence of a learning health care system culture. This project allows each region to increase its monitoring capacity for the implementation of the QAP and facilitates reflection among individuals locally carrying out the implementation. The perspectives expressed will guide the preparation of the next iteration of the dashboards.

Building digital solutions to support brain health prescribing in primary care: Where to begin?

National and international policy goals on healthy ageing and dementia risk reduction are yet to be fully realised in community healthcare settings. Disease modification strategies through lifestyle and social interventions are viable, evidence-based solutions to reduce age-related disease burden. However, prescribing lifestyle interventions targeting dementia risk in primary care remains deficient. Using digital technologies to support older individuals and healthcare professionals through formal health checks and lifestyle management is likely to enable shared understanding and consequences of personalized care and treatment options. These tailored solutions may bridge the translation gap and support healthy ageing.

Ten Topics to Get Started in Medical Informatics Research

The vast and heterogeneous data being constantly generated in clinics can provide great wealth for patients and research alike. The quickly evolving field of medical informatics research has contributed numerous concepts, algorithms, and standards to facilitate this development. However, these difficult relationships, complex terminologies, and multiple implementations can present obstacles for people who want to get active in the field. With a particular focus on medical informatics research conducted in Germany, we present in our Viewpoint a set of 10 important topics to improve the overall interdisciplinary communication between different stakeholders (eg, physicians, computational experts, experimentalists, students, patient representatives). This may lower the barriers to entry and offer a starting point for collaborations at different levels. The suggested topics are briefly introduced, then general best practice guidance is given, and further resources for in-depth reading or hands-on tutorials are recommended. In addition, the topics are set to cover current aspects and open research gaps of the medical informatics domain, including data regulations and concepts; data harmonization and processing; and data evaluation, visualization, and dissemination. In addition, we give an example on how these topics can be integrated in a medical informatics curriculum for higher education. By recognizing these topics, readers will be able to (1) set clinical and research data into the context of medical informatics, understanding what is possible to achieve with data or how data should be handled in terms of data privacy and storage; (2) distinguish current interoperability standards and obtain first insights into the processes leading to effective data transfer and analysis; and (3) value the use of newly developed technical approaches to utilize the full potential of clinical data.

Design and Evaluation of a Technological Platform for Monitoring Patients with Dementia: Unifying Requirements from Mexican Day Centers

The monitoring of patients with dementia who receive comprehensive care in day centers allows formal caregivers to make better decisions and provide better care to patients. For instance, cognitive and physical therapies can be tailored based on the current stage of disease progression. In the context of day centers of the Mexican Federation of Alzheimer, this work aims to design and evaluate Alzaid, a technological platform for assisting formal caregivers in monitoring patients with dementia. Alzaid was devised using a participatory design methodology that consisted in eliciting and validating requirements from 22 and 9 participants, respectively, which were unified to guide the construction of a high-fidelity prototype evaluated by 14 participants. The participants were formal caregivers, medical staff, and management. This work contributes a high-fidelity prototype of a technological platform for assisting formal caregivers in monitoring patients with dementia considering restrictions and requirements of four Mexican day centers. In general, the participants perceived the prototype as quite likely to be useful, usable, and relevant in the job of monitoring patients with dementia (p-value < 0.05). By evaluating and designing Alzaid that unifies requirements for monitoring patients of four day centers, this work is the first effort towards a standard monitoring process of patients with dementia in the context of the Mexican Federation of Alzheimer.

Developing the VA Geriatric Scholars Programs' Clinical Dashboards Using the PDSA Framework for Quality Improvement

Background  Involving clinician end users in the development process of clinical dashboards is important to ensure that user needs are adequately met prior to releasing the dashboard for use. The challenge with following this approach is that clinician end users can undergo periodic turnover, meaning, the clinicians that played a role in the initial development process may not be the same individuals that use the dashboard in future.

Objectives  Here, we summarize our Plan, Do, Study, Act (PDSA)-guided clinical dashboard development process for the VA Geriatric Scholars Program (GSP) and the value of continuous, iterative development. We summarize dashboard adaptations that resulted from two PDSA cycles of improvement for the potentially inappropriate medication dashboard (PIMD), one of many Geriatric Scholars clinical dashboards. We also present the evaluative performance of the PIMD.

Methods  Evaluation of the PIMD was performed using the system usability scale (SUS) and through review of user interaction logs. Routine end users that were Geriatric Scholars and had evidence of 5 or more dashboard views were invited to complete an electronic form that contained the 10-item SUS.

Results  The proportion of Geriatric Scholars that utilized the PIMD increased for each iterative dashboard version that was produced as a byproduct from feedback (31.0% in 2017 to 60.2% in 2019). The overall usability of the PIMD among routine users was found to be above average (SUS score: 75.2 [95% CI 70.5–79.8]) in comparison to the recommended standard of acceptability (SUS score: 68)

Conclusion  The solicitation of feedback during dashboard orientations led to iterative adaptations of the PIMD that broadened its intended use. The presented PDSA-guided process to clinical dashboard development for the VA GSP can serve as a valuable framework for development teams seeking to produce well-adopted and usable health information technology (IT) innovations.