Format guidelines to make them vivid, intuitive, and visual

Women with ovarian cancer's information seeking and avoidance behaviors: an interview study

Objectives

Despite the importance of using information for ovarian cancer (OvCa) disease management and decision-making, some women with OvCa do not actively seek out information. The purpose of this study is to investigate factors that influence information seeking behaviors and information avoidance behaviors and information resources among women with OvCa and their caregivers.

Materials and methods

We conducted in-depth interviews with OvCa patients or caregivers of OvCa (n = 20) and employed deductive and inductive coding methodologies for analysis.

Results

Our analysis revealed 5 emerging themes associated with active information seeking behavior, 5 themes of passive information acquisition, and 4 themes of information avoidance behavior. Additionally, we identified participants' preferred information sources for OvCa management, such as health organization or government operated resources and web-based social groups.

Discussion

To enhance information access, strategies should be developed to motivate people with OvCa to seek rather than avoid information. The study emphasizes the significance of promoting patient-provider communication and leveraging strong social support networks for effective information acquisition.

Conclusion

Our findings provide valuable implications for clinical practice and policymaking, emphasizing the need to improve access to information for individuals with OvCa. By addressing the identified factors influencing information seeking behaviors, healthcare professionals and policymakers can better support patients and caregivers in their information-seeking journey, ultimately enhancing disease management and decision-making outcomes.

Spanish-Language Communication of COVID-19 Information Across US Local Health Department Websites

The COVID-19 pandemic has brought new urgency to a longstanding problem: the US health system is not well-equipped to accommodate the country's large limited English proficient (LEP) population in times of national emergency. We examined the landscape of Spanish-language COVID-19 website information compared to information in English provided by health departments of the top 10 cities by population in the USA. For each city, coders evaluated three score measures (amount of information, presentation quality, and ease of navigation) for six content types (general information, symptoms, testing, prevention, vaccines, and live statistics) across six delivery modes (print resources, website text, videos, external links, data visualization, and media toolkits). We then calculated a grand average, combining all cities' values per score measure for each content type-delivery mode combination, to understand the landscape of Spanish-language information across the country. Overall, we found that, for all cities combined, nearly all content types and delivery modes in Spanish were inferior or non-existent compared to English resources. Our findings also showed much variability and spread concerning content type and delivery mode of information. Finally, our findings uncovered three main clusters of content type and delivery mode combinations for Spanish-language information, ranging from similar to worse, compared to information in English. Our findings suggest that COVID-19 information was not equivalently provided in Spanish, despite federal guidance regarding language access during times of national emergency. These results can inform ongoing and future emergency communication plans for Spanish-preferring LEP and other LEP populations in the USA.

Effective web-based clinical practice guidelines resources: recommendations from a mixed methods usability study

BACKGROUND

Clinical practice guidelines (CPG) are an important knowledge translation resource to help clinicians stay up to date about relevant clinical knowledge. Effective communication of guidelines, including format, facilitates its implementation. Despite the digitalization of healthcare, there is little literature to guide CPG website creation for effective dissemination and implementation. Our aim was to assess the effectiveness of the content and format of the Diabetes Canada CPG website, and use our results to inform recommendations for other CPG websites.

METHODS

Fourteen clinicians (family physicians, nurses, pharmacists, and dieticians) in diabetes care across Canada participated in this mixed-methods study (questionnaires, usability testing and interviews). Participants "thought-aloud" while completing eight usability tasks on the CPG website. Outcomes included task success rate, completion time, click per tasks, resource used, paths, search attempts and success rate, and error types. Participants were then interviewed.

RESULTS

The Diabetes Canada CPG website was found to be usable. Participants had a high task success rate of 79% for all tasks and used 144 (standard deviation (SD) = 152) seconds and 4.6 (SD = 3.9) clicks per task. Interactive tools were most frequently used compared to full guidelines and static tools. Misinterpretation accounted for 48% of usability errors. Participants overall found the website intuitive, with effective content and design elements.

CONCLUSION

Different versions of CPG information (e.g. interactive tools, quick reference guide, static tools) can help answer clinical questions more quickly. Effective web design should be assessed during CPG website creation for effective guideline dissemination and implementation.

User Testing to Improve Retrieval and Comprehension of Information in Guidelines to Improve Medicines Safety

OBJECTIVE

The aim of the study was to investigate the effectiveness of user testing for improving healthcare professionals' retrieval and comprehension of information in medicines guidelines.

METHODS

The United Kingdom's Injectable Medicines Guide was selected as a case study. This gives guidance to nurses on preparing and administering intravenous medicines on hospital wards, in line with standard UK practice. Three rounds of user testing were completed with 10 hospital nurses per round, using the Injectable Medicines Guide for voriconazole and aminophylline. Participants used the guidelines to answer 17 questions related to the administration of these medicines. Answers were scored for "finding" and "understanding" the required information. Semistructured interviews explored participants' opinions of guideline content, design, and wording, with responses analyzed thematically. The guidelines were revised between rounds.

RESULTS

In round 1, 8 of 17 questions were answered correctly by all participants. Participants had difficulty with dose, dilution, administration rate, and adverse effects questions. Revisions included new subsections and increased calculation support. In round 2, 14 of 17 questions were answered correctly by all participants. Difficulty persisted with dose and administration rate questions and further revisions made. In round 3, 15 of 17 questions were answered correctly by all participants. Across all rounds, participants considered appropriate subheadings and information order as important for fast location of information. Specific, detailed, and practical instructions were perceived as important to improve understandability and usefulness.

CONCLUSIONS

Key information in medicines guidelines may not be found and/or understood by healthcare professionals. User testing increased information retrieval and comprehension and could have an important role in improving the safety of medicines use.

Evaluation of a guidelines website capitalizing on Finnish content and Belgium interface: A pilot study in French general practice

No reference point-of-care, web-based medical compendium is available in general practice in France. We have then conducted the experimentation of EBMPracticeNet, a Belgian website of guidelines translated and adapted from the Finnish EBM Guidelines. We collected data from three sources: (i) the website logbook; (ii) a search-specific assessment questionnaire; (iii) a global assessment questionnaire. A cumulative number of 262 (62.8%) physicians performed at least one search on the website and clicked on average 5.9 times per month. Physicians globally got an accurate answer (74.2%). They found the information provided by the website reliable (92.2%) and useful for practice (78.6%). They perceived the website ergonomics as good. The main reported barriers were the time and effort required to find an accurate answer and the uneven relevance of the information retrieved. Improvements should focus on guidelines indexing and their adaptation to the French context, and training physicians to search medical databases.

Iterative Development of Clinician Guides to Support Deprescribing Decisions and Communication for Older Patients in Hospital: A Novel Methodology

BACKGROUND/OBJECTIVES

Medication review is an important component of the management of older hospital patients. Deprescribing (supervised withdrawal of inappropriate medicines) is one outcome of review. This study aimed to iteratively develop and test the usability of deprescribing guides, which support multidisciplinary clinicians to reduce inappropriate polypharmacy in older inpatients.

METHODS

Deprescribing guides for hospital clinicians were developed using a novel mixed-methods, ten-step process. Iterative development and usability testing were applied. This included content development through review of the literature; expert consensus through five rounds of feedback using a modified Delphi approach; and usability testing by 16 multidisciplinary hospital clinicians on hypothetical clinical scenarios involving observations, semi-structured interviews, and administration of the System Usability Scale.

RESULTS

This novel process was used to develop deprescribing guides that facilitate implementation of evidence on deprescribing in routine hospital care. The guides present evidence-based information in a format that aligns with workflows of multidisciplinary hospital clinicians. The guides were adapted for various clinical roles to navigate efficiently to suit differing workflow needs. Guides include unique communication support in the form of "preferred language". Clinicians can use the "preferred language" to apply the evidence to the individual patient and relay decisions between health providers and with patients/carers. The total System Usability Scale score was 80.6 ± 2.0 (mean ± standard error of the mean), indicating excellent usability. Guides have been developed using consistent format for nine medication classes that are common targets for deprescribing and are publicly available.

CONCLUSION

This study demonstrates a novel approach to the development and implementation of evidence-based recommendations that support deprescribing in routine hospital care.

A group intervention to improve quality of life for people with advanced dementia living in care homes: the Namaste feasibility cluster RCT

BACKGROUND

People with advanced dementia who live and die in nursing homes experience variable quality of life, care and dying. There is a need to identify appropriate, cost-effective interventions that facilitate high-quality end-of-life care provision.

OBJECTIVES

To establish the feasibility and acceptability to staff and family of conducting a cluster randomised controlled trial of the Namaste Care intervention for people with advanced dementia in nursing homes.

DESIGN

The study had three phases: (1) realist review and (2) intervention refinement to inform the design of (3) a feasibility cluster randomised controlled trial with a process evaluation and economic analysis. Clusters (nursing homes) were randomised in a 3 : 1 ratio to intervention or control (usual care). The nature of the intervention meant that blinding was not possible.

SETTING

Nursing homes in England providing care for people with dementia.

PARTICIPANTS

Residents with advanced dementia (assessed as having a Functional Assessment Staging Test score of 6 or 7), their informal carers and nursing home staff.

INTERVENTION

Namaste Care is a complex group intervention that provides structured personalised care in a dedicated space, focusing on enhancements to the physical environment, comfort management and sensory engagement.

MAIN OUTCOME MEASURES

The two contender primary outcome measures were Comfort Assessment in Dying - End of Life Care in Dementia for quality of dying (dementia) and Quality of Life in Late Stage Dementia for quality of life. The secondary outcomes were as follows: person with dementia, sleep/activity (actigraphy), neuropsychiatric symptoms, agitation and pain; informal carers, satisfaction with care at the end of life; staff members, person-centred care assessment, satisfaction with care at the end of life and readiness for change; and other data - health economic outcomes, medication/service use and intervention activity.

RESULTS

Phase 1 (realist review; 86 papers) identified that a key intervention component was the activities enabling the development of moments of connection. In phase 2, refinement of the intervention enabled the production of a user-friendly 16-page A4 booklet. In phase 3, eight nursing homes were recruited. Two homes withdrew before the intervention commenced; four intervention and two control homes completed the study. Residents with advanced dementia (n = 32) were recruited in intervention (n = 18) and control (n = 14) homes. Informal carers (total, n = 12: intervention, n = 5; control, n = 7) and 97 staff from eight sites (intervention, n = 75; control, n = 22) were recruited over a 6-month period. Recruitment is feasible. Completion rates of the primary outcome questionnaires were high at baseline (100%) and at 4 weeks (96.8%). The Quality of Life in Late Stage Dementia was more responsive to change over 24 weeks. Even where economic data were missing, these could be collected in a full trial. The intervention was acceptable; the dose varied depending on the staffing and physical environment of each care home. Staff and informal carers reported changes for the person with dementia in two ways: increased social engagement and greater calm. No adverse events related to the intervention were reported.

CONCLUSIONS

A subsequent definitive trial is feasible if there are amendments to the recruitment process, outcome measure choice and intervention specification.

FUTURE WORK

In a full trial, consideration is needed of the appropriate outcome measure that is sensitive to different participant responses, and of clear implementation principles for this person-centred intervention in a nursing home context.

TRIAL REGISTRATION

Current Controlled Trials ISRCTN14948133.

FUNDING

This project was funded by the National Institute for Health Research (NIHR) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 24, No. 6. See the NIHR Journals Library website for further project information.

Development of the U.S. Army’s Suicide Prevention Leadership Tool: The Behavioral Health Readiness and Suicide Risk Reduction Review (R4)

Introduction

Although numerous efforts have aimed to reduce suicides in the U.S. Army, completion rates have remained elevated. Army leaders play an important role in supporting soldiers at risk of suicide, but existing suicide-prevention tools tailored to leaders are limited and not empirically validated. The purpose of this article is to describe the process used to develop the Behavioral Health Readiness and Suicide Risk Reduction Review (R4) tools for Army leaders that are currently undergoing empirical validation with two U.S. Army divisions.

Materials and Methods

Consistent with a Secretary of the Army directive, approximately 76 interviews and focus groups were conducted with Army leaders and subject matter experts (SMEs) to obtain feedback regarding existing practices for suicide risk management, leader tools, and institutional considerations. In addition, reviews of the empirical literature regarding predictors of suicide and best practices for the development of practice guidelines were conducted. Qualitative feedback, empirical predictors of suicide, and design considerations were integrated to develop the R4 tools. A second series of 11 interviews and focus groups with Army leaders and SMEs was also conducted to validate the design and obtain feedback regarding the R4 tools.

Results

Leaders described preferences for tool processes (eg, incorporating engaged leadership, including multiple risk identification methods), formatting (eg, one page), organization (eg, low-intermediate-high risk scoring system), content (eg, excluding other considerations related to vehicle safety, including readiness implications), and implementation (eg, accounting for leadership judgment, tailoring process to specific leadership echelons, consideration of institutional barriers). Evidence-based predictors of suicide risk and practice guideline considerations (eg, design) were integrated with leadership feedback to develop the R4 tools that were tailored to specific leadership echelons. Leaders provided positive feedback regarding the R4 tools and described the importance of accounting for potential institutional barriers to implementation. This feedback was addressed by including recommendations regarding the implementation of standardized support meetings between different echelons of leadership.

Conclusions

The R4 development process entailed the simultaneous integration of leadership feedback with evidence-based predictors of suicide risk and design considerations. Thus, the development of these tools builds upon previous Army leadership tools by specifically tailoring elements of those tools to accommodate leader preferences, accounting for potential implementation barriers (eg, institutional factors), and empirically evaluating the implementation of those tools. Future studies should consider utilizing a similar process to develop empirically based resources that are more likely to be incorporated into the routine practice of leaders supporting soldiers at risk of suicide, very often located at the company level and below.

A four-stage process for intervention description and guide development of a practice-based intervention: refining the Namaste Care intervention implementation specification for people with advanced dementia prior to a feasibility cluster randomised trial

Background

Some interventions are developed from practice, and implemented before evidence of effect is determined, or the intervention is fully specified. An example is Namaste Care, a multi-component intervention for people with advanced dementia, delivered in care home, community, hospital and hospice settings. This paper describes the development of an intervention description, guide and training package to support implementation of Namaste Care within the context of a feasibility trial. This allows fidelity to be determined within the trial, and for intervention users to understand how similar their implementation is to that which was studied.

Methods

A four-stage approach: a) Collating existing intervention materials and drawing from programme theory developed from a realist review to draft an intervention description. b) Exploring readability, comprehensibility and utility with staff who had not experienced Namaste Care. c) Using modified nominal group techniques with those with Namaste Care experience to refine and prioritise the intervention implementation materials. d) Final refinement with a patient and public involvement panel.

Results

Eighteen nursing care home staff, one carer, one volunteer and five members of our public involvement panel were involved across the study steps. A 16-page A4 booklet was designed, with flow charts, graphics and colour coded information to ease navigation through the document. This was supplemented by infographics, and a training package. The guide describes the boundaries of the intervention and how to implement it, whilst retaining the flexible spirit of the Namaste Care intervention.

Conclusions

There is little attention paid to how best to specify complex interventions that have already been organically implemented in practice. This four-stage process may have utility for context specific adaptation or description of existing, but untested, interventions. A robust, agreed, intervention and implementation description should enable a high-quality future trial. If an effect is determined, flexible practice implementation should be enabled through having a clear, evidence-based guide.

Disseminating the Results of a Depression Management Study in an Urban Alaska Native Health Care System

Increased attention to diagnostic accuracy in depression screening and management within primary care has demonstrated inadequate care when patients prematurely discontinue recommended treatments such as medication and counseling. Decision-support tools can enhance the medical decision-making process. In 2010, the Southcentral Foundation (SCF) Research Department developed a stakeholder-driven decision support tool to aid in depression management. This paper describes feedback from attendees at SCF's 2016 Alaska Native Health Research Forum (Forum) regarding a dissemination product highlighting the aforementioned study. Forum attendees participated in a small group discussion and responded to a brief survey using the audience response system. Thematic analysis was conducted on data from the small group discussion. Overall, Forum attendees responded favorably to the dissemination product. Most agreed the presentation was clear, the amount of information presented was appropriate, and that results were presented in an interesting way. Small group discussion participants provided constructive feedback about why depression-related research results should be shared; how they believed results should be best shared; who results should be shared with; when and where results should be shared; and what level of research results should be shared. The stigma associated with depression treatment may be assuaged if results are shared in a way that normalizes support for depression treatment. Community member involvement in disseminating results has potential to make information more acceptable and meaningful.

[Needs assessment to improve the applicability and methodological quality of a German S3 guideline]

BACKGROUND

Clinical practice guidelines can change the practice in healthcare only if their recommendations are implemented in a comprehensive way. The German S3 guideline "Local Therapy of Chronic Wounds in Patients with Peripheral Vascular Disease, Chronic Venous Insufficiency, and Diabetes" will be updated in 2017. The emphasis here is on the guideline's validity, user-friendliness and implementation into practice. Therefore, the aim was to identify the improvements required in regard to the guideline's methods and content presentation.

METHODS

The methodological approach used was the critical appraisal of the guideline according to established quality criteria and an additional stakeholder survey. Both were conducted between August and November 2016. The guideline and its related documents were reviewed independently by two researchers according to the criteria of the "Appraisal of Guidelines for Research and Evaluation" (AGREE-II). Published reviews and peer reviews by external experts and organisations were also taken into account. For the stakeholder survey, a questionnaire with open questions was distributed by e-mail and via the Internet to health professionals and organisations involved in the care of patients with leg ulcers in Germany. The questions were aimed at amendments and new topics based on the stakeholders' experience in inpatient and outpatient care. In addition, the survey focused on gathering suggestions to improve the applicability of the guideline. Suggested new topics and amendments were summarised thematically. The stakeholders' suggestions to improve the applicability, the results of the critical appraisal and the relevant aspects of the external reviews were then summarised according to the AGREE-II domains and presented in a cause and effect diagram.

RESULTS

17 questionnaires (out of 864 sent out by e-mail) were returned. Due to high practice relevance, the stakeholders suggested an expansion of the inclusion criteria to patients with infected wounds and pressure ulcers. They also proposed that plastic surgical procedures, several specific wound products and complementary measures should be included. The guideline is of high methodical quality with respect to the systematic synthesis and the formal expert recommendations. From both the stakeholders' and reviewers' perspectives, the guideline should be more in line with what guideline users regarded as key issues. The recommendations should be more action-oriented. Implementation concepts should be provided to teach, implement and evaluate the guideline in healthcare facilities. The updating process should also follow current standards for guideline development, for systematic reviews and for managing conflict of interests.

CONCLUSION

The guideline is of high methodological quality but currently difficult to implement in clinical practice. The structured evaluation clearly reflects not only the potential for improvement but also provides a transparent theoretical framework for experts and scientific medical societies involved in the guideline updating process. Although some valuable insights were gained from the stakeholders' perspective, the representativeness is limited by the low response rate.

Naturalistic study of guideline implementation tool use via evaluation of website access and physician survey

Background

Clinical guidelines support decision-making at the point-of-care but the onus is often on individual users such as physicians to implement them. Research shows that the inclusion of implementation tools in or with guidelines (GItools) is associated with guideline use. However, there is little research on which GItools best support implementation by individual physicians. The purpose of this study was to investigate naturalistic access and use of GItools produced by the American Academy of Neurology (AAN) to inform future tool development.

Methods

Website accesses over six months were summarized for eight AAN guidelines and associated GItools published between July 2012 and August 2013. Academy members were surveyed about use of tools accompanying the sport concussion guideline. Data were analyzed using summary statistics and the Chi-square test.

Results

The clinician summary was accessed more frequently (29.0%, p < 0.001) compared with the slide presentation (26.8%), patient summary (23.2%) or case study (20.9%), although this varied by guideline topic. For the sport concussion guideline, which was accompanied by a greater variety of GItools, the mobile phone quick reference check application was most frequently accessed, followed by the clinician summary, patient summary, and slide presentation. For the sports concussion guideline survey, most respondents (response rate 21.8%, 168/797) were aware of the guideline (88.1%) and had read the guideline (78.6%). For GItool use, respondents indicated reading the reference card (51.2%), clinician summary (45.2%), patient summary (28.0%), mobile phone application (26.2%), and coach/athletic trainer summary (20.2%). Patterns of sports concussion GItool use were similar between respondents who said they had and had not yet implemented the guideline.

Conclusions

Developers faced with resource limitations may wish to prioritize the development of printable or mobile application clinician summaries, which were accessed significantly more than other types of GItools. Further research is needed to understand how to optimize the design of such GItools.

Redesigning printed educational materials for primary care physicians: design improvements increase usability

BACKGROUND

Printed educational materials (PEMs) are a frequently used tool to disseminate clinical information and attempt to change behavior within primary care. However, their effect on clinician behavior is limited. In this study, we explored how PEMs can be redesigned to better meet the needs of primary care physicians (PCPs) and whether usability and selection can be increased when design principles and user preferences are used.

METHODS

We redesigned a publicly available PEM using physician preferences, design principles, and graphic designer support. We invited PCPs to select their preferred document between the redesigned and original versions in a discrete choice experiment, followed by an assessment of usability with the System Usability Scale and a think aloud process. We conducted this study in both a controlled and opportunistic setting to determine whether usability testing results vary by study location. Think aloud data was thematically analyzed, and results were interpreted using the Technology Acceptance Model.

RESULTS

One hundred and eighty four PCPs participated in the discrete choice experiment at the 2014 Family Medicine Forum, a large Canadian conference for family physicians. Of these, 87.7 % preferred the redesigned version. Follow-up interviews were held with a randomly selected group of seven participants. We repeated this in a controlled setting in Toronto, Canada, with a set of 14 participants. Using the System Usability Scale, we found that usability scores were significantly increased with the redesign (p < 0.001). We also found that when PCPs were given the choice between the two versions, they selected the redesigned version as their preferred PEM more often than the original (p < 0.001). Results did not appear to differ between the opportunistic and controlled setting. We used the results of the think aloud process to add to a list of end user preferences developed in a previous study.

CONCLUSIONS

We found that redesigning a PEM with user preferences and design principles can improve its usability and result in the PEM being selected more often than the original. We feel this finding supports the involvement of the user, application of design principles, and the assistance of a graphic designer in the development of PEMs.