Improving the user experience of patient versions of clinical guidelines: user testing of a Scottish Intercollegiate Guideline Network (SIGN) patient version

Recommendations to improve use and dissemination of patient versions of oncological clinical practice guidelines in Germany: results of a multi-stakeholder workshop

BACKGROUND

Oncological patients have high information needs that are often unmet. Patient versions of oncological clinical practice guidelines (PVG) translate clinical practice guidelines into laypersons' language and might help to address patients' information needs. Currently, 30 oncological PVG have been published in Germany and more are being developed. Following a large multi-phase project on oncological PVGs in Germany, recommendations to improve use and dissemination of PVG were adopted in a multi-stakeholder workshop.

METHODS

Organisations representing users of PVGs (patients, medical personnel, and multipliers), creators, initiators/funding organisations of PVGs, and organisations with methodological expertise in the development of clinical practice guidelines or in patient health information were invited to participate. The workshop included a World Café for discussion of pre-selected recommendations and structured consensus procedure for of all recommendations. Recommendations with agreement of > 75% were approved, and in case of ≤ 75% agreement, recommendations were rejected.

RESULTS

The workshop took place on 24th April 2023 in Cologne, Germany. Overall, 23 people from 24 organisations participated in the discussion. Of 35 suggested recommendations 28 recommendations reached consensus and were approved. The recommendations referred to the topics dissemination (N = 13), design and format (N = 7), (digital) links (N = 5), digitalisation (N = 4), up-to-dateness (N = 3), and use of the PVG in collaboration between healthcare providers and patients (N = 3).

CONCLUSION

The practical recommendations consider various perspectives and can help to improve use and dissemination of oncological PVG in Germany. The inclusion of different stakeholders could facilitate the transfer of the results into practice.

Plain Language vs Standard Format for Youth Understanding of COVID-19 Recommendations: A Randomized Clinical Trial

Importance

To ensure that youths can make informed decisions about their health, it is important that health recommendations be presented for understanding by youths.

Objective

To compare understanding, accessibility, usability, satisfaction, intention to implement, and preference of youths provided with a digital plain language recommendation (PLR) format vs the original standard language version (SLV) of a health recommendation.

Design, Setting, and Participants

This pragmatic, allocation-concealed, blinded, superiority randomized clinical trial included individuals from any country who were 15 to 24 years of age, had internet access, and could read and understand English. The trial was conducted from May 27 to July 6, 2022, and included a qualitative component.

Interventions

An online platform was used to randomize youths in a 1:1 ratio to an optimized digital PLR or SLV format of 1 of 2 health recommendations related to the COVID-19 vaccine; youth-friendly PLRs were developed in collaboration with youth partners and advisors.

Main Outcomes and Measures

The primary outcome was understanding, measured as the proportion of correct responses to 7 comprehension questions. Secondary outcomes were accessibility, usability, satisfaction, preference, and intended behavior. After completion of the survey, participants indicated their interest in completing a 1-on-1 semistructured interview to reflect on their preferred digital format (PLR or SLV) and their outcome assessment survey response.

Results

Of the 268 participants included in the final analysis, 137 were in the PLR group (48.4% female) and 131 were in the SLV group (53.4% female). Most participants (233 [86.9%]) were from North and South America. No significant difference was found in understanding scores between the PLR and SLV groups (mean difference, 5.2%; 95% CI, -1.2% to 11.6%; P = .11). Participants found the PLR to be more accessible and usable (mean difference, 0.34; 95% CI, 0.05-0.63) and satisfying (mean difference, 0.39; 95% CI, 0.06-0.73) and had a stronger preference toward the PLR (mean difference, 4.8; 95% CI, 4.5-5.1 [4.0 indicated a neutral response]) compared with the SLV. No significant difference was found in intended behavior (mean difference, 0.22 (95% CI, -0.20 to 0.74). Interviewees (n = 14) agreed that the PLR was easier to understand and generated constructive feedback to further improve the digital PLR.

Conclusions and Relevance

In this randomized clinical trial, compared with the SLV, the PLR did not produce statistically significant findings in terms of understanding scores. Youths ranked it higher in terms of accessibility, usability, and satisfaction, suggesting that the PLR may be preferred for communicating health recommendations to youths. The interviews provided suggestions for further improving PLR formats.

Trial Registration

ClinicalTrials.gov Identifier: NCT05358990.

Heterogeneous methodology in the development of patient versions of clinical practice guidelines: a scoping review

OBJECTIVES

We aimed to gain an overview of the methods and approaches used to develop, disseminate, and implement patient versions of clinical practice guidelines (PVGs).

METHODS

We searched PubMed and MEDLINE through Ovid for articles reporting on the development, dissemination, or implementation of PVGs until March 2022. We searched the homepages of guideline organizations, screened the reference lists of the included documents, and asked experts to complement the publications. We narratively synthesized the findings.

RESULTS

Of 3,941 publications screened, 27 were included in the study. The identified method reports focused on patient involvement and peer-review processes. The other included publications highlighted the relevance of broad dissemination strategies and emphasized the importance of patient involvement and improving the readability of PVGs by using lay terms and shorter sentences.

CONCLUSION

The terminology used for PVGs varies widely. The extent to which the methods were described was heterogeneous. Organizations developing PVGs should make their methods publicly available and use uniform labeling for PVGs in English to improve their use and recognition, not only for other PVG producers but also for patients and the public. A consensus regarding a minimum reporting standard for developing PVGs internationally and developing guiding principles is desirable.

The perceptions and experience of developing patient (version of) guidelines: a descriptive qualitative study with Chinese guideline developers

OBJECTIVE

To understand developers' perception of patient (versions of) guidelines (PVGs), and identify challenges during the PVG development, with the aim to inform methodological guidance for future PVG development.

METHODS

We used a descriptive qualitative design. Semi-structured interviews were conducted virtually from December 2021 to April 2022, with a purposive sampling of 12 PVG developers from nine teams in China. Conventional and directed content analysis was used for data analysis.

RESULTS

The interviews identified PVG developers' understanding of PVGs, their current practice experience, and the challenges of developing PVGs. Participants believed PVGs were a type of health education material for patients; therefore, it should be based on patient needs and be understandable and accessible. Participants suggested that PVGs could be translated/adapted from one or several clinical practice guidelines (CPG), or developed de novo (i.e., the creation of an entirely new PVG with its own set of research questions that are independent of existing CPGs). Participants perceived those existing methodological guidelines for PVG development might not provide clear instructions for PVGs developed from multiple CPGs and from de novo development. Challenges to PVG development include (1) a lack of standardized and native guidance on developing PVGs; (2) a lack of standardized guidance on patient engagement; (3) other challenges: no publicly known and trusted platform that could disseminate PVGs; concerns about the conflicting interests with health professionals.

CONCLUSIONS AND PRACTICE IMPLICATIONS

Our study suggests clarifying the concept of PVG is the primary task to develop PVGs and carry out related research. There is a need to make PVG developers realize the roles of PVGs, especially in helping decision-making, to maximize the effect of PVG. It is necessary to develop native consensus-based guidance considering developers' perspectives regarding PVGs.

User testing of a Scottish Intercollegiate Guideline Network public guideline for the parents of children with autism

Background

The Scottish Intercollegiate Guidelines Network (SIGN) is the leading national clinical guideline producer in Scotland. Improved design and dissemination of guidelines produced for the public can empower people to take an active role in self-management and shared decision-making. The public version of the guideline examined covered getting assessed and diagnosed with autism, and approaches that can help. The aim of this study was to test a public version of a guideline for the parents of children and young people with autism, implement improvements, and identify what works in making it usable and accessible.

Methods

We recruited mothers from across Scotland. User testing involved formal ‘think aloud’ semi-structured interviews that guided users through the booklet. Interviews took place individually and were recorded and transcribed. Key findings were identified and themed using the honeycomb user experience model.

Results

Fourteen user-testing interviews were conducted. Facilitators for usability and desirability of the guideline included the chunking of text, consistent use of colour and boxes to highlight important information. Simple language, written in a tone of partnership, helped to engage mothers. Value arose from the guidelines ability to explain the process of diagnosis and make mothers feel empowered in their relationships with healthcare professionals. There was a lack of consensus on the usefulness of rating the strength of evidence and recommendations.

Conclusion

There was a marked similarity between what was important to the mothers and what has been found to be important to other groups. The involvement of service users and carers in the guidelines development was key to its credibility. One size does not fit all in presenting evidence-based recommendations to the public and it is a challenge to provide sufficient information while avoiding information overload. Recommendations and evidence levels are suitable for use in public versions, but these should be kept as simple as possible.

Focus groups and interviews with the public led to the development of a template for a GRADE Plain Language Recommendation (PLR)

OBJECTIVE

Clear communication of health care recommendations to patients and the public is essential. Current work has focused on creating patient versions of guidelines without much attention to single recommendations. In this study, we built on previously conducted research to test a template and explore the public's perceptions of, and attitudes towards plain language guideline recommendations.

STUDY DESIGN AND SETTING

We conducted four focus groups with people interested in healthy aging to obtain general attitudes, perceptions, and understanding of recommendations. We then conducted nine user-tests of Plain Language Recommendations developed from GRADE guidelines. We performed a directed content analysis, and finalized a template for a Plain Language Recommendation.

RESULTS

We identified themes related to personalized information; strength of recommendations; support with health care and appointments; amount and credibility of information; and formatting. When recommendations were conditional, participants wanted more information about why and what to consider. The template for a Plain Language Recommendation is available in the GRADEpro software to facilitate automation.

CONCLUSION

We created a Plain Language Recommendation template to communicate specific information from guidelines to patients and the public. Broad application of the template is warranted and future research could measure the impact on understanding and behavior change.

User testing a patient information resource about potential complications of vaginally inserted synthetic mesh

BACKGROUND

Vaginal mesh implants are medical devices used in a number of operations to treat stress urinary incontinence and pelvic organ prolapse. Although many of these operations have delivered good outcomes, some women have experienced serious complications that have profoundly affected their quality of life. To ensure that evolving patient information is up-to-date, accurate and appropriate, the Transvaginal Mesh Oversight Group 'user-tested' a newly developed Scottish patient resource, the first to focus exclusively on the issue of complications. The aim of this research was to gather feedback on usability, content, language and presentation to inform the development of the resource from a user perspective.

METHODS

The experience of using the patient resource was captured through semi-structured interviews that followed a 'think-aloud' protocol. The interviewer observed each participant as they went through the resource, asking questions and making field notes. Participants' comments were then categorised using a validated model of user experience and subsequently analysed thematically.

RESULTS

Thirteen people participated in the user testing interviews, including women with lived experience of mesh implants (n = 7), a convenience sample of staff working for Healthcare Improvement Scotland (n = 5) and a patient's carer (n = 1). The majority of participants considered the resource as clear and helpful. Respondents reported that some presentational aspects promoted usability and understandability, including the use of a font that is easy to read, bullet lists, coloured headings and simple language. Barriers included the reliance on some technical language and an explicit anatomical diagram. Participants endorsed the valuable role of health professionals as co-mediators of patient information.

CONCLUSIONS

The findings illustrate the value of undertaking in-depth user-testing for patient information resources before their dissemination. The study highlighted how the direct guidance or navigation of a patient information resource by a health professional could increase its salience and accuracy of interpretation by patients, their families and carers. These insights may also be useful to other developers in improving patient information.

The reporting checklist for public versions of guidelines: RIGHT-PVG

BACKGROUND

Public or patient versions of guidelines (PVGs) are derivative documents that "translate" recommendations and their rationale from clinical guidelines for health professionals into a more easily understandable and usable format for patients and the public. PVGs from different groups and organizations vary considerably in terms of quality of their reporting. In order to address this issue, we aimed to develop a reporting checklist for developers of PVGs and other potential users.

METHODS

First, we collected a list of potential items through reviewing a sample of PVGs, existing guidance for developing and reporting PVGs or other similar evidence-based patient tools, as well as qualitative studies on original studies of patients' needs about the content and/or reporting of information in PVGs or similar evidence-based patient tools. Second, we conducted a two-round Delphi consultation to determine the level of consensus on the items to be included in the final reporting checklist. Third, we invited two external reviewers to provide comments on the checklist.

RESULTS

We generated the initial list of 45 reporting items based on a review of a sample of 30 PVGs, four PVG guidance documents, and 46 relevant studies. After the two-round Delphi consultation, we formed a checklist of 17 items grouped under 12 topics for reporting PVGs.

CONCLUSION

The RIGHT-PVG reporting checklist provides an international consensus on the important criteria for reporting PVGs.

The effectiveness of digital multimedia presentation of trial information on recruitment and retention of patients: Protocol for a study within a trial (SWAT)

Background: Studies within trials (SWATs) present an opportunity to examine design factors that may impact on the successful delivery of trials. One area in need of research is trial recruitment. Recruiting patients to trials is a major challenge facing trialists. Failure to meet recruitment targets can result in delays and underpowered studies. This SWAT evaluates the effectiveness of hand-held digital multimedia presentation of trial information and standard written patient information to potential participants on recruitment and retention to a host trial. Methods: This is the protocol for SWAT 15, a two-group, embedded parallel randomised controlled trial (RCT) (ISRCTN12838042) designed within a host trial - the SATIN trial (ISRCTN88111427), a RCT designed for implementation in the Irish primary care setting. The SWAT eligibility criteria was determined by the host trial. General practices who agree to participate in the host trial will provide women (participants) who are willing to consider participating in the host trial with either a multimedia digital information resource facilitated through a handheld tablet device, plus a written participant information leaflet (Intervention) or a written participant information leaflet (comparator). Outcomes are recruitment and retention to the host SATIN trial and participant's quality of decision-making. Discussion: Although designed to be implemented in a host trial, the host trial, was suspended and therefore this SWAT was not implemented. The protocol and the lessons learnt whilst developing it offer guidance to researchers who wish to answer similar research questions in the future in a similar context or setting.   Trial registration: ISRCTN Registry ISRCTN12838042 (11/10/2017).

Co-Creation with Older Adults to Improve User-Experience of a Smartphone Self-Test Application to Assess Balance Function

This co-creation study aimed to develop a smartphone self-test application for balance and leg strength in collaboration between older adults and the research team. The paper describes older participants’ preferences for, and their contribution to, the application design. Technology to assess movements is available in smartphones with built-in sensors, and one of the challenges is to develop a valuable self-test for older adults. The participants contributed to the design of the application’s instructions and user interface. Multiple data collection methods were used: user-test with Think aloud method, mock-ups, homework assignment as co-researcher, audio and video recordings. Qualitative content analysis with a deductive-inductive approach was used, guided by the Optimized Honeycomb model for user experience (UX) as a categorization matrix. The analysis resulted in 17 subcategories within the seven facets of the UX Honeycomb model (findable, accessible, usable, desirable, credible, useful, and valuable), and describes the older participants’ preferences and experiences. The main results were participants’ desire to know why, to get clear and appropriate information, and expectations of the self-test to be useful. It was feasible and valuable to develop the self-test application in co-creation with the intended user-group, in order to get direct feedback and suggestions for the development.

How do guideline developers identify, incorporate and report patient preferences? An international cross-sectional survey

Background

Guidelines based on patient preferences differ from those developed solely by clinicians and may promote patient adherence to guideline recommendations. There is scant evidence on how to develop patient-informed guidelines. This study aimed to describe how guideline developers identify, incorporate and report patient preferences.

Methods

We employed a descriptive cross-sectional survey design. Eligible organizations were non-profit agencies who developed at least one guideline in the past five years and had considered patient preferences in guideline development. We identified developers through the Guidelines International Network and publicly-available guideline repositories, administered the survey online, and used summary statistics to report results.

Results

The response rate was 18.3% (52/284). Respondents included professional societies, and government, academic, charitable and healthcare delivery organizations from 18 countries with at least 1 to ≥6 years of experience generating patient-informed guidelines. Organizations most frequently identified preferences through patient panelists (86.5%) and published research (84.6%). Most organizations (48, 92.3%) used multiple approaches to identify preferences (median 3, range 1 to 5). Most often, organizations used preferences to generate recommendations (82.7%) or establish guideline questions (73.1%). Few organizations explicitly reported preferences; instead, they implicitly embedded preferences in guideline recommendations (82.7%), questions (73.1%), or point-of-care communication tools (61.5%). Most developers had little capacity to generate patient-informed guidelines. Few offered training to patients (30.8%), or had dedicated funding (28.9%), managers (9.6%) or staff (9.6%). Respondents identified numerous barriers to identifying preferences. They also identified processes, resources and clinician- and patient-strategies that can facilitate the development of patient-informed guidelines. In contrast to identifying preferences, developers noted few approaches for, or barriers or facilitators of incorporating or reporting preferences.

Conclusions

Developers emphasized the need for knowledge on how to identify, incorporate and report patient preferences in guidelines. In particular, how to use patient preferences to formulate recommendations, and transparently report patient preferences and the influence of preferences on guidelines is unknown. Still, insights from responding developers may help others who may be struggling to generate guidelines informed by patient preferences.

Comparative Usability Analysis and Parental Preferences of Three Web-Based Knowledge Translation Tools: Multimethod Study

BACKGROUND

Connecting parents to research evidence is known to improve health decision making. However, guidance on how to develop effective knowledge translation (KT) tools that synthesize child-health evidence into a form understandable by parents is lacking.

OBJECTIVE

The aim of this study was to conduct a comparative usability analysis of three Web-based KT tools to identify differences in tool effectiveness, identify which format parents prefer, and better understand what factors affect usability for parents.

METHODS

We evaluated a Cochrane plain language summary (PLS), Blogshot, and a Wikipedia page on a specific child-health topic (acute otitis media). A mixed method approach was used involving a knowledge test, written usability questionnaire, and a semistructured interview. Differences in knowledge and usability questionnaire scores for each of the KT tools were analyzed using Kruskal-Wallis tests, considering a critical significance value of P=.05. Thematic analysis was used to synthesize and identify common parent preferences among the semistructured interviews. Key elements parents wanted in a KT tool were derived through author consensus using questionnaire data and parent interviews.

RESULTS

In total, 16 parents (9 female) with a mean age of 39.6 (SD 11.9) years completed the study. Parents preferred the Blogshot over the PLS and Wikipedia page (P=.002) and found the Blogshot to be the most aesthetic (P=.001) and easiest to use (P=.001). Knowledge questions and usability survey data also indicated that the Blogshot was the most preferred and effective KT tool at relaying information about the topic. Four key themes were derived from thematic analysis, describing elements parents valued in KT tools. Parents wanted tools that were (1) simple, (2) quick to access and use, and (3) trustworthy, and which (4) informed how to manage the condition. Out of the three KT tools assessed, Blogshots were the most preferred tool by parents and encompassed these four key elements.

CONCLUSIONS

It is important that child health evidence be available in formats accessible and understandable by parents to improve decision making, use of health care resources, and health outcomes. Further usability testing of different KT tools should be conducted involving broader populations and other conditions (eg, acute vs chronic) to generate guidelines to improve KT tools for parents.

Technology use and preferences to support clinical practice guideline awareness and adherence in individuals with sickle cell disease

Objective

Sickle cell disease (SCD) is a chronic condition affecting over 100 000 individuals in the United States, predominantly from vulnerable populations. Clinical practice guidelines, written for providers, have low adherence. This study explored knowledge about guidelines; desire for guidelines; and how technology could support guideline awareness and adherence, examining current technology uses, and user preferences to inform design of a patient-centered guidelines application in a chronic disease.

Methods

This cross-sectional mixed-methods study involved semi-structured interviews, surveys, and focus groups of adolescents and adults with SCD. We evaluated interest, preferences, and anticipated benefits or barriers of a patient-centered adaptation of SCD practice guidelines; prospective technology uses for health; and barriers to technology utilization.

Results

Forty-seven individuals completed surveys and interviews, and 39 participated in three separate focus groups. Most participants (91%) were unaware of SCD guidelines, but almost all (96%) expressed interest in a guidelines application, identifying benefits (knowledge, activation, individualization, and rewards), and barriers (poor information, low motivation, and resource limitations). Current technology health uses included information access, care coordination, and reminders about health-related actions. Prospective technology uses included informational messaging and timely alerts. Barriers to technology use included lack of interest, lack of utility, and preference for direct communication.

Conclusions

This study's findings can inform the design of clinical practice guideline applications, suggesting a promising role for technology to engage patients, facilitate care decisions and actions, and improve outcomes.

Adapting medical guidelines to be patient-centered using a patient-driven process for individuals with sickle cell disease and their caregivers

Background

Evidence-based guidelines for sickle cell disease (SCD) health maintenance and management have been developed for primary health care providers, but not for individuals with SCD. To improve the quality of care delivered to individuals with SCD and their caregivers, the main purposes of this study were to: (1) understand the desire for patient-centered guidelines among the SCD community; and (2) adapt guideline material to be patient-centered using community-engagement strategies involving health care providers, community -based organizations, and individuals with the disease.

Methods

From May–December 2016, a volunteer sample of 107 individuals with SCD and their caregivers gave feedback at community forums (n = 64) and community listening sessions (n = 43) about technology use for health information and desire for SCD-related guidelines. A team of community research partners consisting of community stakeholders, individuals living with SCD, and providers and researchers (experts) in SCD at nine institutions adapted guidelines to be patient-centered based on the following criteria: (1) understandable, (2) actionable, and (3) useful.

Results

In community forums (n = 64), almost all participants (91%) wanted direct access to the content of the guidelines. Participants wanted guidelines in more than one format including paper (73%) and mobile devices (79%). Guidelines were adapted to be patient-centered. After multiple iterations of feedback, 100% of participants said the guidelines were understandable, most (88%) said they were actionable, and everyone (100%) would use these adapted guidelines to discuss their medical care with their health care providers.

Conclusions

Individuals with SCD and their caregivers want access to guidelines through multiple channels, including technology. Guidelines written for health care providers can be adapted to be patient-centered using Community-engaged research involving providers and patients. These patient-centered guidelines provide a framework for patients to discuss their medical care with their health care providers.

Electronic supplementary material

The online version of this article (10.1186/s12878-018-0106-3) contains supplementary material, which is available to authorized users.

OP33 Developing A Public Version Of A Health Technology Assessment Report

INTRODUCTION:

As the Health Technology Assessment (HTA) community moves towards greater levels of Patient and Public Involvement (PPI), the need to communicate with the public about the results and impact of HTA, and of PPI itself, is also increasing. DECIDE was a European Commission funded collaborative project arising from the GRADE working group, which developed and evaluated strategies for effectively communicating the recommendations from clinical guidelines to a multiple stakeholders. The Scottish Intercollegiate Guidelines Network (SIGN) led the work stream on patients and the public (1, 2). We extended the findings to develop a patient/public version of an HTA on Antimicrobial Wound Dressings (AWDs). The clinical and cost effectiveness evidence was inconclusive (3) which increased the importance of engagement with clinical and patient/public stakeholders.

METHODS:

A literature review, and a series of focus groups and user testing informed the development of a set of principles for designing patient versions of guidelines (1,2). Using these principles developed by the DECIDE collaboration, a patient version of the HTA was developed, in partnership with public volunteers and a standing public communications advisory group.

RESULTS:

We incorporated key facilitators of usability, such as distinct branding as material for the public, a clearly communicated purpose, and the layering of information. Other facilitators included a “friendly” and accessible tone which was achieved by the use of colour, icons, simple language and charts, and brief chunked text. While feedback about clarity, design and usefulness was generally positive, some public reviewers were concerned by the level of uncertainty and complexity in the findings.

CONCLUSIONS:

Using the principles from the DECIDE project, it is feasible and useful to develop public versions of an HTA report. The patient version is currently informing the development of educational material for patients/public about chronic wounds and AWDs by the Scottish Government. However, it remains a challenge to balance the complexity and uncertainty underlying evidence-based recommendations, with the need to provide accessible, understandable, and yet accurate information about them for the public.

Participatory improvement of a template for informed consent documents in biobank research - study results and methodological reflections

Background

For valid informed consent, it is crucial that patients or research participants fully understand all that their consent entails. Testing and revising informed consent documents with the assistance of their addressees can improve their understandability. In this study we aimed at further developing a method for testing and improving informed consent documents with regard to readability and test-readers’ understanding and reactions.

Methods

We tested, revised, and retested template informed consent documents for biobank research by means of 11 focus group interviews with members from the documents’ target population. For the analysis of focus group excerpts we used qualitative content analysis. Revisions were made based on focus group feedback in an iterative process.

Results

Focus group participants gave substantial feedback on the original and on the revised version of the tested documents. Revisions included adding and clarifying explanations, including an info-box summarizing the main points of the text and an illustrative graphic.

Conclusion

Our results indicate positive effects on the tested and revised informed consent documents in regard to general readability and test-readers’ understanding and reactions. Participatory methods for improving informed consent should be more often applied and further evaluated for both, medical interventions and clinical research. Particular conceptual and methodological challenges need to be addressed in the future.

Electronic supplementary material

The online version of this article (10.1186/s12910-017-0232-7) contains supplementary material, which is available to authorized users.

An integrated conceptual framework for evaluating and improving 'understanding' in informed consent

Background

The development of understandable informed consent (IC) documents has proven to be one of the most important challenges in research with humans as well as in healthcare settings. Therefore, evaluating and improving understanding has been of increasing interest for empirical research on IC. However, several conceptual and practical challenges for the development of understandable IC documents remain unresolved.

Methods

In this paper, we will outline and systematize some of these challenges. On the basis of our own experiences in empirical user testing of IC documents as well as the relevant literature on understanding in IC, we propose an integrated conceptual model for the development of understandable IC documents.

Results

The proposed conceptual model integrates different methods for the participatory improvement of written information, including IC, as well as quantitative methods for measuring understanding in IC.

Conclusions

In most IC processes, understandable written information is an important prerequisite for valid IC. To improve the quality of IC documents, a conceptual model for participatory procedures of testing, revising, and retesting can be applied. However, the model presented in this paper needs further theoretical and empirical elaboration and clarification of several conceptual and practical challenges.

AMERICAN ASSOCIATION OF CLINICAL ENDOCRINOLOGISTS AND AMERICAN COLLEGE OF ENDOCRINOLOGY PROTOCOL FOR STANDARDIZED PRODUCTION OF CLINICAL PRACTICE GUIDELINES, ALGORITHMS, AND CHECKLISTS - 2017 UPDATE

Clinical practice guideline (CPG), clinical practice algorithm (CPA), and clinical checklist (CC, collectively CPGAC) development is a high priority of the American Association of Clinical Endocrinologists (AACE) and American College of Endocrinology (ACE). This 2017 update in CPG development consists of (1) a paradigm change wherein first, environmental scans identify important clinical issues and needs, second, CPA construction focuses on these clinical issues and needs, and third, CPG provide CPA node/edge-specific scientific substantiation and appended CC; (2) inclusion of new technical semantic and numerical descriptors for evidence types, subjective factors, and qualifiers; and (3) incorporation of patient-centered care components such as economics and transcultural adaptations, as well as implementation, validation, and evaluation strategies. This third point highlights the dominating factors of personal finances, governmental influences, and third-party payer dictates on CPGAC implementation, which ultimately impact CPGAC development. The AACE/ACE guidelines for the CPGAC program is a successful and ongoing iterative exercise to optimize endocrine care in a changing and challenging healthcare environment.

ABBREVIATIONS

AACE = American Association of Clinical Endocrinologists ACC = American College of Cardiology ACE = American College of Endocrinology ASeRT = ACE Scientific Referencing Team BEL = best evidence level CC = clinical checklist CPA = clinical practice algorithm CPG = clinical practice guideline CPGAC = clinical practice guideline, algorithm, and checklist EBM = evidence-based medicine EHR = electronic health record EL = evidence level G4GAC = Guidelines for Guidelines, Algorithms, and Checklists GAC = guidelines, algorithms, and checklists HCP = healthcare professional(s) POEMS = patient-oriented evidence that matters PRCT = prospective randomized controlled trial.

What do patients and the public know about clinical practice guidelines and what do they want from them? A qualitative study

BACKGROUND

Guideline producers are increasingly producing versions of guidelines for the public. The aim of this study was to explore what patients and the public understand about the purpose and production of clinical guidelines, and what they want from clinical guidelines to support their healthcare decisions.

METHODS

Participants were purposively selected to represent a range of the likely users of patient versions of guidelines, including individuals with health conditions (diabetes and depression), general members of the public, health communication professionals and a group of young people. Participants were asked about their awareness and understanding of clinical guidelines and presented with scenario recommendations, or draft materials from patient guidelines to prompt discussion. Each discussion was facilitated by one or two researchers. All focus groups were recorded and transcribed prior to analysis. Data were analysed using framework analysis.

RESULTS

We ran nine focus groups involving 62 individuals, supplemented by four interviews with people experiencing homelessness. Eight groups were held in Scotland, one in England. The four interviews were held in Scotland. The framework analysis yielded five themes: access and awareness; what patients want to know; properties of guidelines; presenting evidence; and format. Awareness of guidelines was low. Participants emphasised the need for information that enables them to choose between treatment options, including harms. They would like help with this from healthcare professionals, especially general practitioners. Participants differed in their support for the inclusion of numerical information and graphs.

CONCLUSIONS

Members of the public want information to help them choose between treatments, including information on harms, particularly to support shared decisions with health professionals. Presenting numerical information is a challenge and layered approaches that present information in stages may be helpful. Ignoring the themes identified in this study is likely to lead to materials that fail to support public and patient healthcare decision making.