101
|
Yen RW, Barr PJ, Cochran N, Aarts JW, Légaré F, Reed M, O'Malley AJ, Scalia P, Painchaud Guérard G, Backer G, Reilly C, Elwyn G, Durand MA. Medical Students' Knowledge and Attitudes Toward Shared Decision Making: Results From a Multinational, Cross-Sectional Survey. MDM Policy Pract 2019; 4:2381468319885871. [PMID: 31742232 PMCID: PMC6843737 DOI: 10.1177/2381468319885871] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2018] [Accepted: 08/19/2019] [Indexed: 11/16/2022] Open
Abstract
Introduction. We aimed to conduct a multinational cross-sectional online survey of medical students' attitudes toward, knowledge of, and experience with shared decision making (SDM). Methods. We conducted the survey from September 2016 until May 2017 using the following: 1) a convenience sample of students from four medical schools each in Canada, the United States, and the Netherlands (n = 12), and 2) all medical schools in the United Kingdom through the British Medical School Council (n = 32). We also distributed the survey through social media. Results. A total of 765 students read the information sheet and 619 completed the survey. Average age was 24, 69% were female. Mean SDM knowledge score was 83.6% (range = 18.8% to 100%; 95% confidence interval [CI] = 82.8% to 84.5%). US students had the highest knowledge scores (86.2%, 95% CI = 84.8% to 87.6%). The mean risk communication score was 57.4% (range = 0% to 100%; 95% CI = 57.4% to 60.1%). Knowledge did not vary with age, race, gender, school, or school year. Attitudes were positive, except 46% believed SDM could only be done with higher educated patients, and 80.9% disagreed that physician payment should be linked to SDM performance (increased with years in training, P < 0.05). Attitudes did not vary due to any tested variable. Students indicated they were more likely than experienced clinicians to practice SDM (72.1% v. 48.8%). A total of 74.7% reported prior SDM training and 82.8% were interested in learning more about SDM. Discussion. SDM knowledge is high among medical students in all four countries. Risk communication is less well understood. Attitudes indicate that further research is needed to understand how medical schools deliver and integrate SDM training into existing curricula.
Collapse
|
102
|
Alper BS, Price A, van Zuuren EJ, Fedorowicz Z, Shaughnessy AF, Oettgen P, Elwyn G, Qaseem A, Kunnamo I, Gupta U, Carter DD, Mittelman M, Berg-Nelson C, Mayer M. Consistency of Recommendations for Evaluation and Management of Hypertension. JAMA Netw Open 2019; 2:e1915975. [PMID: 31755945 PMCID: PMC6902818 DOI: 10.1001/jamanetworkopen.2019.15975] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/13/2022] Open
Abstract
IMPORTANCE Hypertension is very common, but guideline recommendations for hypertension have been controversial, are of increasing interest, and have profound implications. OBJECTIVE To systematically assess the consistency of recommendations regarding hypertension management across clinical practice guidelines (CPGs). DESIGN, SETTING, AND PARTICIPANTS This cross-sectional study of hypertension management recommendations included CPGs that had been published as of April 2018. Two point-of-care resources that provided graded recommendations were included for secondary analyses. Discrete and unambiguous specifications of the population, intervention, and comparison states were used to define a series of reference recommendations. Three raters reached consensus on coding the direction and strength of each recommendation made by each CPG. Three independent raters reached consensus on the importance of each reference recommendation. MAIN OUTCOMES AND MEASURES The main outcomes were rates of consistency for direction and strength among CPGs. Sensitivity analyses testing the robustness were conducted by excluding recommendation statements that were described as insufficient evidence, excluding single recommendation sources, and stratifying by importance of recommendations. RESULTS The analysis included 8 CPGs with a total of 71 reference recommendations, 68 of which had clear recommendations from 2 or more CPGs. Across CPGs, 22 recommendations (32%) were consistent in direction and strength, 18 recommendations (27%) were consistent in direction but inconsistent in strength, and 28 recommendations (41%) were inconsistent in direction. The rate of consistency was lower in secondary analyses. When insufficient evidence ratings were excluded, there was still substantial inconsistency, and a leave-one-out sensitivity analysis suggested the inconsistency could not be attributed to any single recommendation source. Inconsistency in direction was more common for recommendations deemed to be of lower importance (11 of 20 recommendations [55%]), but 17 of 48 high-importance recommendations (35%) had inconsistency in direction. CONCLUSIONS AND RELEVANCE Hypertension is a common chronic condition with widespread expectations surrounding guideline-based care, yet CPGs have a high rate of inconsistency. Further investigations should determine the reasons for inconsistency, the implications for recommendation development, and the role of synthesis across recommendations for optimal guidance of clinical care.
Collapse
|
103
|
Pel-Littel RE, Buurman BM, van de Pol MH, Yilmaz NG, Tulner LR, Minkman MM, Scholte Op Reimer WJM, Elwyn G, van Weert JCM. Measuring triadic decision making in older patients with multiple chronic conditions: Observer OPTION MCC. PATIENT EDUCATION AND COUNSELING 2019; 102:1969-1976. [PMID: 31279614 DOI: 10.1016/j.pec.2019.06.020] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/21/2018] [Revised: 05/24/2019] [Accepted: 06/20/2019] [Indexed: 06/09/2023]
Abstract
OBJECTIVE To develop a valid and reliable tool to measure triadic decision making between older adults with multiple chronic conditions (MCC), their informal caregivers and geriatricians. METHODS Video observational study with cross-sectional assessment of interaction during medical consultations between geriatricians (n = 10), patients (n = 108) and informal caregivers (68) by three calibrated raters at the geriatric outpatient department of two Dutch hospitals. The Observer OPTIONMCC instrument was developed, based on the 'Dynamic model of SDM in frail older patients' and the 'Observing Patient Involvement in Decision Making - 5 item scale' (Observer OPTION-5). RESULTS Factor analysis confirms that it is acceptable to regard the new scale as a single construct. The 7-item single factor solution explained 62.76% of the variability for geriatricians, 61.60% of the variability for patients and 54.32% of the variability for informal caregivers. The inter-rater ICC for the total Observer OPTIONMCC score was .96, .96, and .95 (resp. geriatricians, patients, informal caregivers), with values ranging from .60 to .95 for individual items, showing good levels of agreement. CONCLUSION AND PRACTICE IMPLICATIONS We conclude that Observer OPTIONMCC is sufficiently valid and reliable to be used for the assessment of triadic SDM in populations of older patients with MCC.
Collapse
|
104
|
Abstract
Objective: Definitions of shared decision-making (SDM) have largely neglected to consider goal setting as an explicit component. Applying SDM to people with multiple long-term conditions requires attention to goal setting. We propose an integrated model, which shows how goal setting, at 3 levels, can be integrated into the 3-talk SDM model. Method: The model was developed by integrating 2 published models. Results: An integrated, goal-based SDM model is proposed and applied to a patient with multiple, complex, long-term clinical conditions to illustrate the use of a visualization tool called a Goal Board. A Goal Board prioritizes collaborative goals and aligns goals with interventional options. Conclusion: The model provides an approach to achieve person-centered decision-making by not only eliciting and prioritizing goals but also by aligning prioritized goals and interventions. Practice Implications: Further research is required to evaluate the utility of the proposed model.
Collapse
|
105
|
Dreesens D, Stiggelbout A, Agoritsas T, Elwyn G, Flottorp S, Grimshaw J, Kremer L, Santesso N, Stacey D, Treweek S, Armstrong M, Gagliardi A, Hill S, Légaré F, Ryan R, Vandvik P, van der Weijden T. A conceptual framework for patient-directed knowledge tools to support patient-centred care: Results from an evidence-informed consensus meeting. PATIENT EDUCATION AND COUNSELING 2019; 102:1898-1904. [PMID: 31118137 DOI: 10.1016/j.pec.2019.05.003] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/28/2018] [Revised: 05/01/2019] [Accepted: 05/04/2019] [Indexed: 06/09/2023]
Abstract
OBJECTIVE Patient-directed knowledge tools are designed to engage patients in dialogue or deliberation, to support patient decision-making or self-care of chronic conditions. However, an abundance of these exists. The tools themselves and their purposes are not always clearly defined; creating challenges for developers and users (professionals, patients). The study's aim was to develop a conceptual framework of patient-directed knowledge tool types. METHODS A face-to-face evidence-informed consensus meeting with 15 international experts. After the meeting, the framework went through two rounds of feedback before informal consensus was reached. RESULTS A conceptual framework containing five patient-directed knowledge tool types was developed. The first part of the framework describes the tools' purposes and the second focuses on the tools' core elements. CONCLUSION The framework provides clarity on which types of patient-directed tools exist, the purposes they serve, and which core elements they prototypically include. It is a working framework and will require further refinement as the area develops, alongside validation with a broader group of stakeholders. PRACTICE IMPLICATIONS The framework assists developers and users to know which type a tool belongs, its purpose and core elements, helping them to develop and use the right tool for the right job.
Collapse
|
106
|
Scalia P, O'Malley AJ, Durand MA, Goodney PP, Elwyn G. Presenting time-based risks of stroke and death for Patients facing carotid stenosis treatment options: Patients prefer pie charts over icon arrays. PATIENT EDUCATION AND COUNSELING 2019; 102:1939-1944. [PMID: 31101429 DOI: 10.1016/j.pec.2019.05.004] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/28/2019] [Revised: 04/14/2019] [Accepted: 05/04/2019] [Indexed: 06/09/2023]
Abstract
OBJECTIVE To user-test graphical display formats (icon arrays, pie, bar, and line charts) to identify preferred formats and metrics ('probability of death or stroke' or 'proportion of time lived without death or stroke') in order to display time-dependent risks of stroke or death for three carotid stenosis treatments: endarterectomy (surgery), stenting, and medical therapy. METHODS Iterative cycles of semi-structured interviews with patients recruited from a Vascular Clinic. RESULTS A total of 27 patients (mean age = 68; range: 50-85) were interviewed over four cycles. Patients strongly preferred the pie chart over icon arrays, and over bar or line graphs. The preference was based on patient recognition of the time-based increase in risk for stroke or death for treatment options. Patients preferred data presented as probabilities instead of the proportion of time lived. We did not assess patients' understanding. CONCLUSION Patients preferred the pie chart formats and reported better realization that risks increase with time for each option and that tradeoffs exist when surgery has a higher short-term risk than medical therapy. PRACTICE IMPLICATIONS There remains debate on how best to convey time-dependent risk information to patients, especially where low literacy and numeracy might exist.
Collapse
|
107
|
Goldwag J, Marsicovetere P, Scalia P, Johnson HA, Durand MA, Elwyn G, Ivatury SJ. The impact of decision aids in patients with colorectal cancer: a systematic review. BMJ Open 2019; 9:e028379. [PMID: 31515416 PMCID: PMC6747873 DOI: 10.1136/bmjopen-2018-028379] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/18/2022] Open
Abstract
OBJECTIVES Our aim was to conduct a systematic review of the literature to determine the impact of patient decision aids (PDA) on patients facing treatment decisions for colorectal cancer. DESIGN Systematic review. DATA SOURCES Sources included Embase, Medline, Web of Science, CINAHL and the Cochrane Library from inception to June, 20, 2019. ELIGIBILITY CRITERIA We included randomised controlled trials (RCTs), cohort studies, mixed methods and case series in which a PDA for colorectal cancer treatment was used. Qualitative studies were excluded from our review. DATA EXTRACTION AND SYNTHESIS Following execution of the search strategy by a medical librarian, two blinded independent reviewers identified articles for inclusion. Two blinded reviewers were also responsible for data extraction, risk of bias and study quality assessments. Any conflict in article inclusion or extraction was resolved by discussion. RESULTS Out of 3773 articles identified, three met our inclusion criteria: one RCT, one before-and-after study and one mixed-method study. In these studies, the use of a PDA for colorectal cancer treatment was associated with increased patient knowledge, satisfaction and preparation for making a decision. On quality assessment, two of three studies were judged to be of low quality. CONCLUSION A paucity of evidence exists on the effect of PDA for colorectal cancer treatment with existing evidence being largely of low quality. Further investigation is required to determine the effect of decision aids for colorectal cancer treatment as well as reasons for the lack of PDA development and implementation in this area. PROSPERO REGISTRATION NUMBER CRD42018095153.
Collapse
|
108
|
Elwyn G, Nelson E, Hager A, Price A. Coproduction: when users define quality. BMJ Qual Saf 2019; 29:711-716. [PMID: 31488570 PMCID: PMC7467503 DOI: 10.1136/bmjqs-2019-009830] [Citation(s) in RCA: 70] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2019] [Revised: 08/14/2019] [Accepted: 08/16/2019] [Indexed: 02/04/2023]
|
109
|
Scalia P, Durand MA, Forcino RC, Schubbe D, Barr PJ, O’Brien N, O’Malley AJ, Foster T, Politi MC, Laughlin-Tommaso S, Banks E, Madden T, Anchan RM, Aarts JWM, Velentgas P, Balls-Berry J, Bacon C, Adams-Foster M, Mulligan CC, Venable S, Cochran NE, Elwyn G. Implementation of the uterine fibroids Option Grid patient decision aids across five organizational settings: a randomized stepped-wedge study protocol. Implement Sci 2019; 14:88. [PMID: 31477140 PMCID: PMC6721118 DOI: 10.1186/s13012-019-0933-z] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2019] [Accepted: 08/05/2019] [Indexed: 11/28/2022] Open
Abstract
BACKGROUND Uterine fibroids are non-cancerous overgrowths of the smooth muscle in the uterus. As they grow, some cause problems such as heavy menstrual bleeding, pelvic pain, discomfort during sexual intercourse, and rarely pregnancy complications or difficulty becoming pregnant. Multiple treatment options are available. The lack of comparative evidence demonstrating superiority of any one treatment means that choosing the best option is sensitive to individual preferences. Women with fibroids wish to consider treatment trade-offs. Tools known as patient decision aids (PDAs) are effective in increasing patient engagement in the decision-making process. However, the implementation of PDAs in routine care remains challenging. Our aim is to use a multi-component implementation strategy to implement the uterine fibroids Option Grid™ PDAs at five organizational settings in the USA. METHODS We will conduct a randomized stepped-wedge implementation study where five sites will be randomized to implement the uterine fibroid Option Grid PDA in practice at different time points. Implementation will be guided by the Consolidated Framework for Implementation Research (CFIR) and Normalization Process Theory (NPT). There will be a 6-month pre-implementation phase, a 2-month initiation phase where participating clinicians will receive training and be introduced to the Option Grid PDAs (available in text, picture, or online formats), and a 6-month active implementation phase where clinicians will be expected to use the PDAs with patients who are assigned female sex at birth, are at least 18 years of age, speak fluent English or Spanish, and have new or recurrent symptoms of uterine fibroids. We will exclude postmenopausal patients. Our primary outcome measure is the number of eligible patients who receive the Option Grid PDAs. We will use logistic and linear regression analyses to compare binary and continuous quantitative outcome measures (including survey scores and Option Grid use) between the pre- and active implementation phases while adjusting for patient and clinician characteristics. DISCUSSION This study may help identify the factors that impact the implementation and sustained use of a PDA in clinic workflow from various stakeholder perspectives while helping patients with uterine fibroids make treatment decisions that align with their preferences. TRIAL REGISTRATION Clinicaltrials.gov , NCT03985449. Registered 13 July 2019, https://clinicaltrials.gov/ct2/show/NCT03985449.
Collapse
|
110
|
Donnelly KZ, Elwyn G, Theiler R, Thompson R. Promoting or Undermining Quality Decision Making? A Qualitative Content Analysis of Patient Decision Aids Comparing Surgical and Medication Abortion. Womens Health Issues 2019; 29:414-423. [PMID: 31266679 DOI: 10.1016/j.whi.2019.05.007] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2018] [Revised: 05/09/2019] [Accepted: 05/24/2019] [Indexed: 11/28/2022]
Abstract
OBJECTIVES To understand, describe, and compare the content of patient decision aids on surgical and medication abortion, including 1) attributes used to describe each method, 2) approaches to clarify patients' values, 3) language used to describe each method, and 4) language used to frame women's decision-making role. STUDY DESIGN We analyzed 49 decision aids identified through a previous systematic review and environmental scan. We used summative content analysis for objectives 1 and 2 and directed content analysis for objectives 3 and 4. RESULTS We identified 37 method attributes. Overall, the attributes privileged medical over practical and emotional information. One decision aid included an explicit values clarification approach, and others included implicit approaches, which varied in length, information consistency, and organization. We identified four themes-information consistency, subjective claims, emotive or ambiguous descriptions, and medication abortion as not a real abortion-related to the methods' descriptions. We identified three themes-agency in choice, unclear emphasis on women's preferences, and endorsement of clinic services-related to women's decision-making role. Of the nine tools that listed factors influencing women's decision making, patient preferences was often listed last. CONCLUSIONS Early abortion method decision aids presented a broad range of information and typically framed the method choice as the woman's. However, their emphasis on medical attributes, use of inconsistent information, and, at times, biased presentation of methods may undermine quality decision making. We recommend adapting an existing decision aid or designing a novel tool based on the content and language that women find most acceptable.
Collapse
|
111
|
Vermunt N, Elwyn G, Westert G, Harmsen M, Olde Rikkert M, Meinders M. Goal setting is insufficiently recognised as an essential part of shared decision-making in the complex care of older patients: a framework analysis. BMC FAMILY PRACTICE 2019; 20:76. [PMID: 31170920 PMCID: PMC6555756 DOI: 10.1186/s12875-019-0966-z] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 09/05/2017] [Accepted: 05/17/2019] [Indexed: 02/07/2023]
Abstract
Background Multimorbidity poses a challenge for decision-making processes and requires that more attention is paid to patient goals, preferences and needs; however, goal setting is not yet widely recognised as a core aspect of the shared decision-making (SDM) approach. This study aims to analyse clinician perceptions of the concept of goal setting within the context of SDM with older patients with multimorbidity. Methods Semi-structured interviews with general practitioners (GPs) and clinical geriatricians (CGs) were analysed using a framework analysis. The integrative model of SDM was used to develop a categorisation matrix, including goal setting as an additional component. Results Sixteen of the 33 clinicians mentioned explicit Goal setting as an integrated component of their definition of SDM, which was comparable to the number of clinicians who listed Patient values and preferences (n = 16), Doctor knowledge and recommendations (n = 19) and Make or explicitly defer a decision (n = 19), elements which are commonly considered to be important aspects of SDM. The other 17 clinicians (6 CGs and 11 GPs) did not mention Goal setting as an explicit component of SDM. Our analysis revealed two potential reasons for this observation. Besides the use of other terminology, part of clinicians viewed collaborative goal setting and SDM as separate but related processes. Conclusions Our study on clinician perspectives highlighted goal setting as component of a SDM approach and could therefore be considered supportive of recent theoretical insights that SDM models that lack an explicit goal-setting component appear to be deficient and overlook an important aspect of engaging patients in decision-making, particularly for patients with complex multimorbidities. We therefore call for the further development of a comprehensive SDM approach for older patients with multimorbidity to include explicit and unequivocal goal setting elements to sufficiently meet the expectations and needs of clinicians and their patients. Electronic supplementary material The online version of this article (10.1186/s12875-019-0966-z) contains supplementary material, which is available to authorized users.
Collapse
|
112
|
Scalia P, Durand MA, Faber M, Kremer JA, Song J, Elwyn G. User-testing an interactive option grid decision aid for prostate cancer screening: lessons to improve usability. BMJ Open 2019; 9:e026748. [PMID: 31133587 PMCID: PMC6538002 DOI: 10.1136/bmjopen-2018-026748] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/03/2022] Open
Abstract
OBJECTIVE To user-test a web-based, interactive Option Grid decision aid 'prostate-specific antigen (PSA) test: yes or no?' to determine its usability, acceptability and feasibility with men of high and low health literacy. DESIGN A semi-structured interview study. SETTING Interviews were conducted at a senior centre, academic hospital or college library in New Hampshire and Vermont. PARTICIPANTS Individuals over 45 years of age with no history of prostate cancer who voluntarily contacted study authors after viewing local invitations were eligible for inclusion. Twenty interviews were conducted: 10 participants had not completed a college degree, of which eight had low health literacy, and 10 participants had high health literacy. INTERVENTION An interactive, web-based Option Grid patient decision aid for considering whether or not to have a PSA test. RESULTS Users with lower health literacy levels were able to understand the content in the tool but were not able to navigate the Option Grid independent of assistance. The tool was used independently by men with high health literacy. In terms of acceptability, the flow of questions and answers embedded in the tool did not seem intuitive to some users who preferred seeing more risk information related to age and family history. Users envisioned that the tool could be feasibly implemented in clinical workflows. CONCLUSION Men in our sample with limited health literacy had difficulty navigating the Option Grid, thus suggesting that the tool was not appropriately designed to be usable by all audiences. The information provided in the tool is acceptable, but users preferred to view personalised risk information. Some participants could envision using this tool prior to an encounter in order to facilitate a better dialogue with their clinician. ETHICS APPROVAL The study received ethical approval from the Dartmouth College Committee for the Protection of Human Subjects (STUDY00030116).
Collapse
|
113
|
Spronk I, Meijers MC, Heins MJ, Francke AL, Elwyn G, van Lindert A, van Dulmen S, van Vliet LM. Availability and effectiveness of decision aids for supporting shared decision making in patients with advanced colorectal and lung cancer: Results from a systematic review. Eur J Cancer Care (Engl) 2019; 28:e13079. [PMID: 31066142 PMCID: PMC9286651 DOI: 10.1111/ecc.13079] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2018] [Revised: 03/22/2019] [Accepted: 04/08/2019] [Indexed: 01/05/2023]
Abstract
Introduction Shared decision making is not always commonplace in advanced colorectal or lung cancer care. Decision aids (DAs) might be helpful. This review aimed (a) to provide an overview of DAs for patients with advanced colorectal or lung cancer and assess their availability; and (b) to assess their effectiveness if possible. Methods A systematic literature search (PubMed/EMBASE/PsycINFO/CINAHL) and Internet and expert searches were carried out to identify relevant DAs. Data from the DAs included were extracted and the quality of studies, evidence (Grading of Recommendations Assessment, Development and Evaluation) and effectiveness (International Patient Decision Aid Standards) of DAs were determined. Results Ten of the 12 DAs included (four colorectal cancer, four lung cancer and four generic) are still available. Most (9/12) were applicable throughout the disease pathway and usable for all decisions, or to the decision for supportive care with/without anti‐cancer therapy. Seven studies tested effectiveness. Effects on patient outcomes varied, but were generally weakly positive (e.g., DAs improved patient satisfaction) with low evidence. Study quality was fair to good. Conclusion There is a lack of readily available DAs that have been demonstrated to be effective in advanced colorectal or lung cancer. Rigorous testing of the effects of currently available and future DAs, to improve patient outcomes, is urgently needed.
Collapse
|
114
|
Saunders CH, Patel K, Kang H, Elwyn G, Kirkland K, Durand MA. Serious Choices: A Systematic Environmental Scan of Decision Aids and Their Use for Seriously Ill People Near Death. J Hosp Med 2019; 14:294-302. [PMID: 30794146 DOI: 10.12788/jhm.3110] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/05/2018] [Accepted: 10/12/2018] [Indexed: 11/20/2022]
Abstract
Seriously ill people near death face difficult decisions about life-sustaining treatments such as cardiopulmonary resuscitation and mechanical ventilation. Patient decision aids may improve alignment between patients' preferences and the care they receive, but the quantity, quality, and routine use of these tools are unknown. We conducted a systematic environmental scan to identify all decision aids for seriously ill people at high risk of death facing choices about life-sustaining treatments, assess their quality, and explore their use in clinical settings. We searched MEDLINE, Google, and mobile application stores and surveyed experts. We included 27 decision aids in our scan. Concerning content, 14 of 27 decision aids for seriously ill people near death were for people with specific diseases and conditions (ie, advanced cancer or kidney disease); 11 concerned individual life-sustaining treatment decisions (ie, cardiopulmonary resuscitation or mechanical ventilation). Only two focused on more general care pathways (ie, life-sustaining intervention, palliative care, and hospice). Twenty-four of 27 decision aids presented options in a balanced way; 23 identified funding sources, and 19 of 27 reported their publication date. Just 11 used plain language. A minority, 11 of 27, listed evidence sources, five documented rigorous evidence-synthesis methods, six disclosed competing interests, and three offered update policies. Preliminary results suggest that few health systems use decision aids in routine patient care. Although many decision aids exist for life-sustaining treatment decisions during serious illness, the tools are deficient in some key quality areas.
Collapse
|
115
|
Zisman-Ilani Y, Roe D, Elwyn G, Kupermintz H, Patya N, Peleg I, Karnieli-Miller O. Shared Decision Making for Psychiatric Rehabilitation Services Before Discharge from Psychiatric Hospitals. HEALTH COMMUNICATION 2019; 34:631-637. [PMID: 29393685 DOI: 10.1080/10410236.2018.1431018] [Citation(s) in RCA: 22] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
Shared decision making (SDM) is an effective health communication model designed to facilitate patient engagement in treatment decision making. In mental health, SDM has been applied and evaluated for medications decision making but less for its contribution to personal recovery and rehabilitation in psychiatric settings. The purpose of this pilot study was to assess the effect of SDM in choosing community psychiatric rehabilitation services before discharge from psychiatric hospitalization. A pre-post non-randomized design with two consecutive inpatient cohorts, SDM intervention (N = 51) and standard care (N = 50), was applied in two psychiatric hospitals in Israel. Participants in the intervention cohort reported greater engagement and knowledge after choosing rehabilitation services and greater services use at 6-to-12-month follow-up than those receiving standard care. No difference was found for rehospitalization rate. Two significant interaction effects indicated greater improvement in personal recovery over time for the SDM cohort. SDM can be applied to psychiatric rehabilitation decision making and can help promote personal recovery as part of the discharge process.
Collapse
|
116
|
Scalia P, Durand MA, Berkowitz JL, Ramesh NP, Faber MJ, Kremer JAM, Elwyn G. The impact and utility of encounter patient decision aids: Systematic review, meta-analysis and narrative synthesis. PATIENT EDUCATION AND COUNSELING 2019; 102:817-841. [PMID: 30612829 DOI: 10.1016/j.pec.2018.12.020] [Citation(s) in RCA: 77] [Impact Index Per Article: 15.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/30/2018] [Revised: 11/23/2018] [Accepted: 12/18/2018] [Indexed: 06/09/2023]
Abstract
OBJECTIVE To determine the effect of encounter patient decision aids (PDAs) as evaluated in randomized controlled trials (RCTs) and conduct a narrative synthesis of non-randomized studies assessing feasibility, utility and their integration into clinical workflows. METHODS Databases were systematically searched for RCTs of encounter PDAs to enable the conduct of a meta-analysis. We used a framework analysis approach to conduct a narrative synthesis of non-randomized studies. RESULTS We included 23 RCTs and 30 non-randomized studies. Encounter PDAs significantly increased knowledge (SMD = 0.42; 95% CI 0.30, 0.55), lowered decisional conflict (SMD= -0.33; 95% CI -0.56, -0.09), increased observational-based assessment of shared decision making (SMD = 0.94; 95% CI 0.40, 1.48) and satisfaction with the decision-making process (OR = 1.78; 95% CI 1.19, 2.66) without increasing visit durations (SMD= -0.06; 95% CI -0.29, 0.16). The narrative synthesis showed that encounter tools have high utility for patients and clinicians, yet important barriers to implementation exist (i.e. time constraints) at the clinical and organizational level. CONCLUSION Encounter PDAs have a positive impact on patient-clinician collaboration, despite facing implementation barriers. PRACTICAL IMPLICATIONS The potential utility of encounter PDAs requires addressing the systemic and structural barriers that prevent adoption in clinical practice.
Collapse
|
117
|
Leppin AL, Boehmer KR, Branda ME, Shah ND, Hargraves I, Dick S, Elwyn G, Ting HH, Ye S, Gilles R, Abbas M, Alexander A, Montori VM. Developing a toolkit to implement the Statin Choice Conversation Aid at scale: application of a work reduction model. BMC Health Serv Res 2019; 19:249. [PMID: 31018840 PMCID: PMC6480421 DOI: 10.1186/s12913-019-4055-8] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2018] [Accepted: 03/31/2019] [Indexed: 11/26/2022] Open
Abstract
Background Guidelines recommend shared decision making (SDM) for determining whether to use statins to prevent cardiovascular events in at-risk patients. We sought to develop a toolkit to facilitate the cross-organizational spread and scale of a SDM intervention called the Statin Choice Conversation Aid (SCCA) by (i) assessing the work stakeholders must do to implement the tool; and (ii) orienting the resulting toolkit’s components to communicate and mitigate this work. Methods We conducted multi-level and mixed methods (survey, interview, observation, focus group) characterizations of the contexts of 3 health systems (n = 86, 84, and 26 primary care clinicians) as they pertained to the impending implementation of the SCCA. We merged the data within implementation outcome domains of feasibility, appropriateness, and acceptability. Using Normalization Process Theory, we then characterized and categorized the work stakeholders did to implement the tool. We used clinician surveys and IP address-based tracking to calculate SCCA usage over time and judged how stakeholder effort was allocated to influence outcomes at 6 and 18 months. After assessing the types and impact of the work, we developed a multi-component toolkit. Results At baseline, the three contexts differed regarding feasibility, acceptability, and appropriateness of implementation. The work of adopting the tool was allocated across many strategies in complex and interdependent ways to optimize these domains. The two systems that allocated the work strategically had higher uptake (5.2 and 2.9 vs. 1.1 uses per clinician per month at 6 months; 3.8 and 2.1 vs. 0.4 at 18 months, respectively) than the system that did not. The resulting toolkit included context self-assessments intended to guide stakeholders in considering the early work of SCCA implementation; and webinars, EMR integration guides, video demonstrations, and an implementation team manual aimed at supporting this work. Conclusions We developed a multi-component toolkit for facilitating the scale-up and spread of a tool to promote SDM across clinical settings. The theory-based approach we employed aimed to distinguish systems primed for adoption and support the work they must do to achieve implementation. Our approach may have value in orienting the development of multi-component toolkits and other strategies aimed at facilitating the efficient scale up of interventions. Trial registration ClinicalTrials.govNCT02375815. Electronic supplementary material The online version of this article (10.1186/s12913-019-4055-8) contains supplementary material, which is available to authorized users.
Collapse
|
118
|
Barr PJ, Forcino RC, Dannenberg MD, Mishra M, Turner E, Zisman-Ilani Y, Matthews J, Hinn M, Bruce M, Elwyn G. Healthcare Options for People Experiencing Depression (HOPE*D): the development and pilot testing of an encounter-based decision aid for use in primary care. BMJ Open 2019; 9:e025375. [PMID: 30962232 PMCID: PMC6500310 DOI: 10.1136/bmjopen-2018-025375] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/17/2022] Open
Abstract
OBJECTIVE To develop and pilot an encounter-based decision aid (eDA) for people with depression for use in primary care. DESIGN We developed an eDA for depression through cognitive interviews and pilot tested it using a one-group pretest, post-test design in primary care. Feasibility, fidelity of eDA use and acceptability were assessed using recruitment rates and semistructured interviews with patients, medical assistants and clinicians. Treatment choice and shared decision-making (SDM) were also assessed. SETTING Interviews with adult patients and the public were conducted in a mall and library in Grafton County, New Hampshire, while clinician interviews took place by phone or at the clinician's office. Pilot testing occurred in a New Hampshire primary care practice. PARTICIPANTS Cognitive interviews were conducted with adults, ≥18 years, who could read English from the following stakeholder groups: history of depression, the public and clinicians. Patients with a Patient Health Questionnaire-9 score of ≥5 were recruited for piloting. RESULTS Three stages of cognitive interviews were conducted (n=28). Changes to eDA included moving the combination therapy information and access to treatment information, adding colour, modifying pictograms and editing the talk-therapy description. Clinician concerns about patient health literacy were not reflected in patient interviews. Of 59 patients who reviewed study information, 56 were eligible and agreed to participate in pilot testing; however, only 29 could be reached for follow-up. The eDA was widely accepted, though clinicians did not always use it as intended. We found no impact of eDA use on SDM, though patients chose a wider range of treatment options. CONCLUSIONS We demonstrated the feasibility of the use of an eDA for depression in primary care that was widely accepted. Further research is needed to improve the fidelity with which the eDA is used and to assess its impact on SDM and related health outcomes.
Collapse
|
119
|
Durand MA, Dannenberg MD, Saunders CH, Giguere AMC, Alper BS, Hoffmann T, Perestelo-Pérez L, Campbell ST, Elwyn G. Modified Delphi survey for the evidence summarisation of patient decision aids: Study protocol. BMJ Open 2019; 9:e026701. [PMID: 30904876 PMCID: PMC6475258 DOI: 10.1136/bmjopen-2018-026701] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/04/2022] Open
Abstract
INTRODUCTION Information included in a patient decision aid (PDA) can significantly influence patients' decisions and is, therefore, expected to be evidence-based and rigorously selected and summarised. PDA developers have not yet agreed on a standardised process for the selection and summarisation of the supporting evidence. We intend to generate consensus on a process (and related steps and criteria) for selecting and summarising evidence for PDAs using a modified Delphi survey. METHODS AND ANALYSIS We will develop an evidence summarisation process specific to PDA development by using a consensus-based Delphi approach, surveying international experts and stakeholders with two to three rounds. To increase generalisability and acceptability, we will distribute the survey to the following stakeholder groups: PDA developers, researchers with expertise in shared decision making, PDA development and evidence summarisation, members of the International Patient Decision Aids Standards (IPDAS) collaboration, policy makers with expertise in PDA certification and patient stakeholder groups. For each criterion, if at least 80% of survey participants rank the criterion as most important/least important, we will consider that consensus has been achieved. ETHICS AND DISSEMINATION It is critical for PDAs to have accurate and trustworthy evidence-based information about the risks and benefits of health treatments and tests, as these decision aids help patients make important choices. We want to generate consensus on an approach for selecting and summarising the evidence included in PDAs, which can be widely implemented by PDA developers. Dartmouth College's Committee for the Protection of Human Subjects approved this protocol. We will publish our results in a peer reviewed journal.
Collapse
|
120
|
Weeks WB, Mishra MK, Curto D, Petersen CL, Cano P, Hswen Y, Serra SV, Elwyn G, Godfrey MM, Soro PS, Tomás JF. Comparing Three Methods for Reducing Psychotropic Use in Older Demented Spanish Care Home Residents. J Am Geriatr Soc 2019; 67:1444-1453. [PMID: 30848834 DOI: 10.1111/jgs.15855] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2018] [Revised: 02/02/2019] [Accepted: 02/07/2019] [Indexed: 12/19/2022]
Abstract
BACKGROUND/OBJECTIVE In nursing homes across the world, and particularly in Spain, there are concerns that psychotropic medications are being overused. For older Spanish nursing home residents who had dementia, we sought to evaluate the association between applying interventions designed to reduce inappropriate psychotropic medication use and subsequent psychotropic use. DESIGN Retrospective, propensity score-matched, controlled, patient-level observational analysis. SETTING A total of 45 nursing homes in Spain. PARTICIPANTS A total of 1653 nursing home residents, aged 70 to 99 years, who had dementia and were prescribed an antipsychotic, anxiolytic, or antidepressant medication, 606 of whom received an intervention; the remainder served as propensity score-matched controls. INTERVENTION Team Rounds, Screening Tool of Older Persons' Prescriptions (STOPP)/Screening Tool to Alert Doctors to Right Treatment (START) criteria, or a Patient Decision Aid. MEASUREMENTS At 2 and 4 weeks following intervention: change from baseline drug class-specific milligram-equivalent daily dose (MEDD); at 2 weeks: patient falls and restraint use. RESULTS Within each intervention/drug-class cohort, intervention patients and matched controls had similar baseline demographic characteristics, Charlson scores, lengths of admission, and drug class-specific MEDDs. Compared to controls, patients exposed to Team Rounds experienced a 23.3% (95% confidence interval [CI] = 13.9%-32.8%) reduction in antipsychotic and a 23.1% (95% CI = 18.3%-28.0%) reduction in anxiolytic MEDDs; those exposed to Patient Decision Aids had a 24.8% (95% CI = 15.6%-33.9%) reduction in antipsychotic and a 31.8% (95% CI = 25.5%-38.2%) reduction in anxiolytic MEDDs; and those exposed to STOPP/START application had a 27.7% (95% CI = 22.4%-33.0%) reduction in antipsychotic and a 39.5% (95% CI = 35.5%-43.5%) reduction in anxiolytic MEDDs. Intervention-associated antidepressant MEDD reductions were statistically significant but less dramatic. Interventions were associated with higher rates of medication discontinuation, but not higher rates of deaths, patient falls, or physical restraints. CONCLUSION We found strong evidence that the interventions we studied were associated with reduced psychotropic use without commensurate harms, suggesting that such interventions should be incorporated into Spanish nursing home care models. Public reporting of psychotropic medication use in Spanish care homes may encourage care homes to regularly monitor psychotropic medication use and implement such instruments. J Am Geriatr Soc, 2019.
Collapse
|
121
|
Dannenberg MD, Bienvenida JCM, Bruce ML, Nguyen T, Hinn M, Matthews J, Bartels SJ, Elwyn G, Barr PJ. End-user views of an electronic encounter decision aid linked to routine depression screening. PATIENT EDUCATION AND COUNSELING 2019; 102:555-563. [PMID: 30497800 DOI: 10.1016/j.pec.2018.10.002] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/30/2018] [Revised: 09/10/2018] [Accepted: 10/01/2018] [Indexed: 06/09/2023]
Abstract
OBJECTIVE Our aim was to gather community stakeholder input to inform the development of a digital system linking depression screening to decision support. METHODS Views and feature requirements were identified through (1) focus groups with patients and consumers with depression, and interviews with primary care clinicians and (2) usability sessions where patients and consumers used the current version of encounter decision aid (eDA) in a primary care waiting room. Qualitative data were analyzed using the framework method. RESULTS We conducted six focus groups with 15 participants, seven clinician interviews and 10 usability sessions. Patients were comfortable completing the Patient Health Questionnaire (PHQ-9) and receiving the electronic eDA in clinic. They felt this would allow patients to prepare for their visit and instill a sense of agency. Participants were comfortable receiving the PHQ-9 results and a subsequent eDA on a tablet in the waiting room. CONCLUSION Patients with and without depression, as well as clinicians, viewed linking the PHQ-9, results, and eDA positively. Patients were comfortable doing this in the clinic waiting room. PRACTICE IMPLICATIONS Linking depression decision support to screening was viewed positively by patients and clinicians, and could help overcome barriers to shared decision-making implementation in this population.
Collapse
|
122
|
Luig T, Elwyn G, Anderson R, Campbell-Scherer DL. Facing obesity: Adapting the collaborative deliberation model to deal with a complex long-term problem. PATIENT EDUCATION AND COUNSELING 2019; 102:291-300. [PMID: 30292424 DOI: 10.1016/j.pec.2018.09.021] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/23/2018] [Revised: 08/15/2018] [Accepted: 09/21/2018] [Indexed: 06/08/2023]
Abstract
OBJECTIVE Care communication about obesity needs to respond to the complex biopsychosocial processes that affect weight and health. The collaborative deliberation model conceptualizes interpersonal work that underpins empathic communication and shared decision-making. The goal of this study was to elucidate how primary care practitioners can use the model to achieve shared obesity assessment and care planning. METHODS This qualitative study used direct observation of clinical encounters with twenty patients with obesity sampled for maximum variation in context, semi-structured patient and provider interviews, patient journals and two follow-up interviews over eight weeks. Themes were compared to the original model. RESULTS We identified five processes that may be relevant for collaborative deliberation about obesity in addition to the original model: (1) Exploring the story, (2) Reframing the story, (3) Co-constructing a new story, (4) Choosing a priority, and (5) Experimenting with alternatives. CONCLUSIONS We propose an enhanced collaborative deliberation model for obesity that describes the interpersonal work needed before and after deliberation about preferences and courses of action. PRACTICE IMPLICATIONS The enhanced model can support clinicians in achieving meaningful conversations about obesity and complex chronic disease resulting in care plans that are responsive to and achievable in the patient's lifeworld.
Collapse
|
123
|
Ryan P, Luz S, Albert P, Vogel C, Normand C, Elwyn G. Using artificial intelligence to assess clinicians' communication skills. BMJ 2019; 364:l161. [PMID: 30659013 DOI: 10.1136/bmj.l161] [Citation(s) in RCA: 26] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/08/2023]
|
124
|
Hahlweg P, Witzel I, Müller V, Elwyn G, Durand MA, Scholl I. Adaptation and qualitative evaluation of encounter decision aids in breast cancer care. Arch Gynecol Obstet 2019; 299:1141-1149. [PMID: 30649604 PMCID: PMC6435605 DOI: 10.1007/s00404-018-5035-7] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2018] [Accepted: 12/18/2018] [Indexed: 11/27/2022]
Abstract
Purpose Shared decision-making is currently not widely implemented in breast cancer care. Encounter decision aids support shared decision-making by helping patients and physicians compare treatment options. So far, little was known about adaptation needs for translated encounter decision aids, and encounter decision aids for breast cancer treatments were not available in Germany. This study aimed to adapt and evaluate the implementation of two encounter decision aids on breast cancer treatments in routine care. Methods We conducted a multi-phase qualitative study: (1) translation of two breast cancer Option Grid™ decision aids; comparison to national clinical standards; cognitive interviews to test patients’ understanding; (2) focus groups to assess acceptability; (3) testing in routine care using participant observation. Data were analysed using qualitative content analysis. Results Physicians and patients reacted positively to the idea of encounter decision aids, and reported being interested in using them; patients were most receptive. Several adaptation cycles were necessary. Uncertainty about feasibility of using encounter decision aids in clinical settings was the main physician-reported barrier. During real-world testing (N = 77 encounters), physicians used encounter decision aids in one-third of potentially relevant encounters. However, they did not use the encounter decision aids to stimulate dialogue, which is contrary to their original scope and purpose. Conclusions The idea of using encounter decision aids was welcomed, but more by patients than by physicians. Adaptation was a complex process and required resources. Clinicians did not follow suggested strategies for using encounter decision aids. Our study indicates that production of encounter decision aids alone will not lead to successful implementation, and has to be accompanied by training of health care providers. Electronic supplementary material The online version of this article (10.1007/s00404-018-5035-7) contains supplementary material, which is available to authorized users.
Collapse
|
125
|
Saunders CH, Petersen CL, Durand MA, Bagley PJ, Elwyn G. Bring on the Machines: Could Machine Learning Improve the Quality of Patient Education Materials? A Systematic Search and Rapid Review. JCO Clin Cancer Inform 2018; 2:1-16. [PMID: 30652611 PMCID: PMC6874040 DOI: 10.1200/cci.18.00010] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022] Open
Abstract
PURPOSE Clear and trustworthy information is essential for people who are ill. People with cancer, in particular, are targeted with vast quantities of patient education material, but of variable quality. Machine learning technologies are popular across industries for automated tasks, like analyzing language and spotting readability issues. With the experience of patients with cancer in mind, we reviewed whether anyone has proposed, modeled, or applied machine learning technologies for the assessment of patient education materials and explored the utility of this application. METHODS We systematically searched the literature to identify English-language articles published in peer-reviewed journals or as conference abstracts that proposed, used, or modeled the use of machine learning technology to assess patient education materials. Specifically, we searched MEDLINE, Web of Science, CINAHL, and Compendex. Two reviewers assessed study eligibility and performed study screening. RESULTS We identified 1,570 publications in our search after duplicate removal. After screening, we included five projects (detailed in nine articles) that proposed, modeled, or used machine learning technology to assess the quality of patient education materials. We evaluated the utility of each application across four domains: multidimensionality (2 of 5 applications), patient centeredness (1 of 5 applications), customizability (0 of 5 applications), and development stage (theoretical, 1 of 5 applications; in development, 3 of 5 applications; complete and available, 1 of 5 applications). Combining points across each domain, the mean utlity score across included projects was 1.8 of 5 possible points. CONCLUSION Given its potential, machine learning has not yet been leveraged substantially in the assessment of patient education materials. We propose machine learning systems that can dynamically identify problematic language and content by assessing the quality of patient education materials across a range of flexible, customizable criteria. Assessment may help patients and families decide which materials to use and encourage developers to improve materials overall.
Collapse
|