1
|
Hung YC, Chaker SC, Sigel M, Saad M, Yu-Hsuan Chang M, Slater ED. Addressing Current Deficits in Patient Education Materials Through Crowdsourcing. Ann Plast Surg 2024; 92:148-155. [PMID: 38198625 DOI: 10.1097/sap.0000000000003777] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/12/2024]
Abstract
BACKGROUND Patient education materials are commonly reported to be difficult to understand. OBJECTIVES We aimed to use crowdsourcing to improve patient education materials at our institution. METHODS This was a department-wide quality improvement project to increase organizational health literacy. There are 6 phases of this pilot study: (1) evaluating preexisting patient education materials, (2) evaluating online patient education materials at the society (the American Society of Plastic Surgeon) and government level (Medline Plus), (3) redesigning our patient education material and reevaluating the education material, (4) crowdsourcing to evaluate understandability of the new patient education material, (5) data analysis, and (6) incorporating crowdsourcing suggestions to the patient education material. RESULTS Breast-related patient education materials are not easy to read at the institution level, the society level, and the government level. Our new implant-based breast reconstruction patient education material is easy to read as demonstrated by the crowdsourcing evaluation. More than 90% of the participants reported our material is "very easy to understand" or "easy to understand." The crowdsourcing process took 1.5 days, with 700 workers responding to the survey. The total cost was $9. After incorporating participants' feedback into the finalized material, the readability of the material is at the recommended reading level. The material also had the recommended length (between 400 and 800 words). DISCUSSION Our study demonstrated a pathway for clinicians to efficiently obtain a large amount of feedback to improve patient education materials. Crowdsourcing is an effective tool to improve organizational health literacy.
Collapse
Affiliation(s)
- Ya-Ching Hung
- From the Department of General Surgery, Sinai Hospital of Baltimore, Baltimore, MD
| | - Sara C Chaker
- Department of Plastic Surgery, Vanderbilt University Medical Center
| | | | - Mariam Saad
- From the Department of General Surgery, Sinai Hospital of Baltimore, Baltimore, MD
| | | | - Elizabeth D Slater
- From the Department of General Surgery, Sinai Hospital of Baltimore, Baltimore, MD
| |
Collapse
|
2
|
Hung YC, Chaker SC, Sigel M, Saad M, Slater ED. Comparison of Patient Education Materials Generated by Chat Generative Pre-Trained Transformer Versus Experts: An Innovative Way to Increase Readability of Patient Education Materials. Ann Plast Surg 2023; 91:409-412. [PMID: 37713147 DOI: 10.1097/sap.0000000000003634] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/16/2023]
Abstract
INTRODUCTION Improving patient education materials may improve patient outcomes. This study aims to explore the possibility of generating patient education materials with the assistance of a large language model, Chat Generative Pre-Trained Transformer (ChatGPT). In addition, we compare the accuracy and readability of ChatGPT-generated materials versus expert-generated materials. METHODS Patient education materials in implant-based breast reconstruction were generated by experts and ChatGPT independently. Readability and accuracy of the materials are the main outcomes. Readability of the materials was compared using Flesch-Kincaid score. Accuracy of the materials generated by ChatGPT was evaluated by 2 independent reviewers. Content errors are categorized into information errors, statistical errors, and multiple errors (errors more than 2 types). RESULTS The content generated by experts had higher readability. The Flesch-Kincaid score is at the 7.5 grade for expert-generated materials, whereas the content generated by ChatGPT is at the 10.5 grade (despite ChatGPT being asked to generate content at the seventh grade level). The accuracy of ChatGPT-generated content is 50%, with most errors being information errors. ChatGPT often provides information about breast reduction or breast augmentation, despite being asked specifically about breast reconstruction. Despite its limitation, ChatGPT significantly reduced the time required to generate patient education materials. Although it takes experts 1 month to generate patient education materials, ChatGPT generates materials within 30 minutes. CONCLUSIONS ChatGPT can be a powerful starting tool to generate patient education materials. However, its readability and accuracy still require improvements.
Collapse
Affiliation(s)
| | - Sara C Chaker
- From the Department of Plastic Surgery, Vanderbilt University Medical Center, Nashville, TN
| | | | - Mariam Saad
- From the Department of Plastic Surgery, Vanderbilt University Medical Center, Nashville, TN
| | - Elizabeth D Slater
- From the Department of Plastic Surgery, Vanderbilt University Medical Center, Nashville, TN
| |
Collapse
|
3
|
Yilma M, Cogan R, Shui AM, Neuhaus JM, Light C, Braun H, Mehta N, Hirose R. Community-level social vulnerability and individual socioeconomic status on liver transplant referral outcome. Hepatol Commun 2023; 7:e00196. [PMID: 37378636 DOI: 10.1097/hc9.0000000000000196] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/13/2022] [Accepted: 05/06/2023] [Indexed: 06/29/2023] Open
Abstract
BACKGROUND Recent endeavors emphasize the importance of understanding early barriers to liver transplantation (LT) by consistently collecting data on patient demographics, socioeconomic factors, and geographic social deprivation indices. METHODS In this retrospective single-center cohort study of 1657 adults referred for LT evaluation, we assessed the association between community-level vulnerability and individual socioeconomic status measures on the rate of waitlisting and transplantation. Patients' addresses were linked to Social Vulnerability Index (SVI) at the census tract-level to characterize community-level vulnerability. Descriptive statistics were used to describe patient characteristics. Multivariable cause-specific HRs were used to assess the association between community-level vulnerability, individual measures of the socioeconomic status, and LT evaluation outcomes (waitlist and transplantation). RESULTS Among the 1657 patients referred for LT during the study period, 54% were waitlisted and 26% underwent LT. A 0.1 increase in overall SVI correlated with an 8% lower rate of waitlisting (HR 0.92, 95% CI 0.87-0.96, p < 0.001), with socioeconomic status, household characteristics, housing type and transportation, and racial and ethnic minority status domains contributing significantly to this association. Patients residing in more vulnerable communities experienced a 6% lower rate of transplantation (HR 0.94, 95% CI 0.91- 0.98, p = 0.007), with socioeconomic status and household characteristic domain of SVI significantly contributing to this association. At the individual level, both government insurance and employment status were associated with lower rates of waitlisting and transplantation. There was no association with mortality prior to waitlisting or mortality while on the waitlist. CONCLUSION Our findings indicate that both individual and community measures of the socioeconomic status (overall SVI) are associated with LT evaluation outcomes. Furthermore, we identified individual measures of neighborhood deprivation associated with both waitlisting and transplantation.
Collapse
Affiliation(s)
- Mignote Yilma
- General Surgery, University of California, San Francisco, California, USA
- National Clinician Scholars Program at the University of California, San Francisco, California, USA
| | - Raymond Cogan
- University of California, San Francisco Transplant Program, California, USA
| | - Amy M Shui
- Department of Epidemiology and Biostatistics, University of California, San Francisco, California, USA
| | - John M Neuhaus
- Department of Epidemiology and Biostatistics, University of California, San Francisco, California, USA
| | - Carolyn Light
- University of California, San Francisco Transplant Program, California, USA
| | - Hillary Braun
- General Surgery, University of California, San Francisco, California, USA
| | - Neil Mehta
- Division of Gastroenterology, University of California, San Francisco, California, USA
| | - Ryutaro Hirose
- Division of Transplant Surgery, University of California, San Francisco, California, USA
| |
Collapse
|
4
|
Hamid M, Rogers E, Chawla G, Gill J, Macanovic S, Mucsi I. Pretransplant Patient Education in Solid-organ Transplant: A Narrative Review. Transplantation 2022; 106:722-733. [PMID: 34260472 DOI: 10.1097/tp.0000000000003893] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/10/2023]
Abstract
Education for pretransplant, solid-organ recipient candidates aims to improve knowledge and understanding about the transplant process, outcomes, and potential complications to support informed, shared decision-making to reduce fears and anxieties about transplant, inform expectations, and facilitate adjustment to posttransplant life. In this review, we summarize novel pretransplant initiatives and approaches to educate solid-organ transplant recipient candidates. First, we review approaches that may be common to all solid-organ transplants, then we summarize interventions specific to kidney, liver, lung, and heart transplant. We describe evidence that emphasizes the need for multidisciplinary approaches to transplant education. We also summarize initiatives that consider online (eHealth) and mobile (mHealth) solutions. Finally, we highlight education initiatives that support racialized or otherwise marginalized communities to improve equitable access to solid-organ transplant. A considerable amount of work has been done in solid-organ transplant since the early 2000s with promising results. However, many studies on education for pretransplant recipient candidates involve relatively small samples and nonrandomized designs and focus on short-term surrogate outcomes. Overall, many of these studies have a high risk of bias. Frequently, interventions assessed are not well characterized or they are combined with administrative and data-driven initiatives into multifaceted interventions, which makes it difficult to assess the impact of the education component on outcomes. In the future, well-designed studies rigorously assessing well-defined surrogate and clinical outcomes will be needed to evaluate the impact of many promising initiatives.
Collapse
Affiliation(s)
- Marzan Hamid
- Multi-Organ Transplant Program and Division of Nephrology, University Health Network, University of Toronto, Toronto, ON, Canada
| | | | | | | | | | | |
Collapse
|
5
|
Jacobson CE, Heximer A, Olmeda-Barrientos R, Anderson MS, Waits SA, Englesbe MJ, Valbuena VSM. Language Accessibility of Liver Transplantation Center Websites. Liver Transpl 2022; 28:722-724. [PMID: 34704660 DOI: 10.1002/lt.26343] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/29/2021] [Revised: 10/15/2021] [Accepted: 10/18/2021] [Indexed: 01/06/2023]
Affiliation(s)
| | | | | | - Maia S Anderson
- Department of Surgery, University of Michigan, Ann Arbor, MI.,Center for Healthcare Outcomes and Policy, University of Michigan, Ann Arbor, MI
| | - Seth A Waits
- Department of Surgery, University of Michigan, Ann Arbor, MI
| | | | - Valeria S M Valbuena
- Department of Surgery, University of Michigan, Ann Arbor, MI.,Center for Healthcare Outcomes and Policy, University of Michigan, Ann Arbor, MI.,National Clinician Scholars Program, University of Michigan, Ann Arbor, MI
| |
Collapse
|
6
|
A scoping review of inequities in access to organ transplant in the United States. Int J Equity Health 2022; 21:22. [PMID: 35151327 PMCID: PMC8841123 DOI: 10.1186/s12939-021-01616-x] [Citation(s) in RCA: 64] [Impact Index Per Article: 32.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2021] [Accepted: 12/24/2021] [Indexed: 02/06/2023] Open
Abstract
Background Organ transplant is the preferred treatment for end-stage organ disease, yet the majority of patients with end-stage organ disease are never placed on the transplant waiting list. Limited access to the transplant waiting list combined with the scarcity of the organ pool result in over 100,000 deaths annually in the United States. Patients face unique barriers to referral and acceptance for organ transplant based on social determinants of health, and patients from disenfranchised groups suffer from disproportionately lower rates of transplantation. Our objective was to review the literature describing disparities in access to organ transplantation based on social determinants of health to integrate the existing knowledge and guide future research. Methods We conducted a scoping review of the literature reporting disparities in access to heart, lung, liver, pancreas and kidney transplantation based on social determinants of health (race, income, education, geography, insurance status, health literacy and engagement). Included studies were categorized based on steps along the transplant care continuum: referral for transplant, transplant evaluation and selection, living donor identification/evaluation, and waitlist outcomes. Results Our search generated 16,643 studies, of which 227 were included in our final review. Of these, 34 focused on disparities in referral for transplantation among patients with chronic organ disease, 82 on transplant selection processes, 50 on living donors, and 61 on waitlist management. In total, 15 studies involved the thoracic organs (heart, lung), 209 involved the abdominal organs (kidney, liver, pancreas), and three involved multiple organs. Racial and ethnic minorities, women, and patients in lower socioeconomic status groups were less likely to be referred, evaluated, and added to the waiting list for organ transplant. The quality of the data describing these disparities across the transplant literature was variable and overwhelmingly focused on kidney transplant. Conclusions This review contextualizes the quality of the data, identifies seminal work by organ, and reports gaps in the literature where future research on disparities in organ transplantation should focus. Future work should investigate the association of social determinants of health with access to the organ transplant waiting list, with a focus on prospective analyses that assess interventions to improve health equity. Supplementary Information The online version contains supplementary material available at 10.1186/s12939-021-01616-x.
Collapse
|
7
|
Wahlin S, Andersson J. Liver health literacy and social stigma of liver disease: A general population e-survey. Clin Res Hepatol Gastroenterol 2021; 45:101750. [PMID: 34175458 DOI: 10.1016/j.clinre.2021.101750] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/30/2021] [Revised: 05/31/2021] [Accepted: 06/02/2021] [Indexed: 02/04/2023]
Abstract
BACKGROUND Health literacy is increasingly recognized as an essential determinant for the health of the population. Liver patients report perceived stigma to be a considerable problem. Little is however known about liver health literacy in the general population and to what extent liver disease is considered stigmatizing in comparison with other chronic diseases. We aimed to explore these knowledge gaps. METHODS We performed an exploratory e-survey in a statistically representative sample of 500 Swedes from the general population. A questionnaire developed for this purpose investigated awareness, attention, knowledge and attitudes towards liver health and compared some aspects with other common health problems. FINDINGS Few worry (23%), think (28%), discuss with their doctor (31%) or hear about liver health in the news (19%). Few (18%) had a liver test in the last year and knew (23%) what is considered a normal liver test. More knew what is considered normal blood pressure (89%), blood sugar (74%) and BMI (73%). Few (22%) talk about liver health, mainly (50%) because abuse is presumed. Many (36%) believe that cirrhosis is only caused by alcohol, 31% that the liver produces urine and 21% that you can survive without a liver. Only mental illness (78%) and obesity (74%) were considered more stigmatizing than liver cirrhosis (61%). INTERPRETATION The study confirms often held views that liver health receives less attention than many other health areas. Knowledge about liver health is generally poor, and liver cirrhosis carries significant social stigma. Improving public awareness and knowledge about liver health, and thereby ameliorating stigma, should be essential parts of policy objectives and action plans to improve liver health in Europe. FUNDING This research was supported by a general grant from the Bengt Ihre Foundation.
Collapse
Affiliation(s)
- Staffan Wahlin
- Hepatology Division, Department of Upper GI Diseases, Karolinska University Hospital, Karolinska Institutet, Stockholm, Sweden.
| | - Johanna Andersson
- Department of Medicine, Karolinska University Hospital, Stockholm, Sweden
| |
Collapse
|
8
|
Pimienta M, Dodge J, Terrault NA. The Internet as a Tool for Liver Transplant Programs to Combat Stigma Related to Alcohol Use Disorder. Hepatol Commun 2021; 5:155-157. [PMID: 33553965 PMCID: PMC7850306 DOI: 10.1002/hep4.1649] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/22/2020] [Revised: 11/04/2020] [Accepted: 11/10/2020] [Indexed: 02/04/2023] Open
Affiliation(s)
- Michael Pimienta
- Keck Medicine of University of Southern CaliforniaLos AngelesCAUSA
| | | | | |
Collapse
|
9
|
Tumin D. Patient-Centered Interventions and the Need for Patient-Centered Outcomes. Prog Transplant 2020; 30:75. [PMID: 32390571 DOI: 10.1177/1526924820914450] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Affiliation(s)
- Dmitry Tumin
- Department of Pediatrics, Brody School of Medicine, East Carolina University, Greenville, NC, USA
| |
Collapse
|
10
|
Lopez Ramos C, Williams JE, Bababekov YJ, Chang DC, Carter BS, Jones PS. Assessing the Understandability and Actionability of Online Neurosurgical Patient Education Materials. World Neurosurg 2019; 130:e588-e597. [DOI: 10.1016/j.wneu.2019.06.166] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2019] [Revised: 06/19/2019] [Accepted: 06/20/2019] [Indexed: 02/06/2023]
|
11
|
Do Social Determinants Define "Too Sick" to Transplant in Patients With End-stage Liver Disease? Transplantation 2019; 104:280-284. [PMID: 31335769 DOI: 10.1097/tp.0000000000002858] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
BACKGROUND Delisting for being "too sick" to be transplanted is subjective. Previous work has demonstrated that the mortality of patients delisted for "too sick" is unexpectedly low. Transplant centers use their best clinical judgment for determining "too sick," but it is unclear how social determinants influence decisions to delist for "too sick." We hypothesized that social determinants and Donor Service Area (DSA) characteristics may be associated with determination of "too sick" to transplant. METHODS Data were obtained from the Scientific Registry of Transplant Recipients for adults listed and removed from the liver transplant waitlist from 2002 to 2017. Patients were included if delisted for "too sick." Our primary outcome was Model for End-Stage Liver Disease (MELD) score at waitlist removal for "too sick." Regression assessed the association between social determinants and MELD at removal for "too sick." RESULTS We included 5250 delisted for "too sick" at 127 centers, in 53 DSAs, over 16 years. The mean MELD at delisting for "too sick" was 25.8 (SD ± 11.2). On adjusted analysis, social determinants including age, race, sex, and education predicted the MELD at delisting for "too sick" (P < 0.05). CONCLUSIONS There is variation in delisting MELD for "too sick" score across DSA and time. While social determinants at the patient and system level are associated with delisting practices, the interplay of these variables warrants additional research. In addition, center outcome reports should include waitlist removal rate for "too sick" and waitlist death ratios, so waitlist management practice at individual centers can be monitored.
Collapse
|