The use of readability formulas in health care

Readability of online patient education material for foregut surgery

INTRODUCTION

Health literacy is the ability of individuals to use basic health information and services to make well-informed decisions. Low health literacy among surgical patients has been associated with nonadherence to preoperative and/or discharge instructions as well as poor comprehension of surgery. It likely poses as a barrier to patients considering foregut surgery which requires an understanding of different treatment options and specific diet instructions. The objective of this study was to assess and compare the readability of online patient education materials (PEM) for foregut surgery.

METHODS

Using Google, the terms "anti-reflux surgery, "GERD surgery," and "foregut surgery" were searched and a total of 30 webpages from universities and national organizations were selected. The readability of the text was assessed with seven instruments: Flesch Reading Ease formula (FRE), Gunning Fog (GF), Flesch-Kincaid Grade Level (FKGL), Coleman Liau Index (CL), Simple Measure of Gobbledygook (SMOG), Automated Readability Index (ARI), and Linsear Write Formula (LWF). Mean readability scores were calculated with standard deviations. We performed a qualitative analysis gathering characteristics such as, type of information (preoperative or postoperative), organization, use of multimedia, inclusion of a version in another language.

RESULTS

The overall average readability of the top PEM for foregut surgery was 12th grade. There was only one resource at the recommended sixth grade reading level. Nearly half of PEM included some form of multimedia.

CONCLUSIONS

The American Medical Association and National Institute of Health have recommended that PEMs to be written at the 5th-6th grade level. The majority of online PEM for foregut surgery is above the recommended reading level. This may be a barrier for patients seeking foregut surgery. Surgeons should be aware of the potential gaps in understanding of their patients to help them make informed decisions and improve overall health outcomes.

Quality of Information About Kidney Stones from Artificial Intelligence Chatbots

INTRODUCTION

Kidney stones are common and morbid conditions in the general population with a rising incidence globally. Prior studies show substantial limitations of online sources of information regarding prevention and treatment. The objective of this study was to examine the quality of information about kidney stones from artificial intelligence (AI) chatbots.

METHODS

The most common online searches about kidney stones from Google Trends and headers from the National Institute of Diabetes and Digestive and Kidney Diseases website were used as inputs to 4 AI chatbots (ChatGPT version 3.5, Perplexity, Chat Sonic, and Bing AI). Validated instruments were used to assess the quality (DISCERN instrument from 1 low to 5 high), understandability and actionability (PEMAT, from 0 to 100%) of the chatbot outputs. In addition, we examined the reading level of the information and whether there was misinformation compared to guidelines (5 point Likert scale).

RESULTS

AI chatbots generally provide high-quality consumer health information (median DISCERN 4 out of 5) and did not include misinformation (median 1 out of 5). The median understandability was moderate (median 69.6%) and actionability was moderate to poor (median 40%). Responses were presented at an advanced reading level (11th grade; median Flesch-Kincaid score 11.3).

CONCLUSIONS

AI chatbots provide generally accurate information on kidney stones and lack misinformation; however, it is not easily actionable and is presented above the recommended reading level for consumer health information.

Readability of Trauma-related Patient Education Materials From the American Academy of Orthopaedic Surgeons and Orthopaedic Trauma Association Websites

INTRODUCTION

Web-based resources serve as a fundamental educational platform for orthopaedic trauma patients; however, they are frequently written above the recommended sixth-grade reading level, and previous studies have demonstrated this for the American Academy of Orthopaedic Surgeons (AAOS) web-based articles. In this study, we perform an updated assessment of the readability of AAOS trauma-related educational articles as compared with injury-matched education materials developed by the Orthopaedic Trauma Association (OTA).

METHODS

All 46 AAOS trauma-related web-based ( https://www.orthoinfo.org/ ) patient education articles were analyzed for readability. Two independent reviewers used (1) the Flesch-Kincaid Grade Level (FKGL) and (2) the Flesch Reading Ease (FRE) algorithms to calculate the readability level. Mean readability scores were compared across body part categories. A one-sample t -test was done to compare mean FKGL with the recommended sixth-grade readability level and the average American adult reading level. A two-sample t -test was used to compare the readability scores of the AAOS trauma-related articles with those of the OTA.

RESULTS

The average (SD) FKGL and FRE for the AAOS articles were 8.9 (0.74) and 57.2 (5.8), respectively. All articles were written above the sixth-grade reading level. The average readability of the AAOS articles was significantly greater than the recommended sixth-grade reading level ( P < 0.001). The average FKGL and FRE for all AAOS articles were significantly higher compared with those of the OTA articles (8.9 ± 0.74 versus 8.1 ± 1.14, P < 0.001 and 57.2 ± 5.8 versus 65.6 ± 6.6, P < 0.001, respectively). Excellent agreement was observed between raters for the FKGL 0.956 (95% confidence interval, 0.922 to 0.975) and FRE 0.993 (95% confidence interval, 0.987 to 0.996).

DISCUSSION

Our findings suggest that after almost a decade, the readability of the AAOS trauma-related articles remains unchanged. The AAOS and OTA trauma patient education materials have high readability levels and may be too difficult for patient comprehension. A need remains to improve the readability of these commonly used trauma education materials.

Clear aligner therapy informed consent forms: A quality and readability evaluation

OBJECTIVE

The aim of the present study was to evaluate the quality and readability of content contained within clear aligner therapy (CAT) informed consent forms.

METHODS

CAT informed consent forms were identified via an online search. The presence of details related to CAT-related processes, risks, benefits and alternatives in each form was recorded. A 4-point Likert type scale was used to determine the quality of content (QOC). The readability of content was evaluated with the Simple Measure of Gobbledegook (SMOG) and Flesch Reading Ease Score (FRES).

RESULTS

A total of 42 forms satisfied selection criteria. Nineteen (45.2%) were authored by companies who provided aligners to patients via clinicians. The QOC regarding CAT-related treatment processes [median 2.0; IQR 0, 2] and benefits [median 2.0; IQR 1, 2] was adequate. The QOC scores regarding treatment alternatives, consequences of no treatment and relapse were poor. There was no difference (P=0.59) in the median (IQR) QOC of the informed consent forms provided by direct-to-consumer (DTC) aligner providers [10 (8.25, 16.25)] and non-DTC aligner providers [12 (10, 14)]. The median (IQR) SMOG score was 12.1 (10.9, 12.7) and FRES was 39.0 (36.0, 44.25).

CONCLUSIONS

The QOC of the evaluated forms was incomplete and poor. The content was difficult to read and failed to reach recommended readability standards. Consent is unlikely to be valid if it is based solely on the content of the forms. Clinicians need to be aware of the limitations of informed consent forms for CAT particularly in relation to alternatives, prognosis, risks, and the need for long-term maintenance of results.

An artificial intelligence language model improves readability of burns first aid information

AIMS

This study aimed to assess the potential of using an artificial intelligence (AI) large language model to improve the readability of burns first aid information.

METHODS

An AI language model (ChatGPT-3) was used to rewrite content from the top 50 English-language webpages containing burns first aid information to be understandable by an individual with the literacy level of an 11-year-old, as recommended by the American Medical Association and Health Education England. The assessment of readability was conducted using five validated tools.

RESULTS

In their original form, only 4% of the patient education materials (PEMs) met the target readability level across all tools. The median grade was 6.9 (SD=1.1). One-sample one-tailed t-test revealed that this was not significantly below the target (p = .31). After AI-modification, 18% of PEMs reached the target level using all tools, with a median grade of 6 (SD=0.9), which was significantly below the target level (p < .001). Once rewritten using AI, paired t-test demonstrated that all readability scores improved significantly (p < .001).

CONCLUSION

Utilising an AI language model proved an effective and viable method for enhancing readability of burns first aid information.

Ostomy Information on the Internet-Is It Good Enough?

PURPOSE

The aim of this study was to determine which internet search engines and keywords patients with ostomies utilize, to identify the common websites using these terms, to determine what aspects of information they wanted, and to perform a quality and readability assessment for these websites.

DESIGN

A cross-sectional survey of persons with ostomies to identify search engines and terms, followed by a structured assessment of the quality and readability of the identified web pages.

SUBJECT AND SETTINGS

The sample comprised 20 hospitalized patients with ostomies cared for on a colorectal surgical ward of a tertiary care hospital located in Melbourne, Australia. There were 15 (75%) adult males and 5 (25%) adult females; their mean age was 52.2 years. Participants were surveyed between August and December 2020.

METHODS

Patients with newly formed ostomies were surveyed about which search engines and keywords they would use to look for information and for which questions regarding ostomies they wanted answers. In addition, 2 researchers then performed independent searches using the search terms identified by patient participants. These searches were conducted in August 2021, with the geographical location set to Australia. The quality of the websites was graded using the DISCERN, Ensuring Quality Information for Patients, and Quality Evaluation Scoring Tool scoring assessments, and their readability was graded using the Flesch Reading Ease Score tool.

RESULTS

Participants used Google as their primary search engine. Four keywords/phrases were identified: stoma for bowel surgery, ileostomy, colostomy, and caring for stoma. Multiple web pages were identified, 8 (21%) originated from Australia, 7 (18%) were from the United Kingdom, and 23 (61%) were from the United States. Most web pages lacked recent updates; only 18% had been undated within the last 12 months. The overall quality of the online information on ostomies was moderate with an average level of readability, deemed suitable for patient educational purposes.

CONCLUSIONS

Information for persons living with an ostomy can be obtained from multiple web pages, and many sites have reasonable quality and are written at a suitable level. Unfortunately, these websites are rarely up-to-date and may contain advice that may not be applicable to individual patients.

Empowering inclusivity: improving readability of living kidney donation information with ChatGPT

Background

Addressing disparities in living kidney donation requires making information accessible across literacy levels, especially important given that the average American adult reads at an 8th-grade level. This study evaluated the effectiveness of ChatGPT, an advanced AI language model, in simplifying living kidney donation information to an 8th-grade reading level or below.

Methods

We used ChatGPT versions 3.5 and 4.0 to modify 27 questions and answers from Donate Life America, a key resource on living kidney donation. We measured the readability of both original and modified texts using the Flesch-Kincaid formula. A paired t-test was conducted to assess changes in readability levels, and a statistical comparison between the two ChatGPT versions was performed.

Results

Originally, the FAQs had an average reading level of 9.6 ± 1.9. Post-modification, ChatGPT 3.5 achieved an average readability level of 7.72 ± 1.85, while ChatGPT 4.0 reached 4.30 ± 1.71, both with a p-value <0.001 indicating significant reduction. ChatGPT 3.5 made 59.26% of answers readable below 8th-grade level, whereas ChatGPT 4.0 did so for 96.30% of the texts. The grade level range for modified answers was 3.4-11.3 for ChatGPT 3.5 and 1-8.1 for ChatGPT 4.0.

Conclusion

Both ChatGPT 3.5 and 4.0 effectively lowered the readability grade levels of complex medical information, with ChatGPT 4.0 being more effective. This suggests ChatGPT's potential role in promoting diversity and equity in living kidney donation, indicating scope for further refinement in making medical information more accessible.

User Information Sharing and Hospital Website Privacy Policies

Importance

Hospital websites frequently use tracking technologies that transfer user information to third parties. It is not known whether hospital websites include privacy policies that disclose relevant details regarding tracking.

Objective

To determine whether hospital websites have accessible privacy policies and whether those policies contain key information related to third-party tracking.

Design, Setting, and Participants

In this cross-sectional content analysis of website privacy policies of a nationally representative sample of nonfederal acute care hospitals, hospital websites were first measured to determine whether they included tracking technologies that transferred user information to third parties. Hospital website privacy policies were then identified using standardized searches. Policies were assessed for length and readability. Policy content was analyzed using a data abstraction form. Tracking measurement and privacy policy retrieval and analysis took place from November 2023 to January 2024. The prevalence of privacy policy characteristics was analyzed using standard descriptive statistics.

Main Outcomes and Measures

The primary study outcome was the availability of a website privacy policy. Secondary outcomes were the length and readability of privacy policies and the inclusion of privacy policy content addressing user information collected by the website, potential uses of user information, third-party recipients of user information, and user rights regarding tracking and information collection.

Results

Of 100 hospital websites, 96 (96.0%; 95% CI, 90.1%-98.9%) transferred user information to third parties. Privacy policies were found on 71 websites (71.0%; 95% CI, 61.6%-79.4%). Policies were a mean length of 2527 words (95% CI, 2058-2997 words) and were written at a mean grade level of 13.7 (95% CI, 13.4-14.1). Among 71 privacy policies, 69 (97.2%; 95% CI, 91.4%-99.5%) addressed types of user information automatically collected by the website, 70 (98.6%; 95% CI, 93.8%-99.9%) addressed how collected information would be used, 66 (93.0%; 95% CI, 85.3%-97.5%) addressed categories of third-party recipients of user information, and 40 (56.3%; 95% CI, 44.5%-67.7%) named specific third-party companies or services receiving user information.

Conclusions and Relevance

In this cross-sectional study of hospital website privacy policies, a substantial number of hospital websites did not present users with adequate information about the privacy implications of website use, either because they lacked a privacy policy or had a privacy policy that contained limited content about third-party recipients of user information.

The Readability of Patient-Facing Social Media Posts on Common Otolaryngologic Diagnoses

OBJECTIVE

To assess the readability of patient-facing educational information about the most common otolaryngology diagnoses on popular social media platforms.

STUDY DESIGN

Cross-sectional study.

SETTING

Social media platforms.

METHODS

The top 5 otolaryngologic diagnoses were identified from the National Ambulatory Medical Care Survey Database. Facebook, Twitter, TikTok, and Instagram were searched using these terms, and the top 25 patient-facing posts from unique accounts for each search term and poster type (otolaryngologist, other medical professional, layperson) were identified. Captions, text, and audio from images and video, and linked articles were extracted. The readability of each post element was calculated with multiple readability formulae. Readability was summarized and was compared between poster types, platforms, and search terms via Kruskal-Wallis testing.

RESULTS

Median readability, by grade level, by grade level, was greater than 10 for captions, 5 for image-associated text, and 9 for linked articles. Captions and images in posts by laypeople were significantly more readable than captions by otolaryngologists or other medical professionals, but there was no difference for linked articles. All post components were more readable in posts about cerumen than those about other search terms.

CONCLUSIONS

When examining the readability of posts on social media regarding the most common otolaryngology diagnoses, we found that many posts are less readable than recommended for patients, and found that posts by laypeople were significantly more readable than those by medical professionals. Medical professionals should work to make educational social media posts more readable to facilitate patient comprehension.

A standardised method for improving patient education material readability for orthopaedic trauma patients

PURPOSE

While the National Institutes of Health and American Medical Association recommend patient education materials (PEMs) should be written at the sixth-grade reading level or below, many patient education materials related to traumatic orthopaedic injuries do not meet these recommendations. The purpose of this study is to create a standardised method for enhancing the readability of trauma-related orthopaedic PEMs by reducing the use of ≥ three syllable words and reducing the use of sentences >15 words in length. We hypothesise that applying this standardized method will significantly improve the objective readability of orthopaedic trauma PEMs.

METHODS

A patient education website was queried for PEMs relevant to traumatic orthopaedic injuries. Orthopaedic trauma PEMs included (N = 40) were unique, written in a prose format, and <3500 words. PEM statistics, including scores for seven independent readability formulae, were determined for each PEM before and after applying this standard method.

RESULTS

All PEMs had significantly different readability scores when comparing original and edited PEMs (p < 0.01). The mean Flesch Kincaid Grade Level of the original PEMs (10.0 ± 1.0) was significantly higher than that of edited PEMs (5.8 ± 1.1) (p < 0.01). None of the original PEMs met recommendations of a sixth-grade reading level compared with 31 (77.5%) of edited PEMs.

CONCLUSIONS

This standard method that reduces the use of ≥ three syllable words and <15 word sentences has been shown to significantly reduce the reading-grade level of PEMs for traumatic orthopaedic injuries. Improving the readability of PEMs may lead to enhanced health literacy and improved health outcomes.

A Readability Study of Carpal Tunnel Release in 2023

BACKGROUND

The National Institutes of Health (NIH) and the American Medical Association (AMA) recommend a sixth-grade reading level for patient-directed content. This study aims to quantitatively evaluate the readability of online information sources related to carpal tunnel surgery using established readability indices.

METHODS

Web searches for "carpal tunnel release" and "carpal tunnel decompression surgery" queries were performed using Google, and the first 20 websites were identified per query. WebFX online software tools were utilized to determine readability. Indices included Flesch Kincaid Reading Ease, Flesch Kincaid Grade Level, Coleman Liau Index, Automated Readability Index, Gunning Fog Score, and the Simple Measure of Gobbledygook Index. Health-specific clickthrough rate (CTR) data were used in order to select the first 20 search engine results page from each query.

RESULTS

"Carpal tunnel release" had a mean readability of 8.46, and "carpal tunnel decompression surgery" had a mean readability of 8.70. The range of mean readability scores among the indices used for both search queries was 6.17 to 14.0. The total mean readability for carpal tunnel surgery information was found to be 8.58. This corresponds to approximately a ninth-grade reading level in the United States.

CONCLUSION

The average readability of carpal tunnel surgery online content is three grade levels above the recommended sixth-grade level for patient-directed materials. This discrepancy indicates that existing online materials related to carpal tunnel surgery are more difficult to understand than the standards set by NIH and AMA.

Clear as Mud: Readability Scores in Cloacal Exstrophy Literature and Its Treatment

Purpose

This study examines the readability of online medical information regarding cloacal exstrophy (CE). We hypothesize that inappropriate levels of comprehension are required in these resources, leading to poor understanding and confusion amongst caregivers.

Methods

The Google and Bing search engines were used to search the terms "cloacal exstrophy" and "cloacal exstrophy treatment". The first 100 results for each were collected. Each webpage was analyzed for readability using four independent validated scoring systems: the Gunning-Fog index (GFI), SMOG grade (Simple Measure of Gobbledygook), Dale-Chall index (DCI), and the Flesch-Kincaid grade (FKG).

Results

Forty-seven unique webpages fit the inclusion criteria. Mean readability scores across all websites were GFI, 14.6; SMOG score, 10.8; DCI, 9.3; and FKG, 11.8, correlating to adjusted grade levels of college sophomore, 11th grade, college, and 11th grade, respectively. There were significant differences across all readability formulas. Non-profit websites were significantly less readable than institutional and commercial webpages (GFI p = 0.012, SMOG p = 0.018, DCI p = 0.021, FKG p = 0.0093).

Conclusion

Caregiver-directed health information regarding CE and its treatment available online is written at the 11th grade reading level or above. Online resources pertaining to CE must be simplified to be effective.

Evaluation of quality and readability of internet information on voice disorders

OBJECTIVES

The purpose of this study is to evaluate the readability and quality of Internet information related to vocal health, voice disorders and voice therapy.

STUDY DESIGN

This is a cross-sectional study.

METHODS

Eighty-two websites were included. Websites were then analyzed; their origin (clinic/hospital, non-profit, government), quality (Health On the Net [HON] certification and DISCERN scores) and readability (Ateşman readability formula and Bezirci-Yılmaz new readability formula) were assessed. Statistical analysis was used to examine differences between website origin and quality and readability scores and correlations between readability instruments.

RESULTS

Of the 82 websites, 93% were of private clinic/hospital, 6% were of non-profit organisation and 1% were of government. None of the 82 websites were HON certification, and the mean score of the item determining the general quality measure in DISCERN was 1.83 in a five-point scale. The mean of Ateşman readability formula value was calculated as 50.46 (±8.16). This value is defined as 'moderately hard' according to the readability scale. The average of Bezirci-Yılmaz new readability formula value is 13.85 (±3.48). This value is defined as 13th and 14th grade.

CONCLUSIONS

The quality of Internet-based health information about the voice is generally inadequate, and the sites examined in this study may be limited due to high readability levels. This may be a problem in people with poor literacy skills. For this reason, it is very important for speech and language therapists and other health professionals to evaluate and monitor the quality and readability of Internet-based information.

How Well Do Artificial Intelligence Chatbots Respond to the Top Search Queries About Urological Malignancies?

Artificial intelligence (AI) chatbots are becoming a popular source of information but there are limited data on the quality of information on urological malignancies that they provide. Our objective was to characterize the quality of information and detect misinformation about prostate, bladder, kidney, and testicular cancers from four AI chatbots: ChatGPT, Perplexity, Chat Sonic, and Microsoft Bing AI. We used the top five search queries related to prostate, bladder, kidney, and testicular cancers according to Google Trends from January 2021 to January 2023 and input them into the AI chatbots. Responses were evaluated for quality, understandability, actionability, misinformation, and readability using published instruments. AI chatbot responses had moderate to high information quality (median DISCERN score 4 out of 5, range 2-5) and lacked misinformation. Understandability was moderate (median Patient Education Material Assessment Tool for Printable Materials [PEMAT-P] understandability 66.7%, range 44.4-90.9%) and actionability was moderate to poor (median PEMAT-P actionability 40%, range 0-40%The responses were written at a fairly difficult reading level. AI chatbots produce information that is generally accurate and of moderate to high quality in response to the top urological malignancy-related search queries, but the responses lack clear, actionable instructions and exceed the reading level recommended for consumer health information. PATIENT SUMMARY: Artificial intelligence chatbots produce information that is generally accurate and of moderately high quality in response to popular Google searches about urological cancers. However, their responses are fairly difficult to read, are moderately hard to understand, and lack clear instructions for users to act on.

Development of a New Tool for Writing Research Key Information in Plain Language

BACKGROUND

The complexity of research informed consent forms makes it hard for potential study participants to make informed consent decisions. In response, new rules for human research protection require informed consent forms to begin with a key information section that potential study participants can read and understand. This research study builds on exiting guidance on how to write research key information using plain language.

OBJECTIVE

The aim of this study was to develop a valid and reliable tool to evaluate and improve the readability, understandability, and actionability of the key information section on research informed consent forms.

METHODS

We developed an initial list of measures to include on the tool through literature review; established face and content validity of measures with expert input; conducted four rounds of reliability testing with four groups of reviewers; and established construct validity with potential research participants.

KEY RESULTS

We identified 87 candidate measures via literature review. After expert review, we included 23 items on the initial tool. Twenty-four raters conducted 4 rounds of reliability testing on 10 informed consent forms. After each round, we revised or eliminated items to improve agreement. In the final round of testing, 18 items demonstrated substantial inter-rater agreement per Fleiss' Kappa (average = .73) and Gwet's AC1 (average = .77). Intra-rater agreement was substantial per Cohen's Kappa (average = .74) and almost perfect per Gwet's AC1 (average = 0.84). Focus group feedback (N = 16) provided evidence suggesting key information was easy to read when rated as such by the Readability, Understandability and Actionability of Key Information (RUAKI) Indicator.

CONCLUSION

The RUAKI Indicator is an 18-item tool with evidence of validity and reliability investigators can use to write the key information section on their informed consent forms that potential study participants can read, understand, and act on to make informed decisions. [HLRP: Health Literacy Research and Practice. 2024;8(1):e29-e37.].

Readability, accountability, and quality of burns first aid information available online

AIM

To assess the readability, accountability, and quality of burns first aid information available online.

METHODS

The top 50 English language webpages containing burns first aid information were compiled and categorised. Readability was measured using five validated tools. Accountability was assessed using the Journal of the American Medical Association (JAMA) benchmarks. Quality was evaluated using a scale based on previous literature.

RESULTS

Two (4%) webpages were judged to be at the target reading level using all tools. Median grade ranged from 4.6 to 9.6 (M = 6.9, SD = 1.1). One-sample one-tailed t-test determined that median grade was not significantly below the target grade of ≤ 6.9 (p = 0.314). Only seven (14%) webpages satisfied all the JAMA accountability benchmarks. No webpages fulfilled all 15 quality criteria. Mean quality score was 9.8 (SD = 2.4). Only 27 (54%) advised 20 min of cooling. One-way analysis of variance demonstrated that accountability was influenced by source (p = 0.01). Pearson's correlation coefficient revealed that accountability and quality had a positive correlation (r = 0.32, p = 0.02).

CONCLUSION

Much of the burns first aid information available online is written above the recommended reading level and fails to meet standards of accountability or quality.

Availability and Readability Level of Online Patient Education Materials Provided by Cleft Lip and Palate Teams

OBJECTIVES

Evaluate the readability of online English and Spanish cleft lip and palate patient education materials.

DESIGN

Review of free online materials.

SETTING

English and Spanish language online patient education materials on cleft lip and palate were collected from American Cleft Palate-Craniofacial Association (ACPA) approved teams.

PARTICIPANTS

American Cleft Palate-Craniofacial Association (ACPA) approved teams.

INTERVENTIONS

English materials were analyzed using the Flesch-Kincaid, SMOG, and Coleman-Liau readability calculators. Spanish materials were analyzed using the Fry Graph, Fernandez Huerta, and INFLESZ calculators. A one-way analysis of variance (ANOVA) was used to test for variability between the readability tools.

OUTCOMES

Readability levels were examined for both sets of materials.

RESULTS

171 (90.5%) teams provided English language materials online, with an average readability score calculated as 10.5 ± 2.9 (10th-11th grade). A total of 44 (23.2%) teams listed Spanish language materials online, with average readability score of 7.9 ± 1.2 (8th grade). ANOVA demonstrated statistically significant variability between the readability assessment tools (P < .01).

CONCLUSION

Online cleft lip and palate patient education material provided by ACPA craniofacial teams were more available in English than in Spanish. Both sets of materials demonstrated readability levels above the recommended 6th-7th grade. Refining readability is associated with lowered healthcare costs and increased patient satisfaction.

Health literacy in rotator cuff repair: a quantitative assessment of the understandability of online patient education material

Background

The American Medical Association and National Institutes of Health recommend online health information be written at a 6th grade or lower reading level for clear understanding. While syntax reading grade level has previously been utilized, those analyses do not determine whether readers are processing key information (understandability) or identifying available actions to take (actionability). The Patient Education Materials Assessment Tool (PEMAT-P) is a method to measure the understandability and actionability of online patient education materials. The purpose of this study was to evaluate online resources regarding rotator cuff repair utilizing measures of readability, understandability, and actionability.

Methods

The search term "rotator cuff surgery" was used in two independent online searches to obtain the top 50 search results. The readability of included resources was quantified using valid objective algorithms: Flesch-Kincaid Grade-Level, Simple Measure of Gobbledygook grade, Coleman-Liau Index, and Gunning Fog Index. The PEMAT-P form was used to assess actionability and understandability.

Results

A total of 49 unique websites were identified to meet our inclusion criteria and were included in our analysis. The mean Flesch-Kincaid Grade Level graded materials at a 10.6 (approximately a 10th grade reading level), with only two websites offering materials at a 6th grade reading level or below. The remaining readability studies graded the mean reading level at high school or greater, with the Gunning Fog Index scoring at a collegiate reading level. Mean understandability and actionability scores were 64.6% and 29.5%, respectively, falling below the 70% PEMAT score threshold for both scales. Fourteen (28.6%) websites were above the threshold for understandability, while no website (0%) scored above the 70% threshold for actionability. When comparing source categories, commercial health publishers provided websites that scored higher in understandability (P < .05), while private practice materials scored higher in actionability (P < .05). Resources published by academic institutions or organizations scored lower in both understandability and actionability than private practice and commercial health publishers (P < .05). No readability, understandability, or actionability score was significantly associated with search result rank.

Conclusion

Overall, online patient education materials related to rotator cuff surgery scored poorly with respect to readability, understandability, and actionability. Only two (4.1%) of the patient education websites scored at the American Medical Association and National Institutes of Health recommended reading level. Fourteen (28.6%) scored above the 70% PEMAT score for understandability; however, no website met the threshold for actionability.

Large Language Model-Based Chatbot vs Surgeon-Generated Informed Consent Documentation for Common Procedures

Importance

Informed consent is a critical component of patient care before invasive procedures, yet it is frequently inadequate. Electronic consent forms have the potential to facilitate patient comprehension if they provide information that is readable, accurate, and complete; it is not known if large language model (LLM)-based chatbots may improve informed consent documentation by generating accurate and complete information that is easily understood by patients.

Objective

To compare the readability, accuracy, and completeness of LLM-based chatbot- vs surgeon-generated information on the risks, benefits, and alternatives (RBAs) of common surgical procedures.

Design, Setting, and Participants

This cross-sectional study compared randomly selected surgeon-generated RBAs used in signed electronic consent forms at an academic referral center in San Francisco with LLM-based chatbot-generated (ChatGPT-3.5, OpenAI) RBAs for 6 surgical procedures (colectomy, coronary artery bypass graft, laparoscopic cholecystectomy, inguinal hernia repair, knee arthroplasty, and spinal fusion).

Main Outcomes and Measures

Readability was measured using previously validated scales (Flesh-Kincaid grade level, Gunning Fog index, the Simple Measure of Gobbledygook, and the Coleman-Liau index). Scores range from 0 to greater than 20 to indicate the years of education required to understand a text. Accuracy and completeness were assessed using a rubric developed with recommendations from LeapFrog, the Joint Commission, and the American College of Surgeons. Both composite and RBA subgroup scores were compared.

Results

The total sample consisted of 36 RBAs, with 1 RBA generated by the LLM-based chatbot and 5 RBAs generated by a surgeon for each of the 6 surgical procedures. The mean (SD) readability score for the LLM-based chatbot RBAs was 12.9 (2.0) vs 15.7 (4.0) for surgeon-generated RBAs (P = .10). The mean (SD) composite completeness and accuracy score was lower for surgeons' RBAs at 1.6 (0.5) than for LLM-based chatbot RBAs at 2.2 (0.4) (P < .001). The LLM-based chatbot scores were higher than the surgeon-generated scores for descriptions of the benefits of surgery (2.3 [0.7] vs 1.4 [0.7]; P < .001) and alternatives to surgery (2.7 [0.5] vs 1.4 [0.7]; P < .001). There was no significant difference in chatbot vs surgeon RBA scores for risks of surgery (1.7 [0.5] vs 1.7 [0.4]; P = .38).

Conclusions and Relevance

The findings of this cross-sectional study suggest that despite not being perfect, LLM-based chatbots have the potential to enhance informed consent documentation. If an LLM were embedded in electronic health records in a manner compliant with the Health Insurance Portability and Accountability Act, it could be used to provide personalized risk information while easing documentation burden for physicians.

Assessment of Artificial Intelligence Chatbot Responses to Top Searched Queries About Cancer

Importance

Consumers are increasingly using artificial intelligence (AI) chatbots as a source of information. However, the quality of the cancer information generated by these chatbots has not yet been evaluated using validated instruments.

Objective

To characterize the quality of information and presence of misinformation about skin, lung, breast, colorectal, and prostate cancers generated by 4 AI chatbots.

Design, Setting, and Participants

This cross-sectional study assessed AI chatbots' text responses to the 5 most commonly searched queries related to the 5 most common cancers using validated instruments. Search data were extracted from the publicly available Google Trends platform and identical prompts were used to generate responses from 4 AI chatbots: ChatGPT version 3.5 (OpenAI), Perplexity (Perplexity.AI), Chatsonic (Writesonic), and Bing AI (Microsoft).

Exposures

Google Trends' top 5 search queries related to skin, lung, breast, colorectal, and prostate cancer from January 1, 2021, to January 1, 2023, were input into 4 AI chatbots.

Main Outcomes and Measures

The primary outcomes were the quality of consumer health information based on the validated DISCERN instrument (scores from 1 [low] to 5 [high] for quality of information) and the understandability and actionability of this information based on the understandability and actionability domains of the Patient Education Materials Assessment Tool (PEMAT) (scores of 0%-100%, with higher scores indicating a higher level of understandability and actionability). Secondary outcomes included misinformation scored using a 5-item Likert scale (scores from 1 [no misinformation] to 5 [high misinformation]) and readability assessed using the Flesch-Kincaid Grade Level readability score.

Results

The analysis included 100 responses from 4 chatbots about the 5 most common search queries for skin, lung, breast, colorectal, and prostate cancer. The quality of text responses generated by the 4 AI chatbots was good (median [range] DISCERN score, 5 [2-5]) and no misinformation was identified. Understandability was moderate (median [range] PEMAT Understandability score, 66.7% [33.3%-90.1%]), and actionability was poor (median [range] PEMAT Actionability score, 20.0% [0%-40.0%]). The responses were written at the college level based on the Flesch-Kincaid Grade Level score.

Conclusions and Relevance

Findings of this cross-sectional study suggest that AI chatbots generally produce accurate information for the top cancer-related search queries, but the responses are not readily actionable and are written at a college reading level. These limitations suggest that AI chatbots should be used supplementarily and not as a primary source for medical information.

Lower Back Pain Imaging: A Readability Analysis

PURPOSE

The internet provides access to a myriad of educational health-related resources which are an invaluable source of information for patients. Lower back pain is a common complaint that is discussed extensively online. In this article, we aim to determine if the most commonly accessed articles about lower back pain imaging use language that can be understood by most patients. According to the American Medical Association (AMA) and National Institute of Health (NIH), this corresponds to a sixth-grade reading level.

METHODS

Online searches were conducted from the most commonly used search engine, Google, to assess the present state of readability on radiograph imaging for LBP. Then the top 20 populated URL links from each search were utilized based on "health & fitness" search trends and click-through rates (CTRs). The readability of various websites was evaluated with WebFX online software that analyzed the unique websites' text when put into reader view on Firefox web browser version 116.0.3 (64-bit). Evaluation occurred via five common readability indices: the Automated Readability Index (ARI), the Coleman Liau Index (CLI), the SMOG index, the Gunning Fog Score Index (GFSI), and the Flesch Kincaid Grade Level Index (FKGLI). In addition, the Flesch Kincaid Reading Ease Index (FKREI) was also used but was excluded from the calculation due to its measuring scale outside of US grade levels. The number of samples was analyzed via health and fitness-specific CTR from an open-access database from July 2022 to July 2023. This was used to calculate the number of persons clicking and visiting positional URLs (first URL to the 20th URL) from each unique keyword search and the rational criteria for selecting the first 20 websites for each query.

RESULTS

Online material that included LBP imaging information was calculated to have an overall readability score of 10.745 out of the 23 websites obtained from unique searches. The range was a mean readability score of 8 to 14. Notably, 17 websites were excluded from a total of 40 websites due to duplication of the same data (URLs that resulted from both unique searches) and accessibility requiring payment (specifically, an UpToDate link). A readability score of 10.745 refers to an 11th-grade reading level. That is to say, the most commonly visited sites on Google that contain information about lower back pain imaging are, on average, five grade levels higher than the sixth-grade reading level recommended by the AMA and the NIH.

CONCLUSIONS

Most internet content regarding lower back pain imaging is written at a reading level that is above the recommended limit defined by the AMA and NIH. To improve education about lower back pain imaging and the patient-physician relationship, we recommend guiding patients to online material that contains a reading level at the sixth-grade level as suggested by the AMA and NIH.

Evaluating the Quality of Online Information Regarding Neoadjuvant Therapy for Pancreatic Cancer

PURPOSE

Neoadjuvant therapy (NT) is increasingly utilized for patients with localized pancreatic ductal adenocarcinoma (PDAC). Patients with cancer have high information needs and the Internet has materialized as a leading source of information for many patients. Nevertheless, little is known about the availability, accessibility, quality, and readability of online information regarding NT for PDAC.

METHODS

A search of online patient informational materials (PIMs) pertaining to NT for PDAC was conducted using a combination of common search engines and browsers. Two independent researchers evaluated the readability, quality, and availability of unique PIMs from the top 25 websites from each search using validated measures.

RESULTS

Among the 130 websites retrieved, 46 (35.4%) unique PIMs focused on treatment of PDAC. Only 30 (23%) mentioned NT as a possible treatment option. Downstaging was the rationale for NT mentioned in the majority (90%) of websites. The mean quality and reliability of the 30 PIMs, assessed using the DISCERN instrument, was 3.3 ± 0.7, suggesting moderate quality/reliability. The mean readability score, assessed using the SMOG Grade tool, was 10.96 ± 1.49, which is equivalent to an 11th grade reading level.

CONCLUSION

The low availability, poor readability, and moderate quality of online informational materials regarding NT for PDAC highlight the need for new patient-centered resources to educate patients and caregivers on an increasingly utilized treatment strategy for localized PDAC.

Parental Attitudes About Lumbar Puncture in Children With Suspected Central Nervous System Infection

OBJECTIVES

This study aimed to evaluate parents' attitudes toward lumbar puncture (LP) for their children with suspected central nervous system infection to determine the reasons for rejection and related factors.

METHODS

The survey was provided to parents of children (1 month to 18 years old) for whom LP was recommended because of a concern for central nervous system infection. Sociodemographic characteristics and other related factors of parents who did and did not approve of LP were compared statistically. The reasons for the disapproval of parents who refused LP were revealed.

RESULTS

A total of 100 parents were included in the study. Eighty-two percent of the participating parents were mothers, and the median age of the mothers was 31 years (min: 17 years; max: 70 years). The median age of the fathers was 37 years (min: 22 years; max: 60 years). Among the parents, 34% did not give consent for LP. The most common reason for the participants to refuse LP was fear of paralysis of their children due to the procedure (82.3%). There was a statistical difference between the approval of the LP procedure and the person who informed the parents about the LP procedure and read the informed consent form ( P = 0.004 and P = 0.038, respectively).As a result of the binary logistic regression analysis, it was seen that the rate of acceptance of the LP procedure by the parents informed by the specialist doctors was 7.1-fold ( P = 0.02; 95% confidence interval, 1.3-37.6) higher than the parents informed by the resident physicians.

CONCLUSION

The informed consent process mainly influenced parents' attitudes toward LP. To increase the acceptance rates of LP, we should standardize the informed consent process so that it is not affected by factors such as seniority of the physician.

Readability of spine-related patient education materials: a standard method for improvement

PURPOSE

Orthopaedic patient education materials (PEMs) have repeatedly been shown to be well above the recommended reading level by the National Institute of Health and American Medical Association. The purpose of this study is to create a standardized method to improve the readability of PEMs describing spine-related conditions and injuries. It is hypothesized that reducing the usage of complex words (≥ 3 syllables) and reducing sentence length to < 15 words per sentence improves readability of PEMs as measured by all seven readability formulas used.

METHODS

OrthoInfo.org was queried for spine-related PEMs. The objective readability of PEMs was evaluated using seven unique readability formulas before and after applying a standardized method to improve readability while preserving critical content. This method involved reducing the use of > 3 syllable words and ensuring sentence length is < 15 words. Paired samples t-tests were conducted to assess relationships with the cut-off for statistical significance set at p < 0.05.

RESULTS

A total of 20 spine-related PEM articles were used in this study. When comparing original PEMs to edited PEMs, significant differences were seen among all seven readability scores and all six numerical descriptive statistics used. Per the Flesch Kincaid Grade level readability formula, one original PEM (5%) versus 15 edited PEMs (75%) met recommendations of a sixth-grade reading level.

CONCLUSION

The current study shows that using this standardized method significantly improves the readability of spine-related PEMs and significantly increased the likelihood that PEMs will meet recommendations for being at or below the sixth-grade reading level.

Mobile Health Hearing Aid Acclimatization and Support Program in Low-Income Communities: Feasibility Study

BACKGROUND

The most common management option for hearing loss is hearing aids. In addition to devices, patients require information and support, including maintenance and troubleshooting. Mobile health (mHealth) technologies can support hearing aid management, acclimatization, and use. This study developed an mHealth acclimatization and support program for first-time hearing aid users and subsequently implemented and pilot-tested the feasibility of the program. The program was facilitated by community health workers (CHWs) in low-income communities in South Africa.

OBJECTIVE

This study aimed to evaluate the feasibility of an mHealth acclimatization and support program supported by CHWs in low-income communities.

METHODS

An application-based acclimatization and support was adapted and translated for use in low- and middle-income countries. This program was delivered in the form of 20 different voice notes accompanied by graphical illustrations via WhatsApp or 20 different SMS text messages. The program was provided to first-time hearing aid users immediately after a community-based hearing aid fitting in March 2021 in 2 low-income communities in the Western Cape, South Africa. The 20 messages were sent over a period of 45 days. Participants were contacted telephonically on days 8, 20, and 43 of the program and via open-ended paper-based questionnaires translated to isiXhosa 45 days and 6 months after the program started to obtain information on their experiences, perceptions, and accessibility of the program. Their responses were analyzed using inductive thematic analysis.

RESULTS

A total of 19 participants fitted with hearing aids received the mHealth acclimatization and support program. Most participants (15/19, 79%) received the program via WhatsApp, with 21% (4/19) of them receiving it via SMS text message. Participants described the program as helpful, supportive, informative, sufficient, and clear at both follow-ups. A total of 14 participants reported that they were still using their hearing aids at the 6-month follow-up. Three participants indicated that not all their questions about hearing aids were answered, and 5 others had minor hearing aid issues. This included feedback (n=1), battery performance (n=1), physical fit (n=2), and issues with hearing aid accessories (n=1). However, CHWs successfully addressed all these issues. There were no notable differences in responses between the participants who received the program via WhatsApp compared with those who received it through SMS text message. Most participants receiving WhatsApp messages reported that the voice notes were easier to understand, but the graphical illustrations supplemented the voice notes well.

CONCLUSIONS

An mHealth acclimatization and support program is feasible and potentially assists hearing aid acclimatization and use for first-time users in low-income communities. Scalable mHealth support options can facilitate increased access and improve outcomes of hearing care.

Are Mobile Applications in Laryngology Designed for All Patients?

OBJECTIVES

Mobile applications (apps) are multiplying in laryngology, with little standardization of content, functionality, or accessibility. The purpose of this study is to evaluate the quality, functionality, health literacy, readability, accessibility, and inclusivity of laryngology mobile applications.

METHODS

Of the 3230 apps identified from the Apple and Google Play stores, 28 patient-facing apps met inclusion criteria. Apps were evaluated using validated scales assessing quality and functionality: the Mobile App Rating Scale (MARS) and the Institute for Healthcare Informatics App Functionality Scale. The Clear Communication Index (CDC) Institute of Medicine Strategies for Creating Health Literate Mobile Applications, and Patient Education Materials Assessment Tool (PEMAT) were used to evaluate apps health literacy level. Readability was assessed using established readability formulas. Apps were evaluated for language, accessibility features, and representation of a diverse population.

RESULTS

Twenty-six apps (92%) had adequate quality (MARS score > 3). The mean PEMAT score was 89% for actionability and 86% for understandability. On average, apps utilized 25/33 health literate strategies. Twenty-two apps (79%) did not pass the CDC index threshold of 90% for health literacy. Twenty-four app descriptions (86%) were above an 8th grade reading level. Only 4 apps (14%) showed diverse representation, 3 (11%) had non-English language functions, and 2 (7%) offered subtitles. Inter-rater reliability for MARS was adequate (CA-ICC = 0.715).

CONCLUSION

While most apps scored well in quality and functionality, many laryngology apps did not meet standards for health literacy. Most apps were written at a reading level above the national average, lacked accessibility features, and did not represent diverse populations. Laryngoscope, 133:1540-1549, 2023.

Readability assessment of patient educational materials for pediatric spinal conditions from top academic orthopedic institutions

Background

The Internet has become a popular source of health information for patients and their families. Healthcare experts recommend that the readability of online education materials be at or below a sixth grade reading level. This translates to a standardized Flesch Reading Ease Score between 81 and 90, which is equivalent to conversational English. However, previous studies have demonstrated that the readability of online education materials of various orthopedic topics is too advanced for the average patient. To date, the readability of online education materials for pediatric spinal conditions has not been analyzed. The objective of this study was to assess the readability of online educational materials of top pediatric orthopedic hospital websites for pediatric spinal conditions.

Methods

Online patient education materials from the top 25 pediatric orthopedic institutions, as ranked by the U.S. News and World Report hospitals for pediatric orthopedics, were assessed utilizing multiple readability assessment metrics including Flesch-Kincaid, Flesch Reading Ease, Gunning Fog Index, and others. Correlations between academic institutional ranking, geographic location, and the use of concomitant multimedia modalities with Flesch-Kincaid scores were evaluated using a Spearman regression.

Results

Only 32% (8 of 25) of top pediatric orthopedic hospitals provided online health information at or below a sixth grade reading level. The mean Flesch-Kincaid score was 9.3 ± 2.5, Flesch Reading Ease 48.3 ± 16.2, Gunning Fog Score 10.7 ± 3.0, Coleman-Liau Index 12.1 ± 2.8, Simple Measure of the Gobbledygook Index 11.7 ± 2.1, Automated Readability Index 9.0 ± 2.7, FORCAST 11.3 ± 1.2, and Dale-Chall Readability Index 6.7 ± 1.4. There was no significant correlation between institutional ranking, geographic location, or use of video material with Flesch-Kincaid scores (p = 0.1042, p = 0.7776, p = 0.3275, respectively).

Conclusion

Online educational material for pediatric spinal conditions from top pediatric orthopedic institutional websites is associated with excessively complex language which may limit comprehension for the majority of the US population.

Type of study/Level of evidence

Economic and Decision Analysis/level III.

Evaluation of the usability, content, readability and cultural appropriateness of online alcohol and other drugs resources for Aboriginal and Torres Strait Islander Peoples in New South Wales, Australia

OBJECTIVES

This study aimed to analyse the usability, content, readability and cultural appropriateness of alcohol and other drugs (AODs) resources for Aboriginal and Torres Strait Islander Peoples in New South Wales (NSW), Australia.

OUTCOME MEASURES

The content of 30 AOD resources for Aboriginal and Torres Strait Islander Peoples was analysed according to the following criteria: general characteristics; elements of graphical design and written communication; thoroughness and content; readability (Flesch-Kincaid grade level (FKGL), Gunning Fog index (Fog), Simplified Measure of Gobbledygook and Flesch Reading Ease); and cultural appropriateness.

RESULTS

Most resources displayed good usability, depicted by the use of headings and subheadings (n=27), superior writing style (n=19), relevant visuals (n=19) and use of colour support (n=30). However, some resources used at least one professional jargon (n=13), and many did not provide any peer-reviewed references (n=22). During content analysis, 12 resources were categorised into the alcohol group and 18 resources in the other drugs group. Impact of alcohol during pregnancy and breast feeding (n=12) was the most common included topics in the resources related to alcohol, while the physical impact of drugs (n=15) was the most discussed topics among the other drugs group. Based on the FKGL readability score, 83% of resources met the recommended reading grade level of 6-8 by NSW Health. Many resources (n=21) met at least half of the cultural appropriateness elements of interest. However, less than one-third were developed in collaboration with the local community (n=9), used local terms (n=5), targeted the local community (n=3), included an Aboriginal voice (n=2) and addressed the underlying cause (n=1).

CONCLUSIONS

Many AOD resources are developed specifically for Aboriginal and Torres Strait Islander Peoples, but their usability, content and readability differed, and they were not culturally appropriate for all communities. Development of a standardised protocol for resource development is suggested.

Spanish-language bariatric surgery patient education materials fail to meet healthcare literacy standards of readability

BACKGROUND

The Hispanic population is the fastest growing ethnic minority in the United States, contributing to nearly half of the population growth over the last decade. Unfortunately, this population suffers from lower-than-average health literacy rates, leading to poorer health outcomes. Per the American Medical Association and National Institutes of Health, patient education materials (PEMs) should be written at no higher than a 6th grade reading level. Given that US Hispanic adults have the second-highest obesity prevalence, this study aims to analyze the readability of Spanish-language PEMs regarding bariatric surgery available in US-based academic and medical centers.

METHODS

A total of 50 PEMs were found via the query ""cirugía de pérdida de peso" site: (edu OR.org)" on the Google search engine. Thirty-nine sources met the inclusion criteria of belonging to a US-based academic or medical center and containing information regarding the indications for bariatric surgery, descriptions of the types of bariatric surgery, what to expect before and after surgery, or the risks and benefits of bariatric surgery. The excerpts were analyzed according to three readability formulas designed specifically for the Spanish language and evaluated for their reading grade level.

RESULTS

All 39 sources were at the college reading level per the Fry graph corrected for Spanish. Per the Spaulding formula, 37 sources were "Grade 12 + " and two sources were "Grade 8-10." Per the Fernandez-Huerta formula, 16 sources were at the 8th/9th grade reading level, 22 sources were at the 7th grade reading level, and one was at the 6th grade reading level.

CONCLUSION

The Spanish-language bariatric surgery PEMs available online from US-based academic and medical centers are generally above the recommended 6th grade reading level. Failure to meet the recommended sixth-grade reading level decreases health care literacy for Spanish-speaking patients within the United States seeking bariatric surgery.

Emerging social workers during COVID-19: Exploring perceived readiness and training needs

Summary methods and approach

Social workers support clients' psychosocial and resource needs across care settings. Social workers are typically not, however, trained to engage in emergency response practices such as the ones that may be necessary to support needs brought on by the COVID-19 pandemic. This article reports findings from a cross-sectional survey of social work students and recent graduates entering the field of social work during COVID-19, exploring their preparation, perceived readiness, and training needs.

Findings

The study sample (N  =  94) included 70 students and 24 recent graduates. The sample was 52% White, 22% Hispanic, and 21% Black/African American. Respondents reported training needs in the areas of trauma-informed care (70%), behavioral health (57%), culturally competent practice (49%), telehealth (48%), loss and grief (44%), and emergency management (43%). No significant differences emerged in self-efficacy ratings of students and recent graduates; both groups reported low self-efficacy in their ability to apply advanced practice skills. After controlling for demographics, receiving training specific to the COVID-19 pandemic (β  =  .271, p < .05), perceived readiness (β  =  .779, p < .001), and satisfaction with training/preparation (β  =  .4450, p < .001) significantly contribute to levels of perceived self-efficacy among SW students and recent graduates.

Applications

Social work curricular developments, and continuing education, are needed to prepare and support emerging social workers for practice in the context of COVID-19 and its long-term implications. This includes enhancing social workers' readiness to engage in telehealth, trauma-informed practice, emergency management, policy interpretation, self-care, and grief support.

The effect of refresher training on fact description in medical incident report writing in the Japanese language

To maintain the effectiveness of the training (1st-Training Session: 1st-TS) to accurate describe facts in the medical incident reports (IRs) in Japanese, a refresher TS was designed and its effectiveness was examined. First, textual analysis showed that IRs' accuracy significantly decreased six months after the 1st-TS. Based on this result, the refresher TS was designed and conducted with 64 residents. To verify the refresher TS' effectiveness, IRs after the 1st-TS, six months later, and after the refresher TS were compared via text analysis. The results showed that the refresher TS restored the description rate of patient's background, safety check procedures, original work procedures, information on equipment used, reporter's actions, and post-incident response. The questionnaire was also administered and showed that the refresher TS contributed to residents' motivation to learn about IRs. In conclusion, the refresher TS contributed to sustaining the effect of the 1st-TS on accurately describing IRs.

Evaluation of quality, readability, suitability, and usefulness of online resources available to cancer survivors

PURPOSE

The aim of this study was to evaluate the quality, readability, suitability, and usefulness of resources publicly available to adult cancer survivors (aged 18 +) who have completed primary treatment.

METHODS

Resources were identified in July 2021 through Google. Search completeness was verified using Yahoo, Bing, and MedlinePlus. Retrieved resources were assessed for quality using the DISCERN, readability, suitability using the Suitability Assessment Measure (SAM), and usefulness based on a list of unmet needs and self-management skills derived from the literature. Descriptive analyses were conducted, and a cluster analysis identified the highest-scoring resources.

RESULTS

Forty-five resources were included. The mean DISCERN score was fair at 63.3% (SD 13.7%) with low-rated items being sources, publication date, and risks and mechanisms of treatment. The mean reading grade level was 11.19 (SD 1.61, range 8-16) with only one resource scoring an 8. The mean SAM score was in the adequate range at 48.2% (SD 10.6%), with graphics being the lowest-rated section. On average, included resources addressed 57.7% (SD 27.3%) of the unmet needs and 48.4% (SD 20.9%) of the self-management skills, the least addressed being problem-solving.

CONCLUSION

Quality and suitability were fair, whereas readability exceeded recommended levels. Only one resource had a superior score in both quality and suitability.

IMPLICATIONS FOR CANCER SURVIVORS

The most pressing need is to develop resources for cancer survivors that address their unmet needs and are accessible in terms of literacy. Study findings outline the highest-scoring resources currently available to survivors, families, and clinicians.

Determination of the Readability Level of Consent Forms Used in the Gynecology and Obstetrics Clinic at Suleyman Demirel University

Background This study aimed to evaluate the readability level of consent forms used for interventional procedures in the obstetrics and gynecology clinic and to determine the readability of the texts according to the education level of the patient. Methodology This study determined the readability of patient consent forms used before interventional procedures in the gynecology and obstetrics clinic at the Suleyman Demirel University Hospital, Isparta. The consent forms were divided into two main groups according to their use in obstetrics and gynecology procedures. The readability level of consent forms was assessed using two readability formulas developed by Ateşman and Bezirci-Yılmaz, which determine the readability level of Turkish texts in the literature. Results When the consent forms were analyzed according to Atesman's readability formula, they were found to be readable with more than 15 years of education at the undergraduate level, while according to Bezirci-Yılmaz's readability formula, they were found to be readable with 17 years of education at the postgraduate level. Conclusions Easy-to-read consent forms will ensure that patients are more informed about interventional procedures and participate more effectively in the treatment process. There is a need to develop readable consent forms suitable for the general education level.

Patient Information Resources on Cardiovascular Health After Cancer Treatment: An Audit of Australian Resources

PURPOSE

Up to one third of patients with cancer are thought to experience adverse cardiovascular events after their cancer diagnosis and treatment. High-quality information about cancer treatment-related cardiovascular disease can prepare patients and reduce anxiety. The aim of this project was to systematically identify Australian online information resources about cardiovascular health after cancer and assess the readability, understandability, actionability, and cultural relevance for Aboriginal and Torres Strait Islander patients.

METHODS

We conducted systematic Google and website searches to identify potentially relevant resources. Eligibility was assessed using predefined criteria. For each eligible resource, we summarized the content and assessed readability, understandability, actionability, and cultural relevance for Aboriginal and Torres Strait Islander people.

RESULTS

Seventeen online resources addressing cardiovascular health after cancer were identified: three focused solely on cardiovascular health and the remaining 14 dedicated between <1% and 48% of the word count to this topic. On average, three of 12 predefined content areas were covered by the resources. Only one resource was considered comprehensive, covering eight of 12 content areas. Overall, 18% of the resources were deemed readable for the average Australian adult, 41% deemed understandable, and only 24% had moderate actionability. None of the resources were considered culturally relevant for Aboriginal and Torres Strait Islander people, with 41% addressing only one of the seven possible criteria and the remainder addressing none of the criteria.

CONCLUSION

This audit confirms a gap in online information resources about cardiovascular health after cancer. New resources, especially for Aboriginal and Torres Strait Islander people, are needed. The development of such resources must be done through involvement and collaboration with Aboriginal and Torres Strait Islander patients, families, and carers, through a codesign process.

Patient information about living donor kidney transplantation across UK renal units: A critical review

BACKGROUND

Patient information about living donor kidney transplantation is used to supplement conversations between health professionals, people with advanced kidney disease and potential kidney donors. It is not known if the information is designed to support decision-making about renal replacement options and if it helps people discuss living kidney donation with family and friends.

OBJECTIVE

Critical review of resources used in outpatient kidney consultations to support patients' decision-making about living kidney donor transplantation.

DESIGN

Mixed methods including an audit questionnaire and critical analysis of patient information leaflets.

PARTICIPANTS AND MEASUREMENTS

All kidney transplant centres and renal units in United Kingdom received a questionnaire to elicit by whom, how, and when information about living kidney donation is delivered. Copies of leaflets were requested. A coding frame was utilised to produce a quality score for each leaflet.

RESULTS

Thirty-nine (54%) units participated. Patients discussed living donor kidney transplantation with nephrologists (100%), living donor nurse (94%), transplant co-ordinator (94%), and predialysis nurse (86%). Twenty-three leaflets were provided and reviewed, mean quality scores for inclusion of information known to support shared decision-making was m = 2.82 out of 10 (range = 0-6, SD = 1.53). Readability scores indicated they were 'fairly difficult to read' (M = 56.3, range = 0-100, SD = 9.4). Few included cultural and faith information. Two leaflets were designed to facilitate conversations with others about donation.

CONCLUSIONS

Leaflets are unlikely to adequately support decision-making between options and discussions about donation. Services writing and updating patient leaflets may benefit from our six principles to guide their development.

Reducing the Use of Complex Words and Reducing Sentence Length to <15 Words Improves Readability of Patient Education Materials Regarding Sports Medicine Knee Injuries

Purpose

To develop a standardized method to improve readability of orthopaedic patient education materials (PEMs) without diluting their critical content by reducing the use of complex words (≥3 syllables) and shortening sentence length to ≤15 words.

Methods

OrthoInfo, a patient education website developed by the Academy of American Orthopedic Surgeons, was queried for PEMs relevant to the care of athletic injuries of the knee. Inclusion criteria were PEMs that were unique, pertained to topics of knee pathology in sports medicine, and written in a prose format. Exclusion criteria were information presented in video or slideshow format, or topics not pertaining to knee pathology in sports medicine. Readability of PEMs was evaluated using 7 unique readability formulas before and after applying a standardized method to improve readability while preserving critical content (reducing the use of ≥3 syllable words and ensuring sentence length is ≤15 words). Paired samples t-tests were conducted to assess the relationship between reading levels of the original PEMs and reading level of edited PEMs.

Results

Reading levels differed significantly between the 22 original PEMs and edited PEMs across all 7 readability formulas (P < .01). Mean Flesch Kincaid Grade Level of original PEMs (9.8 ± 1.4) was significantly increased compared to that of edited PEMs (6.4 ± 1.1) (P = 1.9 × 10^-13). 4.0% of original PEMs met National Institutes of Health recommendations of a sixth-grade reading level compared with 48.0% of modified PEMs.

Conclusions

A standardized method that reduces the use of ≥3 syllable words and ensures sentence length is ≤15 words significantly reduces the reading-grade level of PEMs for sports-related knee injuries. Orthopaedic organizations and institutions should apply this simple standardized method when creating PEMs to enhance health literacy.

Clinical Relevance

The readability of PEMs is important when communicating technical material to patients. While many studies have suggested strategies to improve the readability of PEMs, literature describing the benefit of these proposed changes is scarce. The information from this study details a simple standardized method to use when creating PEMs that may enhance health literacy and improve patient outcomes.

Readability of online monkeypox patient education materials: Improved recognition of health literacy is needed for dissemination of infectious disease information

BACKGROUND

Health literacy is key to navigating the current global epidemic of misinformation and inaccuracy relating to healthcare. The American Medical Association (AMA) suggests health information should be written at the level of American sixth grade. With the monkeypox outbreak being declared a Public Health Emergency of International Concern (PHEIC) in July 2022, we sought to assess the readability of online patient education materials (PEMs) relating to monkeypox to see if they are at the target level of readability.

METHODS

A search was conducted on Google.com using the search term 'Monkeypox'. The top 50 English language webpages with patient education materials (PEMs) relating to monkeypox were compiled and categorised by country of publication and URL domain. Readability was assessed using five readability tools: Flesch Reading Ease Score (FRES), Flesch-Kincaid Grade Level (FKGL), Gunning Fog Index (GFI), Coleman-Liau Index (CLI), and, Simple Measure of Gobbledygook Index (SMOG). Unpaired t-test for URL domain, and one-way ANOVA for country were performed to determine influence on readability.

RESULTS

Three of the five tools (FRES, GFI, CLI) identified no webpages that met the target readability score. The FKGL and SMOG tools identified one (2%) and two (4%) webpages respectively that met the target level. County and URL domain demonstrated no influence on readability.

CONCLUSION

Online PEMs relating to monkeypox are written above the recommended reading level. Based on the previously established effect of health literacy, this is likely exacerbating health inequalities. This study highlights the need for readability to be considered when publishing online PEMs.

How readable are orthognathic surgery consent forms?

BACKGROUND/OBJECTIVE

The valid consent process for medical intervention requires the disclosure of information in a format that is easily understandable by the patient. The aim of this investigation was to assess the readability of orthognathic surgery informed consent forms (OSICFs).

METHODS

An online search methodology was conducted to identify OSICFs for analysis. The forms that satisfied inclusion/exclusion criteria were evaluated according to a standardised protocol. The readability of the content was assessed using three validated tools: the Simple Measure of Gobbledegook (SMOG) score, Flesch-Kincaid Grade-Level (FKGL) score and Flesch Reading Ease (FRE) score.

RESULTS

Most of the 26 evaluated OSICFs were sourced from websites within the United States (69.2%) and from oral and maxillo-facial surgery practices (76.9%). Two of the assessed forms were template OSICFs available from oral and maxillo-facial professional societies to its members. The scores from the three tools found that the content of 84.6% to 92.3% of the forms were "difficult" to read. The mean (SD) SMOG score for all evaluated OSICFs was 12.31(2.22) [95% CI: 11.42 to 13.21]. The SMOG and FKGL scores were closely correlated (r=0.99, P < 0.0001; 95% CI: 0.9864 to 0.9973). There was no association between SMOG scores and the number of words contained within each consent form (r=-0.047;95% CI: -0.44 to 0.36).

CONCLUSIONS

The OSICFs surveyed in this investigation failed to meet recommended readability levels. A significant number of patients are not likely to understand the information contained within the forms. Orthodontists are advised that poor literacy skills of their patients may preclude them from validly consenting to orthognathic surgery treatment procedures.

Readability assessment of patient educational materials for pediatric spinal deformity from top academic orthopedic institutions

STUDY DESIGN

Cross-sectional analysis of patient educational materials from top pediatric orthopedic hospital websites.

OBJECTIVE

To assess the readability of online educational materials of top pediatric orthopedic hospital websites for pediatric spinal deformity. The internet has become an increasingly popular source of health information for patients and their families. Healthcare experts recommend that the readability of online education materials be at or below a 6th-grade reading level. However, previous studies have demonstrated that the readability of online education materials on various orthopedic topics is too advanced for the average patient. To date, the readability of online education materials for pediatric spinal deformity has not been analyzed.

METHODS

Online patient education materials from the top 25 pediatric orthopedic institutions, as ranked by the U.S. News and World Report hospitals for pediatric orthopedics, were accessed utilizing the following readability assessments: Flesch-Kincaid (FK), Flesch Reading Ease, Gunning Fog Index, Coleman-Liau Index, Simple Measure of the Gobbledygook Index (SMOG), Automated Readability Index, FORCAST, and the New Dale and Chall Readability. Correlations between academic institutional ranking, geographic location, and the use of concomitant multi-media modalities with FK scores were evaluated using a Spearman regression.

RESULTS

Only 48% (12 of 25) of top pediatric orthopedic hospitals provided online information regarding pediatric spinal deformity at or below a 6th-grade reading level. The mean FK score was 9.0 ± 2.7, Flesch Reading Ease 50.8 ± 15.6, Gunning Fog Score 10.6 ± 3.1, Coleman-Liau Index 11.6 ± 2.6, SMOG index 11.7 ± 2.0, Automated Readability Index 8.6 ± 2.8, and Dale-Chall Readability Score 6.4 ± 1.4. There was no significant correlation between institutional ranking, geographic location, or use of multimedia with FK scores.

CONCLUSION

Online educational material for pediatric spinal deformity from top pediatric orthopedic institutional websites are associated with poor readability.

Improving health literacy with mumps, measles and rubella (MMR) vaccination: comparison of the readability of MMR patient-facing literature and MMR scientific abstracts

Background:

Historically, there have been many factors that have influenced mumps, measles and rubella (MMR) vaccine uptake, including media bias, social/economic determinants, parental education level, deprivation and concerns over vaccine safety. Readability metrics through online tools are now emerging as a means for healthcare professionals to determine the readability of patient-facing vaccine information. The aim of this study was to examine the readability of patient-facing materials describing MMR vaccination, through employment of nine readability and text parameter metrics, and to compare these with MMR vaccination literature for healthcare professionals and scientific abstracts relating to MMR vaccination.

Materials and methods:

The subscription-based online Readable program (readable.com) was used to determine nine readability indices using various readability formulae: Established readability metrics (n = 5) (Flesch–Kinkaid Grade Level, Gunning Fog Index, SMOG Index, Flesch Reading Ease and New Dale-Chall Score), as well as Text parameters (n = 4) (sentence count, word count, number of words per sentence, number of syllables per word) with 47 MMR vaccination texts [patient-facing literature (n = 22); healthcare professional–focused literature (n = 8); scientific abstracts (n = 17)].

Results:

Patient-facing vaccination literature had a Flesch Reading Ease score of 58.4 and a Flesch–Kincaid Grade Level of 8.1, in comparison with poorer readability scores for healthcare professional literature of 30.7 and 12.6, respectively. MMR scientific abstracts had the poorest readability (24.0 and 14.8, respectively). Sentence structure was also considered, where better readability metrics were correlated with significantly lower number of words per sentence and less syllables per word.

Conclusion:

Use of these readability tools enables the author to ensure their research is more readable to the lay audience. Patient co-production initiatives would help to ensure that not only can the target audience read the literature, but that they understand the content. Increased patient-centric focus groups would give better insights into reasons for MMR-associated vaccine hesitation and vaccine refusal.

Academic and community hernia center websites in the United States fail to meet healthcare literacy standards of readability

BACKGROUND

Health literacy is considered the single best predictor of health status. Organizations including the American Medical Association (AMA) and the National Institutes of Health (NIH) have recommended that the readability of patient education materials not exceed the sixth-grade level. Our study focuses on the readability of self-designated hernia centers websites at both academic and community organizations across the United States to determine their ability to dispense patient information at an appropriate reading level.

METHODS

A search was conducted utilizing the Google search engine. The key words "Hernia Center" and "University Hernia Center" were used to identify links to surgical programs within the United States. The following readability tests were conducted via the program: Flesch-Kincaid Grade Level (FKGL), Gunning Fox Index (GFI), Coleman-Liau Index (CLI), Simple Measure of Gobbledygook (SMOG), and Flesch Reading Ease (FRE) score.

RESULTS

Of 96 websites, zero (0%) had fulfilled the recommended reading level in all four tests. The mean test scores for all non-academic centers (n = 50) were as follows: FKGL (11.14 ± 2.68), GFI (14.39 ± 3.07), CLI (9.29 ± 2.48) and SMOG (13.38 ± 2.03). The mean test scores [SK1] for all academic programs (n = 46) were as follows: FKGL (11.7 ± 2.66), GFI (15.01 ± 2.99), CLI (9.34 ± 1.91) and SMOG (13.71 ± 2.02). A one-sample t test was performed to compare the FKGL, GFI, CLI, and SMOG scores for each hernia center to a value of 6.9 (6.9 or less is considered an acceptable reading level) and a p value of 0.001 for all four tests were noted demonstrating statistical significance. The Academic and Community readability scores for both groups were compared to each other with a two-sample t test with a p value of > 0.05 for all four tests and there were no statistically significant differences.

CONCLUSION

Neither Academic nor Community hernia centers met the appropriate reading level of sixth-grade or less. Steps moving forward to improve patient comprehension and/or involving with their care should include appropriate reading level material, identification of a patient with a low literacy level with intervention or additional counseling when appropriate, and the addition of adjunct learning materials such as videos.

The popularity of contradictory information about COVID-19 vaccine on social media in China

To eliminate the impact of contradictory information on vaccine hesitancy on social media, this research developed a framework to compare the popularity of information expressing contradictory attitudes towards COVID-19 vaccine or vaccination, mine the similarities and differences among contradictory information's characteristics, and determine which factors influenced the popularity mostly. We called Sina Weibo API to collect data. Firstly, to extract multi-dimensional features from original tweets and quantify their popularity, content analysis, sentiment computing and k-medoids clustering were used. Statistical analysis showed that anti-vaccine tweets were more popular than pro-vaccine tweets, but not significant. Then, by visualizing the features' centrality and clustering in information-feature networks, we found that there were differences in text characteristics, information display dimension, topic, sentiment, readability, posters' characteristics of the original tweets expressing different attitudes. Finally, we employed regression models and SHapley Additive exPlanations to explore and explain the relationship between tweets' popularity and content and contextual features. Suggestions for adjusting the organizational strategy of contradictory information to control its popularity from different dimensions, such as poster's influence, activity and identity, tweets' topic, sentiment, readability were proposed, to reduce vaccine hesitancy.

Assessment of the readability and quality of online patient education materials for the medical treatment of open-angle glaucoma

Objective

Patient adherence to glaucoma medications is poor, and is linked to low literacy levels. Patients commonly use the internet to access health information, and it is recommended that patient information is written at an 11-year-old reading level. The aim of this study is to assess the readability and quality of online patient education materials for the medical management of open angle glaucoma.

Methods and analysis

The top 10 relevant Google searches for nine glaucoma medications (timolol, brimonidine, apraclonidine, dorzolamide, latanoprost, bimatoprost, travoprost, tafluprost and brinzolamide) and three generic searches were analysed for readability and accountability. Readability was assessed using Flesch Reading Ease Score (FRES), Flesch-Kincaid Grade Level (FKGL), Gunning Fog Index (GFI) and Simple Measure of Gobbledygook Index (SMOG). Webpages were classified by source and assessed using Journal of the American Medical Association (JAMA) benchmarks of accountability.

Results

111 articles were included in the analysis. Mean readability scores were: FRES 55.5 (95% CI 53.4 to 57.5); FKGL 9.7 (95% CI 9.3 to 10.0); GFI 12 (95% CI 11.6 to 12.4) and SMOG 9.3 (95% CI 8.9 to 9.6). One-way analysis of variance demonstrated no significant difference in readability score between source type. 9% of the webpages satisfied all 4 JAMA benchmarks. Pearson’s correlation coefficient showed a correlation between the FRES and accountability score (r=0.19, p=0.045).

Conclusion

The majority of online patient education materials for the medical treatment of glaucoma are written at a level too difficult for the general population and fail to meet accountability standards.

Quality and accuracy of patient-oriented Web-based information regarding tooth avulsion

BACKGROUND/AIM

Tooth avulsion (TA) is a severe form of traumatic dental injury. The tooth's prognosis depends on the immediate measures taken. First responders are often laypeople, and the Internet is a favored platform to access health-related information. The aim of this descriptive study was to evaluate the accuracy, quality, readability, and popularity of patient-oriented web information regarding the emergency management of TA.

METHODS

Three search engines (Google, Bing, and Yahoo.com) were browsed with six VPNs using "knocked out tooth," "fallen out tooth," and "tooth avulsion" as keywords. The top 20 results for each were evaluated. Webpages were included if they had information oriented to caregivers. They were analyzed for accuracy (cutoff ≥95%). Quality of web pages was assessed using DISCERN and the Journal of the American Medical Association (JAMA) benchmark. Readability was evaluated using Flesch-Kincaid Grade Level (FKGL), Gunning Fog (FOG), Coleman-Liau Index (CLI), and Simple Measure of Gobbledygook (SMOG). Popularity was assessed by Alexa Popularity Rank (APR). Accurate and inaccurate webpages were compared using chi-square analysis and the Mann-Whitney U test. Spearman's correlation between the studied metrics was established. A p < .05 was considered significant.

RESULTS

Seventy-two webpages were included, of which 23 (32%) were accurate. The median DISCERN ratings for accurate and inaccurate webpages were 3.0 [2.5-3.0] and 3.0 [2.0-3.0], respectively (p = .331). Ten (44%) accurate and 12 (24.5%) inaccurate webpages had high-quality JAMA (p = .089). The median readability scores for accurate webpages were FKGL (8 [6.75-9.2]), FOG (10.6 [9.55-12.3]), CLI (7 [6-7]), SMOG (6.7 [6.15-7.5]), while scores for the inaccurate webpages were FKGL (7.85 [6.275-8.525]), FOG (10.55 [8.875-11.425]), CLI (7 [7-8.25]), and SMOG (7 [6.2-7.925]), with a higher CLI score for inaccurate webpages (p = .0035). The median APRs for accurate and inaccurate webpages were 1,02,538 [26,852-14,43,755] and 7,63,190 [2,19,799-29,92,067], respectively (p = .163). Accuracy had a positive correlation with quality (DISCERN: rho = .293, p = .013; JAMA: rho = .249, p = .036), while popularity (APR) was negatively correlated with quality (DISCERN: rho = -.330, p = .013; JAMA: rho = -.287, p = .032).

CONCLUSION

Relevant webpages were limited and had low accuracy. This can impact the emergency management by laypeople and adversely affect the prognosis following avulsion.

Development and validation of the trust in my doctor, trust in doctors in general, and trust in the health care team scales

RATIONALE

Historic and present-day racism and inequity in the United States (U.S.) have resulted in diminished trust in health care among many populations. A key barrier to improving trust in health care is a dearth of well-validated measures appropriate for diverse populations. Indeed, systematic reviews indicate a need to develop and test updated trust measures that are multidimensional and inclusive of relevant domains (e.g., fairness).

OBJECTIVE

We developed three trust measures: the Trust in My Doctor (T-MD), Trust in Doctors in General (T-DiG), and Trust in the Health Care Team (T-HCT) scales.

METHODS

After developing an initial item pool, expert reviewers (n = 6) provided feedback on the face validity of each scale. We conducted cognitive interviews (n = 21) with a convenience sample of adults to ensure items were interpreted as intended. In 2020, we administered an online survey to a convenience sample of U.S. adults recruited through the Qualtrics Panel (n = 801) to assess scale reliability and validity.

RESULTS

Exploratory and confirmatory factor analyses indicated acceptable model fit for second order latent factor models for each scale (root mean square error of approximation: <0.07, comparative fit index: ≥0.98, and standardized root mean square residual: ≤0.03). The T-MD contained 25 items and six subscales: communication competency, fidelity, systems trust, confidentiality, fairness, and global trust. The T-DiG and T-HCT each contained 29 items and seven subscales (the same subscales in the T-MD plus an additional subscale related to stigma-based discrimination). Each scale was strongly correlated with existing trust measures and perceived racism in health care and was significantly associated with delayed health care seeking and receipt of a routine health exam.

CONCLUSIONS

The multidimensional T-MD, T-DiG, and T-HCT scales have sound psychometric properties and may be useful for researchers evaluating trust-related interventions or conducting studies where trust is an important construct or main outcome.

Communicating With Diverse Patients About Participating in a Biobank: A Randomized Multisite Study Comparing Electronic and Face-to-Face Informed Consent Processes

Some individuals' understanding of informed consent (IC) information may improve with electronic delivery, but others may benefit from face-to-face (F2F). This randomized, multisite study explores how individuals from diverse backgrounds understand electronic IC documents versus F2F, their confidence in understanding, and enrollment in research. A total of 501 patients at two U.S. biobanks with diverse populations participated. There were no overall differences between electronic and F2F understanding, but F2F predicted higher confidence in understanding and enrollment. Ethnicity and a higher educational level predicted higher understanding and confidence. Study findings suggest that electronic consent may lead to better understanding for non-Hispanic patients of higher socioeconomic status. F2F processes may lead to better understanding and higher enrollment of patients from Hispanic and lower socioeconomic levels. Researchers should carefully consider how they implement electronic IC processes and whether to maintain an F2F process to better address the needs and limitations of some populations.