Transjugular intrahepatic portosystemic shunt (TIPS) procedure: an assessment of the quality and readability of online information

Evaluation of the reliability and readability of ChatGPT-4 responses regarding hypothyroidism during pregnancy

Hypothyroidism is characterized by thyroid hormone deficiency and has adverse effects on both pregnancy and fetal health. Chat Generative Pre-trained Transformer (ChatGPT) is a large language model trained with a very large database from many sources. Our study was aimed to evaluate the reliability and readability of ChatGPT-4 answers about hypothyroidism in pregnancy. A total of 19 questions were created in line with the recommendations in the latest guideline of the American Thyroid Association (ATA) on hypothyroidism in pregnancy and were asked to ChatGPT-4. The reliability and quality of the responses were scored by two independent researchers using the global quality scale (GQS) and modified DISCERN tools. The readability of ChatGPT was assessed used Flesch Reading Ease (FRE) Score, Flesch-Kincaid grade level (FKGL), Gunning Fog Index (GFI), Coleman-Liau Index (CLI), and Simple Measure of Gobbledygook (SMOG) tools. No misleading information was found in any of the answers. The mean mDISCERN score of the responses was 30.26 ± 3.14; the median GQS score was 4 (2-4). In terms of reliability, most of the answers showed moderate (78.9%) followed by good (21.1%) reliability. In the readability analysis, the median FRE was 32.20 (13.00-37.10). The years of education required to read the answers were mostly found at the university level [9 (47.3%)]. Although ChatGPT-4 has significant potential, it can be used as an auxiliary information source for counseling by creating a bridge between patients and clinicians about hypothyroidism in pregnancy. Efforts should be made to improve the reliability and readability of ChatGPT.

Evaluating the Reliability of YouTube as a Source of Information for Meniscal Ramp Lesions

Background

Videos uploaded to YouTube do not go through a review process, and therefore, videos related to medial meniscal ramp lesions may have little educational value.

Purpose

To assess the educational quality of YouTube videos regarding ramp lesions of the meniscus.

Study Design

Cross-sectional study.

Methods

A standard search was performed on the YouTube website using the following terms: "ramp lesion" and "posterior meniscal detachment" and "ramp" and "meniscocapsular" and "meniscotibial detachment," and the top 100 videos based on the number of views were included for analysis. The video duration, publication data, and number of likes and views were retrieved, and the videos were categorized based on video source (health professionals, orthopaedic company, private user), the type of information (anatomy, biomechanics, clinical examination, overview, radiologic, surgical technique), and video content (education, patient support, patient experience/testimony).The content analysis of the information on the videos was evaluated with the use of the DISCERN instrument (score range, 16-80), the Journal of the American Medical Association (JAMA) benchmark criteria (score range, 0-4), and the Global Quality Score (GQS; score range, 1-5).

Results

A total of 74 videos were included. Of these videos, 70 (94.6%) were published by health professionals, while the remaining 4 (5.4%) were published by orthopaedic companies. Most of the videos were about surgical technique (n = 36; 48.6%) and all had an educational aim (n = 74; 100%). The mean length of the videos was 10.35 ± 17.65 minutes, and the mean online period was 18.64 ± 13.85 months. The mean DISCERN score, JAMA benchmark score, and GQS were 31.84 ± 17.14 (range, 16-72), 1.65 ± 0.87 (range, 1-4), and 2.04 ± 1.21 (range, 1-5), respectively. Videos that reported an overview about ramp lesions were the best in terms of quality for DISCERN and JAMA benchmark score, while biomechanics videos were the best according to GQS. The worst category of videos was about surgical technique, with all having lower scores.

Conclusion

The educational content of YouTube regarding medial meniscal ramp lesions showed low quality and validity based on DISCERN score, JAMA benchmark score, and GQS.

Online Patient Education Resources for Anterior Cruciate Ligament Reconstruction: An Assessment of the Accuracy and Reliability of Information on the Internet Over the Past Decade

PURPOSE

The purpose of this study is to evaluate the quality of patient education materials accessible through popular online search engines regarding anterior cruciate ligament (ACL) injuries and anterior cruciate ligament reconstruction (ACLR).  Methods: Two search terms ("ACL surgery" and "ACL reconstruction") were entered into three search engines (Google, Yahoo, and Bing). The quality of information was scored using a novel scoring system developed and overseen by sports medicine orthopedic clinical research fellows and fellowship-trained orthopedic surgeons. Website quality, credibility, and readability were further assessed by the DISCERN score, Journal of the American Medical Association (JAMA) benchmark criteria, and Flesch-Kincaid Reading Grade Level (FKRGL), respectively. The Health On the Net Code of Conduct (HONcode) certification was also utilized to assess the transparency of health information for each website.

RESULTS

We evaluated 39 websites. The average score for all websites was 11.2±5.6 out of 28 total points. Six out of the 39 websites (41%) were HONcode certified. The websites that contained HONcode certification had a higher average JAMA benchmark score (3.5±0.7) and DISCERN score (44.6±14.7) when compared to the websites without the certification, 2.2±1.2 and 37.6 ± 15.9 for JAMA and DISCERN, respectively. The mean JAMA benchmark score was 2.7±1.2 (67.5%) for all websites out of a possible four points. The average FKRGL for all 39 websites was 10.0±2.0 (range: 5.4-13).

CONCLUSION

The quality of patient education materials accessible on the internet regarding ACL injuries and ACLR can be misleading and directly impact the patient's decision-making process essential to the patient-physician relationship over the past decade.

CLINICAL RELEVANCE

The internet can be a helpful online resource, however, surgeon clarification and consultation with qualified healthcare professionals are strongly recommended prior to clinical decision-making regarding potential treatment options.

Online Patient Education Materials on Iron Deficiency Anemia Are Too Difficult to Read and Low Quality: A Readability and Quality Analysis

Introduction Patients increasingly rely on online health information to understand and manage their diseases. Concerns about the quality and readability of these materials have been reported in the literature. Poor quality and difficult-to-read information lead to delayed diagnoses and adverse outcomes. We assessed the quality and readability of online health information about iron deficiency anemia (IDA) on Google. Method We searched for online web pages using the term "iron deficiency anemia"on Google. One hundred and twelve out of 200 web pages were included. We assessed web page typology, readability, the Journal of the American Medical Association (JAMA) score, the DISCERN score, and the Health on the Net Foundation certification (HONcode). Statistical analysis was performed with R version 4.2.2. Result Non-profit and scientific journal web pages were the most common. Scientific journal web pages were of the highest quality. News web pages were the most readable. The first Google Page web pages did not have greater JAMA scores or lower Flesch-Kinkaid Reading Grade Level (FKGL) and Simple Measure of Gobbledygook (SMOG) scores. Forty-six percent of all web pages were high-quality. Web pages on the first Google page were more likely to have HONCode certification. Conclusion We highlight gaps in the readability and quality of online information about IDA. Online web pages exceeded the recommended reading level for patients. Most web pages were low quality; only a quarter were HONcode-certified; and the first Google page web pages were not higher in quality than the later web pages on search.

Quality and readability of online information on plantar fasciitis and calcaneal spur

Plantar fasciitis and calcaneal spur are common causes of heel pain in the community. People use the Internet to obtain medical information about diseases. We reviewed Internet information sources on plantar fasciitis and calcaneal spur for quality and readability. The first 50 websites for each search term ("calcaneal spur", "heel spur", and "plantar fasciitis") were scanned on www.google.com . Six different valid tools were used for information quality and readability assessment. We searched for HONCode (Health On the Net Foundation Code) stamps on included websites. The total mean points for DISCERN were 50.52 ± 14.62, and the total mean points for JAMA (Journal of the American Medical Association) were 2.42 ± 1.26. In total, 25.72% of 97 websites had HONCode stamps. The average scores for the readability indicators were calculated to be Flesch-Kincaid Grade Level (FKGL): 7.27 ± 1.71, Gunning Fog: 8.46 ± 2.17, Simple Measure of Gobbledygook (SMOG): 6.89 ± 1.24, and Coleman Liau Index: 15.56 ± 1.85. In our study, when the website resources were examined, there were profit websites the most and website quality and readability were moderate level. A significant proportion of the websites have a financial bias and provide low-quality information. A mechanism for monitoring the quality and readability of online information must be established and managed systematically.

YouTube as a platform for knowledge and awareness of peritoneal dialysis: A content analysis

BACKGROUND

One of the main barriers to choosing peritoneal dialysis (PD) is the lack of awareness and PD knowledge. There is an increasing trend in the use of the internet as a search tool for health-related information. This study aims to determine how useful YouTube videos are to get information about PD.

METHODS

YouTube videos were evaluated independently by two nephrologists. The videos' quality was assessed with DISCERN scoring system, global quality score (GQS) and the Journal of the American Medical Association (JAMA) scoring system. We determined the quartile (Q) of the videos as follows: most reliable top 25% videos Q1 and others Q2-4.

RESULTS

A total of 295 videos were evaluated. University or society-sourced videos made up 15% (n = 43) of all videos, and healthcare providers were the primary target audience compared to patients (p < 0.001). JAMA, GQS and DISCERN scores were significantly higher for the videos that were targeted healthcare providers compared to the patients (p < 0.001, for all). A total of 34% of the videos in Q1 were obtained from the university or society. Nevertheless, only 17% of the videos prepared for the patients were among the Q1. A small number of videos mentioned that PD maintains the residual kidney function (RKF) longer compared to haemodialysis.

CONCLUSIONS

Universities and societies should upload videos to provide easy-to-understand information on PD. Also, the important benefits of PD, like the preservation of RKF, should be further highlighted in these videos. It may increase the PD penetrance by increasing patients' awareness.