Febrile seizure: What information can caregivers access through YouTube?

Assessing the performance of ChatGPT's responses to questions related to epilepsy: A cross-sectional study on natural language processing and medical information retrieval

BACKGROUND

Epilepsy is a neurological condition marked by frequent seizures and various cognitive and psychological effects. Reliable information is essential for effective treatment. Natural language processing models like ChatGPT are increasingly used in healthcare for information access and data analysis, making it crucial to assess their accuracy.

OBJECTIVE

This study aimed to investigate the accuracy of ChatGPT in providing educational information related to epilepsy.

METHODS

We compared the answers from ChatGPT-4 and ChatGPT-3.5 to 57 common epilepsy questions based on the Korean Epilepsy Society's "Epilepsy Patient and Caregiver Guide." Two epileptologists reviewed the responses, with a third serving as an arbiter in cases of disagreement.

RESULTS

Out of 57 questions, 40 responses from ChatGPT-4 had "sufficient educational value," 16 were "correct but inadequate," and one was "mixed with correct and incorrect" information. No answers were entirely incorrect. GPT-4 generally outperformed GPT-3.5 and was often on par with or better than the official guide.

CONCLUSIONS

ChatGPT-4 shows promise as a tool for delivering reliable epilepsy-related information and could help alleviate the educational burden on healthcare professionals. Further research is needed to explore the benefits and limitations of using such models in medical contexts.

Evaluation of YOUTUBE videos on complementary feeding: Content quality and reliability analysis

YouTube is an online platform that parents frequently use to access information on child health. Parents' watching YouTube videos to have information on complementary feeding requires evaluation of the videos regarding child health. This study which was conducted in descriptive design, aimed to analyze YouTube videos' content quality and reliability on complementary feeding. Searched by matching keywords "starting", "beginning", "introducing", "solid food", and "complementary feeding" through boolean operators in the English language on YouTube, on August 2022. The search identified 528 videos related to complementary feeding. Two independent researchers analyzed the content of 61 videos that met the inclusion criteria. The content quality of the videos was evaluated using the Checklist for Complementary Feeding (CCF), which was prepared by researchers in line with international guidelines, the reliability of the videos was analyzed using the DISCERN, and the content quality was evaluated using the Global Quality Score (GQS). Of the 61 videos included, 38 (62.3%) were informative, and 23 (37.7%) were misleading. The kappa value among independent observers was 0.96. The mean GQS, DISCERN, and CCF scores of the videos grouped as informative were significantly higher than the videos grouped as misleading (p = 0.000, p = 0.000, p = 0.000, respectively). There was a significant difference between the mean scores of GQS and DISCERN according to the publication source of the videos (p = 0.033 and p = 0.023, respectively). The GQS and DISCERN mean scores of the Ministrial/Academic/Hospital/Healthcare Institution channel videos were higher than the mean scores of the Individual/Parents content channel videos. Videos on YouTube about complementary feeding have high viewing rates, but also videos that are low in terms of quality and reliability.

Takotsubo syndrome on TikTok: An analysis of information quality and audience engagement (Preprint)

Background

The incidence of Takotsubo syndrome (TTS), also known as the broken heart syndrome or stress cardiomyopathy, is increasing worldwide. The understanding of its prognosis has been progressively evolving and currently appears to be poorer than previously thought, which has attracted the attention of researchers. An attempt to recognize the awareness of this condition among the general population drove us to analyze the dissemination of this topic on TikTok, a popular short-video–based social media platform. We found a considerable number of videos on TTS on TikTok; however, the quality of the presented information remains unknown.

Objective

The aim of this study was to analyze the quality and audience engagement of TTS-related videos on TikTok.

Methods

Videos on the TikTok platform were explored on August 2, 2021 to identify those related to TTS by using 6 Chinese keywords. A total of 2549 videos were found, of which 80 met our inclusion criteria and were evaluated for their characteristics, content, quality, and reliability. The quality and reliability were rated using the DISCERN instrument and the Journal of the American Medical Association (JAMA) criteria by 2 reviewers independently, and a score was assigned. Descriptive statistics were generated, and the Kruskal-Wallis test was used for statistical analysis. Multiple linear regression was performed to evaluate the association between audience engagement and other factors such as video content, video quality, and author types.

Results

The scores assigned to the selected video content were low with regard to the diagnosis (0.66/2) and management (0.34/2) of TTS. The evaluated videos were found to have an average score of 36.93 out of 80 on the DISCERN instrument and 1.51 out of 4 per the JAMA criteria. None of the evaluated videos met all the JAMA criteria. The quality of the relayed information varied by source (All P<.05). TTS-related videos made by health care professionals accounted for 28% (22/80) of all the evaluated videos and had the highest DISCERN scores with an average of 40.59 out of 80. Multiple linear regression analysis showed that author types that identified as health professionals (exponentiated regression coefficient 17.48, 95% CI 2.29-133.52; P=.006) and individual science communicators (exponentiated regression coefficient 13.38, 95% CI 1.83-97.88; P=.01) were significant and independent determinants of audience engagement (in terms of the number of likes). Other author types of videos, video content, and DISCERN document scores were not associated with higher likes.

Conclusions

We found that the quality of videos regarding TTS for patient education on TikTok is poor. Patients should be cautious about health-related information on TikTok. The formulation of a measure for video quality review is necessary, especially when the purpose of the published content is to educate and increase awareness on a health-related topic.

Amyotrophic lateral sclerosis in social media: Content analysis of YouTube videos

The purpose of this study is to analyze the characteristics, content, and quality of information available on YouTube regarding amyotrophic lateral sclerosis (ALS), and explore the search results and number of views and quality of the videos. A search was performed on YouTube on 10 June 2020, using the search term ''Lou Gehrig's disease" in the Korean language, and the first 100 videos were targeted for analysis. General characteristics (e.g., number of views, video length, etc.) were collected, and upload source, target audience, subject of the video, and quality of the videos using a global quality score (GQS) were assessed. About two-thirds of the videos were for the general public (62.0%), while the other third were made for patients and their families with ALS (38.0%). The mean GQS was 3.70 ± 1.42, and 60 videos were classified as high-quality videos. ALS-related videos on YouTube play a role in raising awareness among the general public of this devastating disease, however, practical information regarding disease management for patients and family is relatively insufficient. The quality and characteristics of the videos varied greatly and sometimes the lowest quality videos were shown in the top pages of search results.