Patients' Use of the Internet to Find Reliable Medical Information About Minor Ailments: Vignette-Based Experimental Study

Is Information About Musculoskeletal Malignancies From Large Language Models or Web Resources at a Suitable Reading Level for Patients?

BACKGROUND

Patients and caregivers may experience immense distress when receiving the diagnosis of a primary musculoskeletal malignancy and subsequently turn to internet resources for more information. It is not clear whether these resources, including Google and ChatGPT, offer patients information that is readable, a measure of how easy text is to understand. Since many patients turn to Google and artificial intelligence resources for healthcare information, we thought it was important to ascertain whether the information they find is readable and easy to understand. The objective of this study was to compare readability of Google search results and ChatGPT answers to frequently asked questions and assess whether these sources meet NIH recommendations for readability.

QUESTIONS/PURPOSES

(1) What is the readability of ChatGPT-3.5 as a source of patient information for the three most common primary bone malignancies compared with top online resources from Google search? (2) Do ChatGPT-3.5 responses and online resources meet NIH readability guidelines for patient education materials?

METHODS

This was a cross-sectional analysis of the 12 most common online questions about osteosarcoma, chondrosarcoma, and Ewing sarcoma. To be consistent with other studies of similar design that utilized national society frequently asked questions lists, questions were selected from the American Cancer Society and categorized based on content, including diagnosis, treatment, and recovery and prognosis. Google was queried using all 36 questions, and top responses were recorded. Author types, such as hospital systems, national health organizations, or independent researchers, were recorded. ChatGPT-3.5 was provided each question in independent queries without further prompting. Responses were assessed with validated reading indices to determine readability by grade level. An independent t-test was performed with significance set at p < 0.05.

RESULTS

Google (n = 36) and ChatGPT-3.5 (n = 36) answers were recorded, 12 for each of the three cancer types. Reading grade levels based on mean readability scores were 11.0 ± 2.9 and 16.1 ± 3.6, respectively. This corresponds to the eleventh grade reading level for Google and a fourth-year undergraduate student level for ChatGPT-3.5. Google answers were more readable across all individual indices, without differences in word count. No difference in readability was present across author type, question category, or cancer type. Of 72 total responses across both search modalities, none met NIH readability criteria at the sixth-grade level.

CONCLUSION

Google material was presented at a high school reading level, whereas ChatGPT-3.5 was at an undergraduate reading level. The readability of both resources was inadequate based on NIH recommendations. Improving readability is crucial for better patient understanding during cancer treatment. Physicians should assess patients' needs, offer them tailored materials, and guide them to reliable resources to prevent reliance on online information that is hard to understand.

LEVEL OF EVIDENCE

Level III, prognostic study.

Conceptualizing Patient as an Organization With the Adoption of Digital Health

The concept of viewing a patient as an organization within the context of digital healthcare is an innovative and evolving concept. Traditionally, the patient-doctor relationship has been centered around the individual patient and their interactions with healthcare providers. However, with the advent of technology and digital healthcare solutions, the dynamics of this relationship are changing. Digital healthcare platforms and technologies enable patients to have more control and active participation in managing their health and healthcare processes. This shift empowers patients to take on a more proactive role, similar to how an organization functions with various stakeholders, goals, and strategies. The prevalence of mobile phones and wearables is regarded as an important factor in the acceptance of digital health.

Objective

This study aimed to identify the factors affecting adoption intention using the TAM (Technology Acceptance Model), HB (Health Belief model), and the UTAUT (Unified Theory of Acceptance and Use of Technology). The argument is made that the adoption of the technology enables patients to create resources (ie, data), transforming patients from mere consumers to producers as well.

Results

PLS analysis showed that health beliefs and perceived ease of use had positive effects on the perceived usefulness of digital healthcare, and system capabilities positively impacted perceived ease of use. Furthermore, perceived service, the customer's willingness to change and reference group influence significantly impacted adoption intention (b > 0.1, t > 1.96, P < .05). However, privacy protection and data security, online healthcare resources, and user guidance were not positively associated with perceived usefulness.

Conclusions

Perceived usefulness, the customer's willingness to change, and the influence of the reference group are decisive variables affecting adoption intention among the general population, whereas privacy protection and data security are indecisive variables. Online resources and user guides do not support adoption intentions.

Evaluating the reliability and quality of YouTube videos regarding medial collateral ligament knee injury as a patient education resource

OBJECTIVES

The purpose of this study was to assess the educational reliability and quality of videos shared on YouTube regarding medial collateral ligament (MCL) injuries of the knee.

METHODS

Using the search keywords "medial collateral ligament" on YouTube, the first 50 videos were evaluated by two independent reviewers. Video characteristics were extracted, and each video was categorized by upload source and content type. Three scoring systems were used to evaluate the videos: the Journal of the American Medical Association (JAMA) Benchmark Score to assess a video's reliability; the Global Quality Score (GQS) to assess educational quality; the novel MCL Specific Score (MCL-SS) to assess MCL-specific content quality. Linear regression analyses were conducted to explore relationships between video characteristics and scores.

RESULTS

Collectively, the videos were viewed 5,759,427 times with a mean number of views per video of 115,189 ​± ​177,861. The mean JAMA score was 1.8, GQS was 2.1, and MCL-SS was 5.6, indicating both poor reliability and quality. Only videos uploaded by physicians showed a statistically significantly higher mean MCL-SS (P ​= ​0.032) but were still of low quality with a mean MCL-SS of 9.2 ​± ​5.9. Multivariate linear regression revealed that videos uploaded by physicians were statistically significant predictors of greater MCL-SS (β ​= ​4.108; P ​= ​0.029). Longer video durations were statistically significant predictors of greater GQS (β ​= ​0.001; P ​= ​0.002) and MCL-SS (β ​= ​0.007; P ​< ​0.001).

CONCLUSIONS

YouTube videos regarding MCL injuries, despite their popularity, were found to be on average having poor overall reliability and quality as measured by JAMA, GQS and MCL-SS.

LEVEL OF EVIDENCE

III.

STUDY DESIGN

Cross-sectional Study.

Evaluation of Oropharyngeal Cancer Information from Revolutionary Artificial Intelligence Chatbot

OBJECTIVE

With burgeoning popularity of artificial intelligence-based chatbots, oropharyngeal cancer patients now have access to a novel source of medical information. Because chatbot information is not reviewed by experts, we sought to evaluate an artificial intelligence-based chatbot's oropharyngeal cancer-related information for accuracy.

METHODS

Fifteen oropharyngeal cancer-related questions were developed and input into ChatGPT version 3.5. Four physician-graders independently assessed accuracy, comprehensiveness, and similarity to a physician response using 5-point Likert scales. Responses graded lower than three were then critiqued by physician-graders. Critiques were analyzed using inductive thematic analysis. Readability of responses was assessed using Flesch Reading Ease (FRE) and Flesch-Kincaid Reading Grade Level (FKRGL) scales.

RESULTS

Average accuracy, comprehensiveness, and similarity to a physician response scores were 3.88 (SD = 0.99), 3.80 (SD = 1.14), and 3.67 (SD = 1.08), respectively. Posttreatment-related questions were most accurate, comprehensive, and similar to a physician response, followed by treatment-related, then diagnosis-related questions. Posttreatment-related questions scored significantly higher than diagnosis-related questions in all three domains (p < 0.01). Two themes of the physician critiques were identified: suboptimal education value and potential to misinform patients. The mean FRE and FKRGL scores both indicated greater than an 11th grade readability level-higher than the 6th grade level recommended for patients.

CONCLUSION

ChatGPT responses may not educate patients to an appropriate degree, could outright misinform them, and read at a more difficult grade level than is recommended for patient material. As oropharyngeal cancer patients represent a vulnerable population facing complex, life-altering diagnoses, and treatments, they should be cautious when consuming chatbot-generated medical information.

LEVEL OF EVIDENCE

NA Laryngoscope, 134:2252-2257, 2024.

Critical review of self-diagnosis of mental health conditions using artificial intelligence

The advent of artificial intelligence (AI) has revolutionised various aspects of our lives, including mental health nursing. AI-driven tools and applications have provided a convenient and accessible means for individuals to assess their mental well-being within the confines of their homes. Nonetheless, the widespread trend of self-diagnosing mental health conditions through AI poses considerable risks. This review article examines the perils associated with relying on AI for self-diagnosis in mental health, highlighting the constraints and possible adverse outcomes that can arise from such practices. It delves into the ethical, psychological, and social implications, underscoring the vital role of mental health professionals, including psychologists, psychiatrists, and nursing specialists, in providing professional assistance and guidance. This article aims to highlight the importance of seeking professional assistance and guidance in addressing mental health concerns, especially in the era of AI-driven self-diagnosis.

The landscape of self-care in Australia: A pharmacy perspective

The evolving landscape of self-care in Australia underscores the imperative of recognizing and integrating the crucial role of pharmacists in promoting greater levels of self-care. Although the social and economic justifications for self-care are acknowledged internationally and in the literature, there is very little policy recognition in relation to self-care specifically in Australian health policy. Additionally, the distinct contributions of pharmacies to self-care, i.e., their experiences and accessibility in primary health care, are not consistently highlighted. Community pharmacies in Australia are currently navigating a transformative shift, expanding their scope of practice to deliver highly individualized care, with a special emphasis on the implementation of professional services crucial for the sector's enduring viability. Although pharmacists already play a substantial role in supporting self-care, there exists a compelling demand for a systematic and structured approach. Despite the limited availability of theoretical frameworks or models for pharmacists in self-care support within the existing literature, tangible practical evidence attests to the success of interventions. In an era where patients increasingly assume responsibility for self-managing conditions, the pharmacist's role in facilitating self-care and judicious self-medication is pivotal, promising not only tangible benefits for individuals but also contributing significantly to the long-term sustainability of the healthcare system in Australia. This necessitates a strategic and comprehensive framework that positions pharmacists as essential catalysts in the broader landscape of healthcare, ensuring their contributions are optimally leveraged to enhance patient outcomes and system efficiency.

Online health information-seeking behaviours for low back pain in the United Kingdom: analysis of data from Google trends and the Global Burden of Disease Study, 2004-2019

BACKGROUND

Low back pain (LBP) is a leading cause of global disability. Timely health-seeking is crucial for early diagnosis and management of pathologies. Despite increases in internet usage, there is sparse literature regarding online health information-seeking behaviours (OHISBs) for LBP and how they correlate with the LBP disease burden in the UK.

METHODS

To examine OHISB trends, we conducted Prais-Winsten analyses on monthly search volume data from Google Trends in the UK between 1 January 2004 and 1 December 2019. Cross-correlation analyses assessed the relationship between annual LBP search volume and LBP morbidity and mortality data from the Global Burden of Disease study (2004-2019).

RESULTS

From 2004 to 2019, the trend in LBP search volume was curvilinear (β=1.27, t=5.00, p<0.001), with a slope change around the end of 2006. There was a negative linear trend (β=-0.25, t35=-1.52, p<0.14) from 2004 to 2006 and a positive linear trend (β=0.67, t108=9.17, p<0.001) from 2007 to 2019. Cross-correlations revealed positive associations between search volume and disease burden indicators for LBP such as prevalence and incidence at lags 4 and 5.

CONCLUSIONS

A rising trend in OHISBs for LBP was noted between 2004 and 2019. This trend positively correlates with incidence, prevalence and burden measures. These findings emphasise the importance of high-quality online resources to increase awareness around LBP, facilitating early diagnosis and management.

Popular large language model chatbots' accuracy, comprehensiveness, and self-awareness in answering ocular symptom queries

In light of growing interest in using emerging large language models (LLMs) for self-diagnosis, we systematically assessed the performance of ChatGPT-3.5, ChatGPT-4.0, and Google Bard in delivering proficient responses to 37 common inquiries regarding ocular symptoms. Responses were masked, randomly shuffled, and then graded by three consultant-level ophthalmologists for accuracy (poor, borderline, good) and comprehensiveness. Additionally, we evaluated the self-awareness capabilities (ability to self-check and self-correct) of the LLM-Chatbots. 89.2% of ChatGPT-4.0 responses were 'good'-rated, outperforming ChatGPT-3.5 (59.5%) and Google Bard (40.5%) significantly (all p < 0.001). All three LLM-Chatbots showed optimal mean comprehensiveness scores as well (ranging from 4.6 to 4.7 out of 5). However, they exhibited subpar to moderate self-awareness capabilities. Our study underscores the potential of ChatGPT-4.0 in delivering accurate and comprehensive responses to ocular symptom inquiries. Future rigorous validation of their performance is crucial to ensure their reliability and appropriateness for actual clinical use.

Translating and Adapting the DISCERN Instrument Into a Simplified Chinese Version and Validating Its Reliability: Development and Usability Study

BACKGROUND

There is a wide variation in the quality of information available to patients on the treatment of the diseases afflicting them. To help patients find clear and accessible information, many scales have been designed to evaluate the quality of health information, including the Patient Education Materials Assessment Tool; the Suitability Assessment of Materials for evaluation of health-related information for adults; and DISCERN, an instrument for judging the quality of written consumer health information on treatment choices. These instruments are primarily in English. Few of them have been translated and adapted into simplified Chinese tools for health information assessment in China.

OBJECTIVE

This study aimed to translate and adapt DISCERN into the first simplified Chinese version and validate the psychometric properties of this newly developed scale for judging the quality of patient-oriented health information on treatment choices.

METHODS

First, we translated DISCERN into simplified Chinese using rigorous guidelines for translation and validation studies. We tested the translation equivalence and measured the content validity index. We then presented the simplified Chinese instrument to 3 health educators and asked them to use it to assess the quality of 15 lung cancer-related materials. We calculated the Cohen κ coefficient and Cronbach α for all items and for the entire scale to determine the reliability of the new tool.

RESULTS

We decided on the simplified Chinese version of the DISCERN instrument (C-DISCERN) after resolving all problems in translation, adaptation, and content validation. The C-DISCERN was valid and reliable: the content validity index was 0.98 (47/48, 98% of the items) for clarity and 0.94 (45/48, 94% of the items) for relevance, the Cronbach α for internal consistency was .93 (95% CI 0.699-1.428) for the whole translated scale, and the Cohen κ coefficient for internal consistency was 0.53 (95% CI 0.417-0.698).

CONCLUSIONS

C-DISCERN is the first simplified Chinese version of the DISCERN instrument. Its validity and reliability have been attested to assess the quality of patient-targeted information for treatment choices.

Recurrent UTI: Questions and Answers on Clinical Practice

Recurrent urinary tract infection (rUTI) management is still a challenge due to the lack of a standard approach and due to the burden of diseases both on personal and societal aspects. Consultations for rUTIs in everyday clinical practice range from 1% to 6% of all medical visits with high social and personal associated costs, such as prescriptions, hospital expenses, days of sick leave due to the disease, and the treatment of related comorbidities. Recurrent UTIs are, then, associated with anxiety and depression due to treatment failures and symptomatic recurrences. Often urologists are asked to give practical recommendations to patients regarding the everyday management of recurrent UTIs. Here, we aim to give to the physicians managing UTI some helpful suggestions for their everyday clinical practice, on the basis of the recent evidence.

YouTube videos in Japanese as a source of information on nocturnal enuresis: A content-quality and reliability analysis

BACKGROUND

This study aimed to evaluate the quality and reliability of Japanese YouTube videos pertaining to nocturnal enuresis (NE).

METHODS

In this cross-sectional study, we performed a YouTube search using the keyword "Ya-nyou-shou" ('nocturnal enuresis' in Japanese). We considered the first 200 videos listed based on the YouTube default option. Videos that were irrelevant, concerned personal experiences or adult NE, had non-Japanese content, were advertisements, were duplicated, and those without audio were excluded. Video features and upload source were recorded. The Modified DISCERN, Journal of the American Medical Association (JAMA), and Global Quality Scale (GQS) scoring systems were used for analysis. Two independent pediatricians, specialists in nephrology and urology, completed the scoring. Correlation analysis was performed between video features and the three quality analysis scores.

RESULTS

In total, 72 videos were analyzed. The most common upload sources were physicians (40.3%) and non-physician health personnel (40.3%). The median modified DISCERN, JAMA, and GQS scores for the videos were 1 (lowest: 0; highest: 4), 2 (lowest: 1; highest: 3), and 2 (lowest: 1; highest: 4), respectively. The highest scores for video power index (VPI) were for independent users (6.43 points) and physicians (3.05 points). There were positive correlations between the VPI and video length and modified DISCERN and GQS scores. No video presenter disclosed conflicts of interest.

CONCLUSIONS

Most Japanese YouTube videos about NE were low quality. Healthcare experts should be encouraged to upload better quality content.

Association between online health information-seeking and medication adherence: A systematic review and meta-analysis

Background

The evidence of the impact of online health information-seeking (OHIS) on health outcomes has been conflicting. OHIS is increasingly recognised as a factor influencing health behaviour but the impact of OHIS on medication adherence remains unclear.

Objectives

We conducted a systematic review and meta-analysis to examine the associations between OHIS and medication adherence.

Methods

We searched Medline, Embase, Web of Science, Scopus, CINAHL and Psychology and Behavioural Science Collection for studies published up to December 2020. The inclusion criteria were studies that reported the associations of OHIS and medication adherence, quantitative design, reported primary data only, related to any health condition where medications are used and conducted on patients either in clinical or community settings. A meta-analysis was used to examine the association between OHIS and medication adherence.

Results

A total of 17 studies involving 24,890 patients were included in this review. The study designs and results were mixed. In the meta-analysis, there was no significant association (n = 7, OR 1.356, 95% CI 0.793-2.322, p = 0.265), or correlation (n = 4, r = -0.085, 95% CI −0.572-0.446, p = 0.768) between OHIS and medication adherence. In the sub-group analysis of people living with HIV/AIDS, OHIS was associated with better medication adherence (OR 1.612, 95% CI 1.266-2.054, p < 0.001).

Conclusions

The current evidence of an association between OHIS and medication adherence is inconclusive. This review highlights methodological issues on how to measure OHIS objectively and calls for in-depth exploration of how OHIS affects health decisions and behaviour.

Stigmatizing and de-Stigmatizing Properties of Web Apps for Sexual Health-Related Conditions: A Scoping Review

Objective

To review the literature that has examined stigma in relation to the design, impact, and ways web apps can alleviate or aggravate sexual health-related stigma.

Methods

Six databases were searched and 17 studies met the inclusion criteria.

Results

While two studies were randomized controlled trials, most studies were descriptive or qualitative. Stigma may be alleviated in web apps through sharing stigma-related experiences, receiving emotional support, and providing anonymous virtual connections Yet, stigma may be aggravated by implied disclosure, inappropriate content, and stigma by association.

Conlcusions

While web apps were able to address stigma to some extent, some strategies employed inadvertently aggravated stigma.

Reliability and Quality of YouTube Contents Pertaining to Pancreatic Cancer

OBJECTIVE

In our study, we aim to evaluate in terms of patients the quality and reliability of the most relevant and most-watched videos uploaded on YouTube about pancreatic cancer.

METHOD

Before starting the study, YouTube^TM search terms were determined by consensus by two General Surgeons. Then, on 10/10/2020, the terms such as "pancreatic cancer", "diagnosis of pancreatic cancer" and "treatment of pancreatic cancer" were entered separately in the search bar of YouTube, "relevance" was selected among the filtering options and the most viewed videos were listed. The videos were evaluated with the Global Quality Scale (GQS), the DISCERN scoring system (Quality Criteria for Consumer Health Information, http://www.discern.org.uk), and video power index.

RESULTS

 Among the 50 videos analysed, 19 videos were uploaded by hospital channels, 17 videos by health channels, seven videos by patients, four videos by blog channels, and three videos by doctors. The mean GQS score of the first researcher was 3.24 ± 0.99 and the mean GQS score of the second researcher was 3.18 ± 0.88 with a significantly high agreement between them (r= 0.628). The mean DISCERN score of the first researcher was 3.48 ± 0.77 and the mean DISCERN score of the second researcher was 3.46 ± 1.09 with a significantly high agreement between them (r= 0.814).

CONCLUSION

 In our study, the majority of the videos were found to be of moderate quality. Healthcare professionals should be encouraged to upload more videos with useful content. However, we think that the uploaded videos should definitely go through a professional peer-review process before they are published.

Evaluation of YouTube Video Content Related to the Management of Hypoglycemia

Objective

Hypoglycemia is a syndrome characterized by decreased blood glucose levels and can result in morbidity and mortality. Often, patients seek information about hypoglycemia from the Internet and especially YouTube. The objective of this study was to investigate the quality and reliability of the 50 most viewed videos related to hypoglycemia on YouTube.

Methods

The links of 50 videos that met the criteria were copied to spreadsheet software. Attributes of the uploaders, the content of the videos, their screening time, the date they were uploaded, the number of days since the upload date, the number of daily views, comments, likes, dislike, and video power indexes were recorded. The videos were assessed by two independent emergency specialists using DISCERN and global quality scales (GQS).

Results

Of the selection, 27 (54%) videos were uploaded by health channels, 11 (22%) by physicians, nine (18%) by hospital channels, and three (6%) by patients. Furthermore, 30 (60%) of these 50 videos were real-content videos and 20 (40%) were animations. The average DISCERN score given by the researchers to 50 videos was 3.72 ± 0.90 (min-max: 1-5) and the average GQS score was 3.65 ± 0.88. Mean video power index (VPI) value was determined as 92.64 ± 11. According to Pearson’s analysis, there was a good agreement between the two observers.

Conclusion

Videos uploaded by physicians were useful. However, health videos should only be uploaded by physicians. Uploading videos with content that the patients and their relatives can clearly understand is of paramount importance.

Consumer side economic perception of telemedicine during COVID-19 era: A survey on Bangladesh's perspective

In Bangladesh, the telemedicine industry is one of the few industries able to flourish in the contemporary era of COVID-19. But to thrive, the industry must know the viewpoints of both consumers (those who are interested in availing the services of the industry) and non-consumers to overcome deficits. This should be done to maximize profits and give optimal utility to users so that the industry can be made sustainable in the long run. The main aim of this paper is to analyze the economic perception of both the telemedicine consumers and non-consumers of Bangladesh and the actions required to be taken to optimize them. A survey was developed with 18 questions divided into several parts relating to the health identity of the respondent, the respondents' use of telemedicine, the analysis of the economic behaviors of the respondents with regards to telemedicine, and the consumer perception of the merits and demerits of telemedicine. The survey results show that about one-third has used some form of telemedicine during the COVID-19 pandemic. Among the telemedicine users, 48% used hospital-mandated telemedicine services whereas 41% used mobile telemedicine applications. The survey states that 75% were satisfied with the service they received. The average payment made by the respondent population was 532 Taka, and 62% of them thought that the amount they paid was justified. In conclusion, the results of this survey can be utilized in making economically viable telemedicine models that will give optimal utility to its consumers and help forecast the next stage of the industry for betterment in the health sector.