Misinformation on the Internet regarding Ablative Therapies for Prostate Cancer

Health-related Internet Use Among New Urology Clinic Patients

OBJECTIVE

To assess internet usage among new patients seen by urologists and impact on post-consultation understanding for 4 common conditions: kidney stones, elevated prostate-specific antigen, male voiding, and female voiding.

METHODS

We performed a prospective study of new urology patients at our diverse urban, academic urology practice for the above conditions over a 1-year period. A voluntary questionnaire assessed patients' internet use related to referred conditions prior to encounters. Questions evaluated quality of information and patient understanding of symptoms/condition at baseline, after online searches, and after their urology visit. A patient-reported Likert scale of 1 (poor) to 10 (excellent) was used and internet "searchers" were compared to "non-searchers."

RESULTS

Two hundred fifteen patients participated. Most respondents were Latino (41%) or Black (35%) and English-speaking (81%). Cohorts comprised 130 searchers (60%) and 85 non-searchers (40%). Searchers were significantly younger (median 53 vs 63 years, P <.001), more likely to have home internet access (P <.001), and more general medical internet use (P <.001). Overall, patients' understanding of visit diagnoses increased after their encounters (median pre-visit rating 5 vs post-visit rating 10). Searchers reported a greater post-visit understanding compared to non-searchers (median rating 10 vs 9, P <.001), and a greater change in understanding from baseline (median +4 vs +3, P = .02).

CONCLUSION

Internet use is common amongst younger patients referred to urologists and may be associated with improved understanding of their condition after urologic consultation. Continued investigation of patient uses and attitude towards popular online resources can help urologists curate resources to benefit patients and providers alike.

Evaluating the Efficacy of ChatGPT as a Patient Education Tool in Prostate Cancer: Multimetric Assessment

BACKGROUND

Artificial intelligence (AI) chatbots, such as ChatGPT, have made significant progress. These chatbots, particularly popular among health care professionals and patients, are transforming patient education and disease experience with personalized information. Accurate, timely patient education is crucial for informed decision-making, especially regarding prostate-specific antigen screening and treatment options. However, the accuracy and reliability of AI chatbots' medical information must be rigorously evaluated. Studies testing ChatGPT's knowledge of prostate cancer are emerging, but there is a need for ongoing evaluation to ensure the quality and safety of information provided to patients.

OBJECTIVE

This study aims to evaluate the quality, accuracy, and readability of ChatGPT-4's responses to common prostate cancer questions posed by patients.

METHODS

Overall, 8 questions were formulated with an inductive approach based on information topics in peer-reviewed literature and Google Trends data. Adapted versions of the Patient Education Materials Assessment Tool for AI (PEMAT-AI), Global Quality Score, and DISCERN-AI tools were used by 4 independent reviewers to assess the quality of the AI responses. The 8 AI outputs were judged by 7 expert urologists, using an assessment framework developed to assess accuracy, safety, appropriateness, actionability, and effectiveness. The AI responses' readability was assessed using established algorithms (Flesch Reading Ease score, Gunning Fog Index, Flesch-Kincaid Grade Level, The Coleman-Liau Index, and Simple Measure of Gobbledygook [SMOG] Index). A brief tool (Reference Assessment AI [REF-AI]) was developed to analyze the references provided by AI outputs, assessing for reference hallucination, relevance, and quality of references.

RESULTS

The PEMAT-AI understandability score was very good (mean 79.44%, SD 10.44%), the DISCERN-AI rating was scored as "good" quality (mean 13.88, SD 0.93), and the Global Quality Score was high (mean 4.46/5, SD 0.50). Natural Language Assessment Tool for AI had pooled mean accuracy of 3.96 (SD 0.91), safety of 4.32 (SD 0.86), appropriateness of 4.45 (SD 0.81), actionability of 4.05 (SD 1.15), and effectiveness of 4.09 (SD 0.98). The readability algorithm consensus was "difficult to read" (Flesch Reading Ease score mean 45.97, SD 8.69; Gunning Fog Index mean 14.55, SD 4.79), averaging an 11th-grade reading level, equivalent to 15- to 17-year-olds (Flesch-Kincaid Grade Level mean 12.12, SD 4.34; The Coleman-Liau Index mean 12.75, SD 1.98; SMOG Index mean 11.06, SD 3.20). REF-AI identified 2 reference hallucinations, while the majority (28/30, 93%) of references appropriately supplemented the text. Most references (26/30, 86%) were from reputable government organizations, while a handful were direct citations from scientific literature.

CONCLUSIONS

Our analysis found that ChatGPT-4 provides generally good responses to common prostate cancer queries, making it a potentially valuable tool for patient education in prostate cancer care. Objective quality assessment tools indicated that the natural language processing outputs were generally reliable and appropriate, but there is room for improvement.

Internet use by pregnant women during prenatal care

OBJECTIVE

The search for medical information on the internet is a part of people's daily lives. Exponential volumes of data are available through various media and platforms. There are several problems related to the ease of creating and accessing medical information on the internet, as evidenced by the quantity of false content and increasing anxiety due to the consumption of these data. In light of this accessibility, it is necessary to understand how people use internet-based medical information and its impact on specific populations. This prospective study aimed to analyze pregnant women's behavior when searching for health-related information on the internet, and how they were influenced by the information.

METHODS

Questionnaires were administered to the participants during their immediate puerperium, and their answers were tabulated.

RESULTS

Three hundred and two patients answered the questionnaires. We observed that internet use was frequent, and most patients discussed the findings with their physicians. However, this did not affect the delivery routes.

CONCLUSION

The search for health information by pregnant women is very prevalent but does not interfere with the delivery route.

Evaluating AI in medicine: a comparative analysis of expert and ChatGPT responses to colorectal cancer questions

Colorectal cancer (CRC) is a global health challenge, and patient education plays a crucial role in its early detection and treatment. Despite progress in AI technology, as exemplified by transformer-like models such as ChatGPT, there remains a lack of in-depth understanding of their efficacy for medical purposes. We aimed to assess the proficiency of ChatGPT in the field of popular science, specifically in answering questions related to CRC diagnosis and treatment, using the book "Colorectal Cancer: Your Questions Answered" as a reference. In general, 131 valid questions from the book were manually input into ChatGPT. Responses were evaluated by clinical physicians in the relevant fields based on comprehensiveness and accuracy of information, and scores were standardized for comparison. Not surprisingly, ChatGPT showed high reproducibility in its responses, with high uniformity in comprehensiveness, accuracy, and final scores. However, the mean scores of ChatGPT's responses were significantly lower than the benchmarks, indicating it has not reached an expert level of competence in CRC. While it could provide accurate information, it lacked in comprehensiveness. Notably, ChatGPT performed well in domains of radiation therapy, interventional therapy, stoma care, venous care, and pain control, almost rivaling the benchmarks, but fell short in basic information, surgery, and internal medicine domains. While ChatGPT demonstrated promise in specific domains, its general efficiency in providing CRC information falls short of expert standards, indicating the need for further advancements and improvements in AI technology for patient education in healthcare.

A powerful partnership: researchers and patients working together to develop a patient-facing summary of clinical trial outcome data

OBJECTIVE

Availability of easy-to-understand patient-reported outcome (PRO) trial data may help individuals make more informed healthcare decisions. Easily interpretable, patient-centric PRO data summaries and visualizations are therefore needed. This three-stage study explored graphical format preferences, understanding, and interpretability of clinical trial PRO data presented to people with prostate cancer (PC).

MATERIALS AND METHODS

A 7-day online survey exploring people with PC's preferences for different PRO data presentations (stage 1; n = 30) informed development of a draft plain-language resource sheet containing PRO data. After refining for clarity during cognitive debriefing interviews (stage 2; n = 18), the final resource sheet was circulated to people with PC for broader feedback (stage 3; n = 45).

RESULTS

Although participants expressed preferences for certain graphical formats (pie charts and bar charts), preference did not always associate with interpretability and overall message clarity. Iterative development (stages 1 and 2) led to a final resource sheet, which 91.1% of participants in stage 3 considered useful and informative, and 88.9% expressed interest in receiving similar resources in the future.

DISCUSSION

Findings demonstrate PRO data are relevant to people with PC and highlights that targeted resource sheets can support patient-clinician discussions. Appropriate graphical formatting and use of plain-language text is essential for conveying interpretable PRO data. Data visualization preferences are context dependent.

CONCLUSION

Resource sheets summarizing clinical trial PRO data can be helpful for decision-making in PC. Researchers and patients can work together to develop clear, relevant, sensitive, and understandable resource sheets, which equally consider patient priorities as well as those of scientists.

Navigating Radiation Therapy During COVID-19 Using YouTube as a Source of Information

The COVID-19 pandemic brought considerable change to the practice of radiotherapy. In the meantime, patients are increasingly turning to online resources for health information, with YouTube being one of the biggest platforms. However, little is known about what information is being disseminated to cancer patients about radiotherapy in the context of COVID-19. Therefore, this study aims to characterize and assess YouTube videos on radiotherapy during COVID-19. A YouTube search using the terms "Radiation therapy COVID-19", "Radiation therapy coronavirus", "Radiotherapy COVID-19", and "Radiotherapy coronavirus" was completed using a clear-cache web browser. The top 50 videos were collected from each search. After applying pre-determined exclusion criteria, each video was assessed for general parameters, source, and content. Two raters were used to ensure interrater reliability. One hundred five unique videos resulted from the four searches. Ninety-eight per cent were published in the last year. The median video length was 6 min and 54 s, and the median number of views was 570. Most videos were from the USA (58%). The majority of videos were published by a commercial channel (31%), non-profit organization (28%), or healthcare facility (26%). Forty-two per cent of the videos covered a topic related to radiotherapy during the pandemic. Bias was identified in 6% of videos. YouTube information on radiotherapy during COVID-19 is non-specific and can be misleading. The results of this study highlight the need for healthcare providers to proactively address patient information needs and guide them to appropriate sources of information.

Quality Assessment of Online Resources for the Most Common Cancers

The internet is a common source of health information for patients with cancer. Despite research surrounding the quality of online resources for individual types of cancer, these results may not necessarily be easily extrapolated to cancer resources as a whole. Thus, we aim to use a standardized tool to produce generalizable results by analyzing the quality of online resources for the most common cancers. Educational websites pertaining to breast, lung, prostate, and colorectal cancers were searched using multiple search engines. After screening against pre-specified inclusion criteria, the most visible 100 websites for each cancer were extracted for analysis. A validated tool was then used to assess their quality. Pooled results were evaluated using descriptive and inferential statistics. Of the 400 analyzed websites, 43% were commercially affiliated, and these were significantly associated with greater use of biased language. Thirty percent of websites disclosed authorship, 47% cited at least one reliable source, and 43% were updated within the last 2 years. The average Flesch-Kincaid readability was determined to be at a grade 10.9 level, which is significantly more difficult than the recommended grade 6 level. Risk factors, symptoms, and detection were the most accurately covered topics. However, most websites did not cover prognosis. This study comprehensively examines the quality of online cancer resources for the four most common cancers. Our results could help guide the development of future resources, support patient education endeavors, and raise awareness among healthcare providers about the limitations of online cancer resources.

Improving access to oncology publications for advocates and people with cancer

Journal articles provide reliable and current information about cancer research. This can offer hope to people with cancer and help them make decisions about their care. Here, the authors suggest ways in which different groups may help people with cancer to find, view, and understand articles. For example, journals should make articles free to view if they describe research that could change patient care. Also, clear titles and easy-to-follow summaries or videos may help people to find relevant articles and understand the main findings. It is important to explore ways to best share research with all those whose lives it may affect.

Health Literacy of Newly-Admitted Cancer Patients in Vietnam: Difficulties Understanding Treatment Options and Processing Health-Related Information

Having a good understanding of cancer patients' health literacy in the early stage of diagnosis can help to implement strategies to improve the management process and overall health outcomes. The study aims to describe health literacy and its association with socio-demographic characteristics among newly admitted cancer patients. A cross-sectional study was conducted on 262 newly admitted patients of a cancer hospital in Vietnam using the Vietnamese version of the HLS-SF12 questionnaire. Descriptive analytics and regression analysis were used to describe health literacy and examine associated factors. Older age, lower level of education, and living in rural areas were associated with lower health literacy while there was no significant relationship between gender and health literacy among newly admitted cancer patients. Many newly admitted patients, especially the older patients have difficulties understanding the different treatment options (54%) and evaluating the reliability of health information on the internet (43%). During the early stage of treatment, strategies should be implemented with regards to patients' health literacy, to properly educate patients and their caregivers to improve communication, adherence to medication, lifestyle, and overall better quality of life and treatment outcome.

Consulting 'Dr. Google' for minimally invasive urological oncological surgeries: A contemporary web-based trend analysis

PURPOSE

To determine web-based public interest in minimally invasive surgery (MIS) specifically for urological oncological surgical procedures and how interest in robotics and laparoscopy compares over time.

MATERIALS AND METHODS

Worldwide search-engine trend analysis included electronic Google queries of MIS urologic options from January 2004 to August 2019, worldwide. Join-point regression was performed. Comparison of annual relative search volume (ARSV) and average annual percentage change (AAPC) were analysed to assess loss or gain of interest. Evaluations were made regarding 1) penetrance of interest for MIS in Urology; 2) how MIS urologic procedures compared over time; and 3) which were the top related queries to searches for urologic oncology procedures.

RESULTS

Increased interest was found for all of the MIS procedures evaluated. Mean ARSV for robotic approach was higher for the search term 'prostatectomy" (44.8 vs. 13.5; p < 0.001) and 'partial nephrectomy" (27.1 vs.11.5; p = 0.02). No statistical difference was found for the search terms 'cystectomy" or 'nephrectomy". The analysis of mean (∆-ARSV) of MIS procedures measured between the first and last 12 months of the study period showed an increased interest with a more pronounced ∆-ARSV for robotic procedures. The top related searches for all surgical procedures were examined showing an increasing inquisitiveness with regards of type of urological cancers, treatment options, type of surgery and prognostic outcomes.

CONCLUSIONS

People are increasingly searching the web for MIS urological procedures. A growing appeal for robotics is demonstrated, especially for prostatectomy and partial nephrectomy where the robotic approach is gaining traction, suggesting a shift in mind-set amongst people seeking urological healthcare information.