1
|
Prontera PP, Prusciano FR, Lattarulo M, Utano E, Schiralli F, Sciorio C, Romano L, Grossi FS. Quality of bladder cancer treatment information on YouTube: May the user's profile affect the quality of results? Arch Ital Urol Androl 2024; 96:12179. [PMID: 38363228 DOI: 10.4081/aiua.2024.12179] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2023] [Accepted: 12/24/2023] [Indexed: 02/17/2024] Open
Abstract
BACKGROUND Social media are widely used information tools, including the medical/health field. Unfortunately, the levels of misinformation on these platforms seem to be high, with a medium-low quality of the proposed content, as evidenced by previous studies. You Tube is one of the most important platforms for audio/video content. It shows content to users through a recommendation algorithm system. MATERIALS AND METHODS We have classified in two cohorts the first results obtained by researching "bladder tumor treatment" on You Tube through two different user profiles: "Cohort A" with a not logged-in session in incognito mode (46 videos enrolled) and "Cohort B" with a logged-in session with a physician profile (50 videos enrolled). The videos were evaluated using validated instruments such as DISCERN and PEMAT-AV Furthermore, we used a Likert's scale for the evaluation of levels of misinformation. RESULTS Overall quality of information was moderate to poor (DISCERN 3) in 54% of Cohort A and 24% of Cohort B. Moreover, a high degree of misinformation (Likert score 3) was found in 52% of Cohort A cases and 32% of Cohort B. CONCLUSIONS Levels of misinformation in both cohorts are positively correlated to the number of views per month. Globally, the levels of information quality, understandability and actionability are lower for the results obtained from searches performed with anonymous user profile (Cohort A).
Collapse
Affiliation(s)
| | - Francesca Romana Prusciano
- Department of Emergency and Organ Transplantation-Urology, Andrology and Kidney Transplatation Unit, University of Bari.
| | | | - Emanuele Utano
- Department of Urology, "S.S. Annunziata" Hospital, Taranto.
| | | | - Carmine Sciorio
- Department of Urology, "Alessandro Manzoni" Hospital of Lecco.
| | - Lorenzo Romano
- Department of Neurosciences, Reproductive Sciences and Odontostomatology, University of Naples "Federico II", Naples.
| | | |
Collapse
|
2
|
Ni CX, Fei YB, Wu R, Cao WX, Liu W, Huang F, Shen FM, Li DJ. Tumor Immunotherapy-Related Information on Internet-Based Videos Commonly Used by the Chinese Population: Content Quality Analysis. JMIR Form Res 2024; 8:e50561. [PMID: 38324352 PMCID: PMC10882464 DOI: 10.2196/50561] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2023] [Revised: 01/03/2024] [Accepted: 01/16/2024] [Indexed: 02/08/2024] Open
Abstract
BACKGROUND Tumor immunotherapy is an innovative treatment today, but there are limited data on the quality of immunotherapy information on social networks. Dissemination of misinformation through the internet is a major social issue. OBJECTIVE Our objective was to characterize the quality of information and presence of misinformation about tumor immunotherapy on internet-based videos commonly used by the Chinese population. METHODS Using the keyword "tumor immunotherapy" in Chinese, we searched TikTok, Tencent, iQIYI, and BiliBili on March 5, 2022. We reviewed the 118 screened videos using the Patient Education Materials Assessment Tool-a validated instrument to collect consumer health information. DISCERN quality criteria and the JAMA (Journal of the American Medical Association) Benchmark Criteria were used for assessing the quality and reliability of the health information. The videos' content was also evaluated. RESULTS The 118 videos about tumor immunotherapy were mostly uploaded by channels dedicated to lectures, health-related animations, and interviews; their median length was 5 minutes, and 79% of them were published in and after 2018. The median understandability and actionability of the videos were 71% and 71%, respectively. However, the quality of information was moderate to poor on the validated DISCERN and JAMA assessments. Only 12 videos contained misinformation (score of >1 out of 5). Videos with a doctor (lectures and interviews) not only were significantly less likely to contain misinformation but also had better quality and a greater forwarding number. Moreover, the results showed that more than half of the videos contain little or no content on the risk factors and management of tumor immunotherapy. Overall, over half of the videos had some or more information on the definition, symptoms, evaluation, and outcomes of tumor immunotherapy. CONCLUSIONS Although the quality of immunotherapy information on internet-based videos commonly used by Chinese people is moderate, these videos have less misinformation and better content. Caution must be exercised when using these videos as a source of tumor immunotherapy-related information.
Collapse
Affiliation(s)
- Chen-Xu Ni
- Shanghai Tenth People's Hospital, Shanghai, China
| | - Yi-Bo Fei
- Shanghai Tenth People's Hospital, Shanghai, China
| | - Ran Wu
- Shanghai Tenth People's Hospital, Shanghai, China
| | | | - Wenhao Liu
- Shanghai Tenth People's Hospital, Shanghai, China
| | - Fang Huang
- Shanghai Tenth People's Hospital, Shanghai, China
| | - Fu-Ming Shen
- Shanghai Tenth People's Hospital, Shanghai, China
| | - Dong-Jie Li
- Shanghai Tenth People's Hospital, Shanghai, China
| |
Collapse
|
3
|
Hüsch T, Ober S, Haferkamp A, Naumann G, Tunn R, Saar M, Kranz J. Comparison of online health information between different digital platforms for pelvic organ prolapse. World J Urol 2022; 40:2529-2534. [PMID: 36006445 PMCID: PMC9512708 DOI: 10.1007/s00345-022-04129-6] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2022] [Accepted: 08/07/2022] [Indexed: 11/23/2022] Open
Abstract
Purpose To identify differences in the content and quality of online health information for pelvic organ prolapse (POP) presented in social media and digital search engines to sustainably enhance patient guidance for adequate platforms for seeking online health information on POP. Methods The platforms Google search, Facebook, Instagram, LinkedIn, and YouTube were searched for the keyword “pelvic organ prolapse”. Results were categorized as useful, misleading, advertising, and personal experience. Data were categorized into healthcare professionals, professional organisations, industry, patients, and individuals. The readability score and Health On the Net (HON) code seal were analyzed for Google. Descriptive and univariate analysis was performed. Results The source with the highest quantity of useful content was YouTube whereas LinkedIn included mostly advertisement and misleading content. YouTube and Google provided the greatest variety of health information. Social media platforms identified emotional distress and sleep disturbances as a common side effect of POP which is limited considered in clinical practice and provide novel insights of bothersome symptoms related to the disease. The spectrum of different surgical techniques was limited in all platforms. Only 12 (40.0%) were HON-qualified websites with a mean readability score of 10.4 which is considered fairly difficult to read. Conclusion Besides Google search, YouTube was identified as a valuable online source for POP information. However, encompassing information of surgical techniques was limited in all platforms. Urogynecological association may contribute to improve patient information by providing online health information which is complete and easy to understand. Supplementary Information The online version contains supplementary material available at 10.1007/s00345-022-04129-6.
Collapse
Affiliation(s)
- Tanja Hüsch
- Department of Urology and Pediatric Urology, University Medical Center of Johannes Gutenberg University, Langenbeckstr. 1, 55131, Mainz, Germany.
| | - Sita Ober
- Department of Urology and Pediatric Urology, University Medical Center of Johannes Gutenberg University, Langenbeckstr. 1, 55131, Mainz, Germany.,Department of Obstetrics and Gynecology, Hospital Darmstadt, Darmstadt, Germany
| | - Axel Haferkamp
- Department of Urology and Pediatric Urology, University Medical Center of Johannes Gutenberg University, Langenbeckstr. 1, 55131, Mainz, Germany
| | - Gert Naumann
- Department of Gynecology and Obstetrics, Helios Hospital Erfurt, Erfurt, Germany
| | - Ralf Tunn
- Department of Urogynecology, St. Hedwig Hospital, Berlin, Germany
| | - Matthias Saar
- Department of Urology, University Hospital RWTH Aachen, Aachen, Germany
| | - Jennifer Kranz
- Department of Urology, University Hospital RWTH Aachen, Aachen, Germany.,Department of Urology and Kidney Transplantation, Martin-Luther-University, Halle (Saale), Germany
| |
Collapse
|
4
|
Karsalia M, Malik R. Evaluation of free mobile health applications for pelvic organ prolapse and urinary incontinence. Am J Surg 2021; 223:187-193. [PMID: 34391568 DOI: 10.1016/j.amjsurg.2021.07.046] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2021] [Revised: 07/26/2021] [Accepted: 07/27/2021] [Indexed: 11/29/2022]
Abstract
BACKGROUND Technology is becoming increasingly integrated into healthcare, including the rapid development of mobile health (mHealth) applications (apps) for various medical conditions such as urinary incontinence and pelvic organ prolapse (POP). As patients turn to these sources more frequently, closer evaluation of the apps becomes more important. OBJECTIVES To (1) evaluate free applications designed for POP and urinary incontinence using the Xcertia guidelines for medical app quality, (2) analyze user sentiment of the apps, and (3) evaluate app information for quality, understandability, and actionability with the DISCERN and the Patient Education Materials Assessment Tool (PEMAT) tools. METHODS Mobile medical apps were identified on the Apple App Store or Google Play Store with keywords "pelvic organ prolapse," "incontinence," or "bladder." Exclusion criteria included 1) not free, 2) not updated in past year, 3) required a product for use, 4) not in English. Apps were evaluated using the Xcertia Guidelines. Categories included Operability, Privacy, Security, Content, and Usability. Ratings and sentiment of reviews were assessed, and associations analyzed with one-sided Fisher's exact test. Apps with an informational component were evaluated for quality, usability and actionability using DISCERN and PEMAT criteria. RESULTS Overall, a total of 73 apps were found and 28 were included. There was an average number of ratings of 2341 and an average score of 3.39 for all the apps included. The average number of reviews was 216.2, with the majority of reviews having positive sentiment. A high number of ratings was associated with a high rating score (p < 0.05) and a high number of reviews was associated with a high percentage of positive reviews (p < 0.05). Based on Xcertia Guidelines, all apps met the guidelines for privacy, security, and usability. Regarding content, 67.9 % of apps incorporated an informational component, but only 17.9 % delineated sources. The average DISCERN score for information quality indicated good quality information (>3). The average PEMAT scores for Understandability and Actionability were 90.6 % and 86.6 %, respectively, which are good scores (≥75 %). CONCLUSIONS Most free apps were functional and well received by users, however quality of app content varied. Only some apps had an informational component, and even fewer had sources listed. Providers recommending health apps should consider those that meet Xcertia guidelines, have reliable information, and have good understandability and actionability.
Collapse
Affiliation(s)
- Moli Karsalia
- University of Maryland School of Medicine, Baltimore, MD, USA.
| | - Rena Malik
- University of Maryland School of Medicine, Department of Surgery, Division of Urology, Baltimore, MD, USA
| |
Collapse
|
5
|
Pace LA, Herbert AS, Malik RD. Characteristics of pelvic organ prolapse content available on social media. Neurourol Urodyn 2021; 40:1165-1174. [PMID: 33834557 DOI: 10.1002/nau.24673] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2020] [Revised: 02/24/2021] [Accepted: 03/13/2021] [Indexed: 11/11/2022]
Abstract
AIMS To analyze the quality, understandability, and actionability of pelvic organ prolapse (POP) content and to characterize creators of content and treatment options discussed on social media platforms YouTube, Instagram, and Pinterest. METHODS A cross-sectional, qualitative study was conducted for each platform. A search for "pelvic organ prolapse" was conducted and the first 100 relevant results analyzed. Data collected include source characteristics, treatments discussed, and scores for each criterion of validated Patient Education Materials and Assessment Tool and DISCERN metrics to evaluate quality, actionability, and understandability. The χ 2 analysis, univariate and multivariate logistic regressions were done to assess correlations and the impact of variables on outcomes of interest across platforms. RESULTS Low to moderate quality was present in 74.1% of posts. Poor understandability was seen in 37.1% of posts, and 56.1% had poor actionability. The most common publisher of content overall was health and wellness or physical therapy groups (44.6%). The most common YouTube publisher was doctors, hospitals, or clinics (49%). Pelvic floor muscle training was the most discussed treatment overall (57.4%). On YouTube surgery was discussed more frequently than Instagram or Pinterest (58% vs. 11% vs. 43%, p < 0.001. Pinterest posts had better understandability ratings than YouTube videos (odds ratio = 0.19; 95% confidence interval: [0.10-0.36]; p < 0.001). CONCLUSION Information on popular platforms regarding POP demonstrates inconsistent quality and poor understandability and actionability. There is an opportunity for health care providers to direct patients to curated lists of high-quality educational content on these platforms. Awareness of information available on social media is an increasingly important aspect of patient care.
Collapse
Affiliation(s)
- Lauren A Pace
- Department of Urology, Division of Female Pelvic Medicine & Reconstructive Surgery, University of Maryland School of Medicine, Baltimore, Maryland, USA
| | - Amber S Herbert
- Department of Urology, Division of Female Pelvic Medicine & Reconstructive Surgery, University of Maryland School of Medicine, Baltimore, Maryland, USA
| | - Rena D Malik
- Department of Urology, Division of Female Pelvic Medicine & Reconstructive Surgery, University of Maryland School of Medicine, Baltimore, Maryland, USA
| |
Collapse
|
6
|
An Evaluation of the Readability and Content-Quality of Pelvic Organ Prolapse YouTube Transcripts. Urology 2021; 154:120-126. [PMID: 33775787 DOI: 10.1016/j.urology.2021.03.009] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2020] [Revised: 03/05/2021] [Accepted: 03/14/2021] [Indexed: 11/23/2022]
Abstract
OBJECTIVE To evaluate the readability, quality, and accuracy of pelvic organ prolapse (POP) YouTube transcripts. METHODS We analyzed the readability of written transcripts for the first 100 YouTube videos about "Pelvic Organ Prolapse." Transcripts were excluded if they lacked narration in English or contained both no text and no audio. Readability was evaluated using an online software (www.readabilityformulas.com) to determine reading grade levels. The quality of videos was scored using the DISCERN quality criteria and the Patient Education Materials Assessment Tool. Accuracy was assessed by comparing content to accepted POP treatment guidelines. RESULTS The median grade level of all 100 videos was 12.6. High quality transcripts or transcripts that discuss the benefits, risk, alternative treatments, and quality of life had a median readability score of 12.5. Transcripts with low misinformation (85%) had a higher median readability index (12.6), than transcripts containing high misinformation (12.2). More than 20% of transcripts discussed shared decision-making. The median readability index for videos with a high Patient Education Materials Assessment Tool score (>75%) for understandability and actionability were both 12.6. CONCLUSION Transcripts of POP YouTube videos are written at difficult levels with many transcripts exceeding the reading capabilities of the American population. The majority of good transcripts or transcripts with high quality content, low misinformation, shared decision-making, no commercial bias, and understandable and actionable content were written at a high school level or above. Efforts should be made to avoid complex terms when creating patient focused content and helping patients navigate to content of appropriate literacy online.
Collapse
|
7
|
Analysis of Pelvic Organ Prolapse-related Content on Pinterest. Female Pelvic Med Reconstr Surg 2021; 27:e372-e376. [PMID: 32941313 DOI: 10.1097/spv.0000000000000940] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
OBJECTIVES Our study is a cross-sectional, qualitative study analyzing pelvic organ prolapse-related content on Pinterest, a social media platform that also functions as a visual search engine. Primary outcomes assessed include quality, understandability, and actionability of content. Secondary outcomes include levels of misinformation and commercial bias. Our study further characterizes sources of prolapse content and treatment modalities discussed. METHODS A Pinterest search was conducted using the term "pelvic organ prolapse," analyzing the first 100 relevant results. We examined the publisher of each pin and the writer of linked content. Using validated tools including the Patient Education Materials Assessment Tool and DISCERN criteria, we assessed understandability and actionability of content. We further compared content to professional guidelines for discussing and treating prolapse, evaluating for misinformation. We also evaluated for commercial bias and subjectively rated pin quality. RESULTS Of pins evaluated, low understandability was found in 16, low actionability in 30, and low-to-moderate quality in 69. The most common publisher of pins was health and wellness groups, and the most common writer of content was physical therapists. Pelvic floor muscle training (PFMT) is the treatment modality discussed most frequently on Pinterest. CONCLUSIONS Pinterest content discussing pelvic organ prolapse shows good levels of understandability for patients at all levels of health literacy. However, the number of pins showing poor actionability raises concern that content may not encourage readers to take direct steps toward prolapse assessment and management. In all, a majority of prolapse-related content on Pinterest was of low-to-moderate quality.
Collapse
|
8
|
Loeb S, Reines K, Abu-Salha Y, French W, Butaney M, Macaluso JN, Steinberg GD, Walter D, Byrne N, la Garza DD, Smith AB. Quality of Bladder Cancer Information on YouTube. Eur Urol 2021; 79:56-59. [DOI: 10.1016/j.eururo.2020.09.014] [Citation(s) in RCA: 25] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2020] [Accepted: 09/04/2020] [Indexed: 11/15/2022]
|
9
|
Huang MM, Winoker JS, Allaf ME, Matlaga BR, Koo K. Evidence-based quality and accuracy of YouTube videos about nephrolithiasis. BJU Int 2020; 127:247-253. [PMID: 32805761 DOI: 10.1111/bju.15213] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/25/2023]
Abstract
OBJECTIVE To assess the quality and accuracy of online videos about the medical management of nephrolithiasis. MATERIALS AND METHODS To evaluate trends in online interest, we first examined the frequency of worldwide YouTube searches for 'kidney stones' from 2015 to 2020. We then queried YouTube with terms related to symptoms and treatment of kidney stones and analysed English-language videos with >5000 views. Quality was assessed using the validated DISCERN instrument. Evidence-based content analysis of video content and viewer comments was performed. RESULTS Online searches for videos about kidney stones doubled between 2015 and 2019 (P < 0.001). We analysed 102 videos with a median (range) number of views of 46 539 (5024-3 631 322). The mean (sd) DISCERN score was 3.0 (1.4) out of 5, indicating 'moderate' quality; scores were significantly higher for the 21 videos (21%) authored by academic hospitals (mean 3.7 vs 2.8, P = 0.02). Inaccurate or non-evidence-based claims were identified in 23 videos (23%); none of the videos authored by academic institutions contained inaccurate claims. Videos with inaccurate statements had more than double the viewer engagement (viewer-generated comments, 'thumbs up' and 'thumbs down' ratings) compared to videos without inaccuracies (P < 0.001). Among viewer comments, 43 videos (43%) included comments with inaccurate or non-evidence-based claims, and a large majority (82 videos, 80%) had 'chatbot' recommendations. CONCLUSIONS Interest in YouTube videos about nephrolithiasis has doubled since 2015. While highly viewed videos vary widely in quality and accuracy, videos produced by academic hospitals have significantly fewer inaccurate claims. Given the high prevalence of stone disease and poor-quality videos, patients should be directed to evidence-based content online.
Collapse
Affiliation(s)
- Mitchell M Huang
- The James Buchanan Brady Urological Institute, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Jared S Winoker
- The James Buchanan Brady Urological Institute, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Mohamad E Allaf
- The James Buchanan Brady Urological Institute, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Brian R Matlaga
- The James Buchanan Brady Urological Institute, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Kevin Koo
- The James Buchanan Brady Urological Institute, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| |
Collapse
|
10
|
Light A. Arteriovenous fistula for dialysis - Let's YouTube it. Surgeon 2020; 19:252-253. [PMID: 32819822 DOI: 10.1016/j.surge.2020.07.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2020] [Accepted: 07/23/2020] [Indexed: 11/30/2022]
Affiliation(s)
- Alexander Light
- Department of Surgery, University of Cambridge, Cambridge, UK.
| |
Collapse
|
11
|
Evidence-based analysis of online consumer information about prostate artery embolization for benign prostatic hyperplasia. Prostate Cancer Prostatic Dis 2020; 24:106-113. [PMID: 32513968 DOI: 10.1038/s41391-020-0242-2] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2020] [Revised: 04/18/2020] [Accepted: 05/27/2020] [Indexed: 11/08/2022]
Abstract
BACKGROUND Clinical guidelines have conflicting recommendations on the role of prostate artery embolization (PAE), a novel interventional radiology technique used to treat benign prostatic hyperplasia (BPH). In the absence of consensus among clinicians, patients may seek information online, where consumer-targeted content has proliferated in recent years. Our objective was to assess the content and quality of online information about prostate artery embolization (PAE). METHODS We evaluated patient interest and exposure to PAE by searching Google Trends for PAE and searching Google for BPH and treatment-related terms. To assess online content about PAE safety and efficacy, we queried Google for patient-oriented websites and YouTube for consumer videos, assessing quality using the validated DISCERN instrument and performing an evidence-based content analysis of how indications, risks, and benefits of PAE were presented. RESULTS Worldwide searches for PAE peaked in 2019; PAE was mentioned in 15 (26%) of the 57 general BPH-related websites. From our PAE-specific searches, we identified 50 websites and 31 videos. Academic hospitals were the most common sponsor of both PAE-related websites (16, 32%) and videos (15, 48%). Among sources offering PAE to patients, only 15% of websites and 11% of videos explicitly did so as part of a clinical trial. The average DISCERN rating of quality of content was 3.0 out of 5 for websites and 2.0 out of 5 for videos (p < 0.001). Over a quarter of websites and more than half of videos contained potential misinformation, inaccuracies, or non-evidence-based claims about PAE (p = 0.02). CONCLUSIONS Online consumer information about PAE is of low to moderate quality, with a high frequency of non-evidence-based claims. In the absence of guideline consensus about the role of PAE, clinicians should offer shared decision making and evidence-based counseling about the risks and benefits of PAE.
Collapse
|