1
|
Vallurupalli M, Shah ND, Vyas RM. Optimizing Readability of Patient-Facing Hand Surgery Education Materials Using Chat Generative Pretrained Transformer 3.5. J Hand Surg Am 2024:S0363-5023(24)00234-X. [PMID: 38970600 DOI: 10.1016/j.jhsa.2024.05.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/17/2023] [Revised: 05/06/2024] [Accepted: 05/21/2024] [Indexed: 07/08/2024]
Abstract
PURPOSE To address patient health literacy, the American Medical Association and the National Institutes of Health recommend that readability of patient education materials should not exceed an eighth grade reading level. However, patient-facing materials often remain above the recommended average reading level. Current online calculators provide readability scores; however, they lack the ability to provide text-specific feedback, which may streamline the process of simplifying patient materials. The purpose of this study was to evaluate Chat Generative Pretrained Transformer (ChatGPT) 3.5 as a tool for optimizing patient-facing hand surgery education materials through reading level analysis and simplification. METHODS The readability of 18 patient-facing hand surgery education materials was compared by a traditional online calculator for reading level and ChatGPT 3.5. The original excerpts were then entered into ChatGPT 3.5 and simplified by the artificial intelligence tool. The simplified excerpts were scored by the same calculators. RESULTS The readability scores for the original excerpts from the online calculator and ChatGPT 3.5 were similar. The simplified excerpts' scores were lower than the originals, with a mean of 7.28, less than the maximum recommended 8. CONCLUSIONS The use of ChatGPT 3.5 for the purpose of simplification and readability analysis of patient-facing hand surgery materials is efficient and may help facilitate the conveyance of important health information. ChatGPT 3.5 rendered readability scores comparable with traditional readability calculators, in addition to excerpt-specific feedback. It was also able to simplify materials to the recommended grade levels. CLINICAL RELEVANCE By confirming ChatGPT3.5's ability to assess and simplify patient education materials, this study offers a practical solution for potentially improving patient comprehension, engagement, and health outcomes in clinical settings.
Collapse
Affiliation(s)
- Medha Vallurupalli
- Keck School of Medicine of University of Southern California, Los Angeles, CA; Department of Plastic Surgery, University of California, Irvine, Orange, CA
| | - Nikhil D Shah
- Department of Plastic Surgery, University of California, Irvine, Orange, CA
| | - Raj M Vyas
- Department of Plastic Surgery, University of California, Irvine, Orange, CA; Children's Hospital of Orange County, Orange, CA.
| |
Collapse
|
2
|
Gomez-Cabello CA, Borna S, Pressman SM, Haider SA, Sehgal A, Leibovich BC, Forte AJ. Artificial Intelligence in Postoperative Care: Assessing Large Language Models for Patient Recommendations in Plastic Surgery. Healthcare (Basel) 2024; 12:1083. [PMID: 38891158 PMCID: PMC11171524 DOI: 10.3390/healthcare12111083] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2024] [Revised: 05/13/2024] [Accepted: 05/23/2024] [Indexed: 06/21/2024] Open
Abstract
Since their release, the medical community has been actively exploring large language models' (LLMs) capabilities, which show promise in providing accurate medical knowledge. One potential application is as a patient resource. This study analyzes and compares the ability of the currently available LLMs, ChatGPT-3.5, GPT-4, and Gemini, to provide postoperative care recommendations to plastic surgery patients. We presented each model with 32 questions addressing common patient concerns after surgical cosmetic procedures and evaluated the medical accuracy, readability, understandability, and actionability of the models' responses. The three LLMs provided equally accurate information, with GPT-3.5 averaging the highest on the Likert scale (LS) (4.18 ± 0.93) (p = 0.849), while Gemini provided significantly more readable (p = 0.001) and understandable responses (p = 0.014; p = 0.001). There was no difference in the actionability of the models' responses (p = 0.830). Although LLMs have shown their potential as adjunctive tools in postoperative patient care, further refinement and research are imperative to enable their evolution into comprehensive standalone resources.
Collapse
Affiliation(s)
| | - Sahar Borna
- Division of Plastic Surgery, Mayo Clinic, Jacksonville, FL 32224, USA
| | | | - Syed Ali Haider
- Division of Plastic Surgery, Mayo Clinic, Jacksonville, FL 32224, USA
| | - Ajai Sehgal
- Center for Digital Health, Mayo Clinic, Rochester, MN 55905, USA
| | - Bradley C. Leibovich
- Center for Digital Health, Mayo Clinic, Rochester, MN 55905, USA
- Department of Urology, Mayo Clinic, Rochester, MN 55905, USA
| | - Antonio J. Forte
- Division of Plastic Surgery, Mayo Clinic, Jacksonville, FL 32224, USA
- Center for Digital Health, Mayo Clinic, Rochester, MN 55905, USA
| |
Collapse
|
3
|
Vallurupalli M, Shah ND, Vyas RM. Validation of ChatGPT 3.5 as a Tool to Optimize Readability of Patient-facing Craniofacial Education Materials. PLASTIC AND RECONSTRUCTIVE SURGERY-GLOBAL OPEN 2024; 12:e5575. [PMID: 38313589 PMCID: PMC10836906 DOI: 10.1097/gox.0000000000005575] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2023] [Accepted: 12/11/2023] [Indexed: 02/06/2024]
Abstract
Background To address patient health literacy, the American Medical Association recommends that readability of patient education materials should not exceed a sixth grade reading level; the National Institutes of Health recommend no greater than an eigth-grade reading level. However, patient-facing materials in plastic surgery often remain at an above-recommended average reading level. The purpose of this study was to evaluate ChatGPT 3.5 as a tool for optimizing patient-facing craniofacial education materials. Methods Eighteen patient-facing craniofacial education materials were evaluated for readability by a traditional calculator and ChatGPT 3.5. The resulting scores were compared. The original excerpts were then inputted to ChatGPT 3.5 and simplified by the artificial intelligence tool. The simplified excerpts were scored by the calculators. Results The difference in scores for the original excerpts between the online calculator and ChatGPT 3.5 were not significant (P = 0.441). Additionally, the simplified excerpts' scores were significantly lower than the originals (P < 0.001), and the mean of the simplified excerpts was 7.78, less than the maximum recommended 8. Conclusions The use of ChatGPT 3.5 for simplification and readability analysis of patient-facing craniofacial materials is efficient and may help facilitate the conveyance of important health information. ChatGPT 3.5 rendered readability scores comparable to traditional readability calculators, in addition to excerpt-specific feedback. It was also able to simplify materials to the recommended grade levels. With human oversight, we validate this tool for readability analysis and simplification.
Collapse
Affiliation(s)
- Medha Vallurupalli
- From the Keck School of Medicine of USC, Los Angeles, Calif
- Department of Plastic Surgery, University of California, Irvine, Calif
| | - Nikhil D. Shah
- Department of Plastic Surgery, University of California, Irvine, Calif
| | - Raj M. Vyas
- Department of Plastic Surgery, University of California, Irvine, Calif
- CHOC Children’s Hospital of Orange County, Orange, Calif
| |
Collapse
|
4
|
Health Literacy in Plastic Surgery: A Scoping Review. Plast Reconstr Surg Glob Open 2022; 10:e4247. [PMID: 35433155 PMCID: PMC9007188 DOI: 10.1097/gox.0000000000004247] [Citation(s) in RCA: 16] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2021] [Accepted: 02/10/2022] [Indexed: 11/30/2022]
Abstract
Health literacy of plastic surgery patients may affect surgical decision-making and perioperative outcomes. In addition to consulting a plastic surgeon, patients often refer to online-based resources to learn about surgical options. The aim of this scoping review was to identify evidence detailing the state of health literacy of plastic surgery patients and available resources to highlight areas of improvement for clinical practice and future research.
Collapse
|
5
|
|
6
|
Soteropulos CE, Poore SO. Navigating the Gray of Academic Publication: Avoiding Predatory Publishers and Creating Your "Whitelist". Ann Plast Surg 2021; 87:e171-e179. [PMID: 34818289 DOI: 10.1097/sap.0000000000002902] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
ABSTRACT Academic publishing has undergone a transition from print-based, subscription access journals targeted toward physicians and scientists to the widely accessible, open access (OA) format made possible by the Internet. The objectives of OA broadly include audience expansion and improved public access to publicly funded research, reduction of limitations on content reuse and alteration, and prompt turnaround from submission to publication. Despite well-intended founding principles, unexpected disadvantages of the OA model have arisen including the emergence of predatory journals, which exploit the author-pays publishing model with the deceptive promise of reputable publishing platforms. Predatory journals can be difficult to discern from the legitimate yet unsophisticated novice journal, which represents a destructive influence on the credibility of surgeons and scientists within many specialties. As an author, when the highly reputable, "whitelisted" journals in our field are not available or interested in the scope of our work, how can we ensure authenticity of those journals that exist in the gray area between legitimate and illegitimate? Given these questions, the goal of this article is to demystify the history and selected issues that surround academic publication including content access, licensing, indexing, and journal metrics. With this background, we then evaluate highly visible OA journals in plastic and reconstructive surgery and build a basic framework, which authors can use to evaluate a journal for legitimacy and visibility.
Collapse
Affiliation(s)
- Carol E Soteropulos
- From the Division of Plastic Surgery, University of Wisconsin School of Medicine and Public Health, Madison, WI
| | | |
Collapse
|
7
|
Peymani A, Lokhorst MM, Chen AD, van der Horst CMAM, Lee BT, Lin SJ, Strackee SD. #MadelungDeformity: Insights Into a Rare Congenital Difference Using Social Media. Hand (N Y) 2021; 18:24S-31S. [PMID: 34772284 PMCID: PMC10052623 DOI: 10.1177/15589447211054133] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
BACKGROUND Madelung deformity is a rare congenital hand difference with little known regarding the patient perspective. In this cross-sectional survey study, we harnessed the global reach of social media to understand the clinical spectrum of Madelung deformity and its impact on physical, mental, and social health. METHODS A survey was developed based on a previously published protocol and multiple Patient-Reported Outcomes Measurement Information System (PROMIS) short forms. The survey was distributed on several Madelung deformity communities on Facebook and Instagram. T-scores were calculated, interpreted, and compared between patients who underwent surgery and those who did not. Correlations between scores were calculated using the Spearman rank correlation coefficient. RESULTS Mean PROMIS scores for adults were as follows: pain intensity, 4.9 ± 2.8; pain interference, 57.6 ± 10.0; upper extremity, 35.2 ± 8.1; depression, 53.8 ± 11.1; anxiety, 55.4 ± 11.4; and ability to participate in social roles and activities, 42.5 ± 7.7. Mean scores for children were as follows: pain intensity, 5.0 ± 2.8; pain interference, 55.7 ± 11.3; upper extremity function, 24.6 ± 10.4; depressive symptoms, 57.7 ± 11.3; anxiety, 57.3 ± 11.9; and peer relationships, 42.2 ± 10.3. CONCLUSIONS Madelung deformity has significant effects on patients' physical, mental, and social well-being, even after surgical treatment. Using social media, we were able to compensate for Madelung deformity's rarity by engaging an international audience, demonstrating the feasibility to conduct research through it, and providing a global perspective of the disease entity.
Collapse
Affiliation(s)
- Abbas Peymani
- University of Amsterdam, The Netherlands.,Harvard Medical School, Boston, MA, USA
| | | | | | | | | | | | | |
Collapse
|
8
|
Nischwitz SP, Luze H, Rauch K, Lemelman BT, Heine-Geldern A, Rappl T, Gualdi A, Kamolz LP, Maldonado AA. Analysis of social media use by European plastic surgery societies: A missing link for #PlasticSurgery. PLoS One 2021; 16:e0258120. [PMID: 34648527 PMCID: PMC8516210 DOI: 10.1371/journal.pone.0258120] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2021] [Accepted: 09/17/2021] [Indexed: 11/18/2022] Open
Abstract
PURPOSE The field of Plastic Surgery is prominent on social media around the world. Board certified plastic surgeons and societies of plastic surgery play a role in providing accurate, evidence-based information to the public, patients, and colleagues. The aim of this study was to explore the use of social media by European Plastic Surgery Societies. METHODS AND MATERIALS A retrospective analysis of the presence and activity of European Plastic Surgery Societies on Facebook, Twitter and Instagram was conducted between December 12th 2018 and December 12th 2019. The results have been compared to the American Society of Plastic Surgeons. RESULTS Twenty, eleven and nine European societies yielded an active account on Facebook, Twitter and Instagram respectively. Only seven European societies had an account on all three platforms and were therefore considered polypresent. The amount of followers of those seven societies was significantly higher than of the others (p-value = 0.02). Their activity yielded significantly more posts on Facebook (p-value = 0.02). The American Society of Plastic Surgeons had more followers on all three platforms than all European societies combined. CONCLUSION Social media are still rather unexploited by European Plastic Surgery Societies. A tendency towards increased visibility can be observed, yet a higher penetration is required to further educate and engage through social media. The quantitative data provided serve as reasonable foundation for further studies and a guide for growth of #PlasticSurgery.
Collapse
Affiliation(s)
- Sebastian P. Nischwitz
- Division of Plastic, Aesthetic and Reconstructive Surgery, Department of Surgery, Medical University Graz, Graz, Austria
- COREMED – Cooperative Centre for Regenerative Medicine, JOANNEUM RESEARCH Forschungsgesellschaft mbH, Graz, Austria
| | - Hanna Luze
- Division of Plastic, Aesthetic and Reconstructive Surgery, Department of Surgery, Medical University Graz, Graz, Austria
- COREMED – Cooperative Centre for Regenerative Medicine, JOANNEUM RESEARCH Forschungsgesellschaft mbH, Graz, Austria
| | | | - Benjamin T. Lemelman
- Section of Plastic Surgery, Department of Surgery, Advocate Illinois Masonic Medical Center, Chicago, Illinois, United States of America
| | - Albrecht Heine-Geldern
- Department of Plastic, Hand and Reconstructive Surgery, BG Trauma Center Frankfurt am Main, Academic Hospital of the Goethe University Frankfurt am Main, Frankfurt am Main, Germany
| | - Thomas Rappl
- Division of Plastic, Aesthetic and Reconstructive Surgery, Department of Surgery, Medical University Graz, Graz, Austria
- COREMED – Cooperative Centre for Regenerative Medicine, JOANNEUM RESEARCH Forschungsgesellschaft mbH, Graz, Austria
| | | | - Lars-Peter Kamolz
- Division of Plastic, Aesthetic and Reconstructive Surgery, Department of Surgery, Medical University Graz, Graz, Austria
- COREMED – Cooperative Centre for Regenerative Medicine, JOANNEUM RESEARCH Forschungsgesellschaft mbH, Graz, Austria
| | - Andres A. Maldonado
- Department of Plastic, Hand and Reconstructive Surgery, BG Trauma Center Frankfurt am Main, Academic Hospital of the Goethe University Frankfurt am Main, Frankfurt am Main, Germany
- Department of Plastic Surgery, University Hospital Getafe, Madrid, Spain
| |
Collapse
|
9
|
Atiyeh BS, Chahine F, Abou Ghanem O. Social Media and Plastic Surgery Practice Building: A Thin Line Between Efficient Marketing, Professionalism, and Ethics. Aesthetic Plast Surg 2021; 45:1310-1321. [PMID: 32964279 DOI: 10.1007/s00266-020-01961-2] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2020] [Accepted: 09/05/2020] [Indexed: 11/25/2022]
Abstract
Social media sites and platforms have grown in numbers with an enormous potential to reach and disseminate information in real time. They are impacting tremendously for better or for worse on the current practice of plastic surgery. As the demand for elective plastic surgery, in particular for aesthetic procedures, continues to rise, there is a need to determine the influence of social media advertisements and how it motivates the public to undergo cosmetic procedures. Most importantly, there is an urgent need to determine how the social media are impacting plastic surgery practice building and what is proper and efficient marketing while upholding ethics of the medical profession? A thorough PICO tool-based comprehensive literature search was conducted. Fifty-one peer-reviewed publications, 15 patient-centered, 33 provider-centered, and three combined patient/provider were identified to be relevant to the use of social media in plastic surgery and were selected for this review. Evidence on how social media influences the medical practice and helps in practice building remains scarce; nevertheless, reliance of plastic surgeons on social media to improve their practice has been increasing steadily. Social media may be a powerful tool to promote one's career. It presents, however, serious professional, legal, and ethical challenges including maintenance of professionalism and protecting patient confidentiality. If misused, it may be a quick way to end a plastic surgery practice.Level of Evidence V This journal requires that authors assign a level of evidence to each article. For a full description of these Evidence-Based Medicine ratings, please refer to the Table of Contents or the online Instructions to Authors www.springer.com/00266 .
Collapse
Affiliation(s)
- Bishara S Atiyeh
- Division of Plastic and Reconstructive Surgery, American University of Beirut Medical Center, Beirut, Lebanon
| | | | - Odette Abou Ghanem
- Division of Plastic and Reconstructive Surgery, American University of Beirut Medical Center, Beirut, Lebanon.
| |
Collapse
|
10
|
Pakhchanian H, Yuan M, Raiker R, Waris S, Geist C. Readability Analysis of the American Society of Ophthalmic Plastic & Reconstructive Surgery Patient Educational Brochures. Semin Ophthalmol 2021; 37:77-82. [PMID: 33975496 DOI: 10.1080/08820538.2021.1919721] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Abstract
INTRODUCTION Previous studies have shown patient education material (PEM) in ophthalmology has been written at levels exceeding appropriate reading levels. However, information for readability in the field of oculoplastics remains limited. The aim of this study was to evaluate the readability of patient educational brochures from the American Society of Ophthalmic Plastic & Reconstructive Surgery (ASOPRS). METHODS Patient educational brochures from ASOPRS were analyzed for readability. The body of text from all 18 ASOPRS patient brochures was analyzed by ten validated tests for English readability assessment: Flesch Reading Ease Test (FRE), Flesch-Kincaid Grade Level (FKGL), Simple Measure of Gobbledygook (SMOG), Coleman-Liau Index (CLI), Gunning Fog Index (GFI), New Dale-Chall Readability (NDC), FORCAST, Fry Graph Readability (FG), Raygor Readability Estimate (RRE), and New Fog Count (NFC). RESULTS The mean (± SD) readability scores from the 18 ASOPRS patient brochures were 48 (4.3), 11.0 (0.8), 13.0 (0.7), 11.7 (0.8), 13.6 (0.9), 11.3 (0.8), 11.1 (0.5), 12.1 (1.5), 12.2 (1.0), and 10.6 (1.3) for FRE, FKGL, SMOG, CLI, GFI, NDC, FORCAST, FG, RRE, and NFC, respectively. All ten of the mean readability scores were above the recommended reading levels. CONCLUSIONS These findings show that the average patient may have difficulty understanding educational information provided by ASOPRS patient brochures, thereby hindering their ability to make informed decisions on their healthcare. Revision with readability as a primary goal, with input from patients and caregivers, may be necessary to improve health literacy among patients who seek oculoplastic care.
Collapse
Affiliation(s)
- Haig Pakhchanian
- Department of Ophthalmology, George Washington University School of Medicine & Health Science, Washington DC, USA
| | - Mellissa Yuan
- Department of Ophthalmology, Weill Cornell Medicine: Medical College, New York, NY, USA
| | - Rahul Raiker
- Department of Ophthalmology and Visual Sciences, West Virginia University School of Medicine, Morgantown, WV, USA
| | - Shanawar Waris
- Department of Ophthalmology and Visual Sciences, West Virginia University School of Medicine, Morgantown, WV, USA
| | - Craig Geist
- Department of Ophthalmology, George Washington University School of Medicine & Health Science, Washington DC, USA
| |
Collapse
|
11
|
Keane G, Chi D, Ha AY, Myckatyn TM. En Bloc Capsulectomy for Breast Implant Illness: A Social Media Phenomenon? Aesthet Surg J 2021; 41:448-459. [PMID: 32940709 DOI: 10.1093/asj/sjaa203] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022] Open
Abstract
BACKGROUND En bloc capsulectomy has recently increased in prominence as a potential surgical therapy for patients with breast implant illness (BII). However, this procedure has chiefly been recommended for treating breast implant-associated anaplastic large cell lymphoma (BIA-ALCL). OBJECTIVES This study aimed to review the current literature and evaluate the public understanding of treatment options for BII via social media to characterize any potential communication disconnect between clinicians and patients. METHODS An electronic literature review was performed to identify all available publications mentioning evidence-based support for en bloc capsulectomy as treatment for BII and BIA-ALCL. Twitter social media posts referencing BII or BIA-ALCL were analyzed from 2010 to 2019. Author identity and any mention of surgical treatment were assessed. RESULTS A total of 115 publications on the subject of BII and 315 articles on BIA-ALCL were identified. En bloc resection was recommended only for patients with a diagnosis of BIA-ALCL. A total of 6419 tweets referencing BII and 6431 tweets referencing BIA-ALCL were identified. Tweets referencing BIA-ALCL were significantly more likely to be authored by physicians (25.9% vs 5.3%, P < 0.001), and tweets referencing BII were significantly more likely to mention any surgical treatment (7.8% vs 1.9%, P < 0.001) and en bloc capsulectomy (1.4% vs 0.3%, P < 0.001). CONCLUSIONS This study demonstrates that a communication disconnect exists between the scientific literature and social media regarding treatment options for BII and BIA-ALCL. Physicians should be aware of these potential misconceptions to empathetically address patient concerns in a patient-centered manner.
Collapse
Affiliation(s)
- Grace Keane
- From the Division of Plastic and Reconstructive Surgery, Washington University School of Medicine, Saint Louis, MO
| | - David Chi
- From the Division of Plastic and Reconstructive Surgery, Washington University School of Medicine, Saint Louis, MO
| | - Austin Y Ha
- From the Division of Plastic and Reconstructive Surgery, Washington University School of Medicine, Saint Louis, MO
| | - Terence M Myckatyn
- From the Division of Plastic and Reconstructive Surgery, Washington University School of Medicine, Saint Louis, MO
| |
Collapse
|
12
|
Parizh D, Effendi M, Dale E, Slater J. Assessing the Quality and Reliability of Patient Information Regarding First-Aid for Acute Burns on YouTube. J Burn Care Res 2021; 42:228-231. [PMID: 32840623 DOI: 10.1093/jbcr/iraa135] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
Given ever increasing ease of access to technology, the majority of adults first turn to the internet for medical advice. The world wide web is filled with user-generated content within multiple social media platforms that lack a governing body to validate the information's accuracy and reliability. The authors performed a qualitative review of first-aid burn resources available on YouTube using two validated scales: Modified Discern and Global Quality Scale. A search was conducted using the term "burn treatment" on September 18, 2019. Of 120 reviewed videos, 59 met their inclusion criteria. 36% (n = 21) of the speakers had formal medical training, with only 12% (n = 7) identified as burn care professionals. The mean views originating from nonmedical speakers (162,675) were more than eight times that originating from burn centers (14,975). The quality of the videos was compared by video source, speaker, and specialty. Burn centers had the highest Modified Discern and Global Quality Scale scores, 2.91 and 2.86, respectively (P < .05). Additionally, the authors were able to demonstrate that there was a statistically significant higher quality of videos when the speaker was a burn care professional or had formal medical training. Unfortunately, their review demonstrated that videos originating from hospital systems and burn centers made up a minority of the online media content. These results illustrate an opportunity for improvement by way of increased content creation to bolster the online presence of the burn community and provide patients with more accurate information.
Collapse
Affiliation(s)
- David Parizh
- Department of Surgery, Division of Plastic, Reconstructive, Hand and Burn Surgery, University of Cincinnati Medical Center, Ohio
| | - Maleeh Effendi
- Department of Surgery, Division of Plastic, Reconstructive, Hand and Burn Surgery, University of Cincinnati Medical Center, Ohio
| | - Elizabeth Dale
- Department of Surgery, Division of Plastic, Reconstructive, Hand and Burn Surgery, University of Cincinnati Medical Center, Ohio
| | - Julia Slater
- Department of Surgery, Division of Plastic, Reconstructive, Hand and Burn Surgery, University of Cincinnati Medical Center, Ohio
| |
Collapse
|
13
|
Linzey JR, Robertson F, Haider AS, Graffeo CS, Wang JZ, Shasby G, Alotaibi NM, Cohen-Gadol AA, Rutka JT. Online Impact and Presence of a Specialized Social Media Team for the Journal of Neurosurgery: Descriptive Analysis. J Med Internet Res 2020; 22:e17741. [PMID: 32163371 PMCID: PMC7267990 DOI: 10.2196/17741] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2020] [Revised: 03/03/2020] [Accepted: 03/05/2020] [Indexed: 02/01/2023] Open
Abstract
Background Social media use continues to gain momentum in academic neurosurgery. To increase journal impact and broaden engagement, many scholarly publications have turned to social media to disseminate research. The Journal of Neurosurgery Publishing Group (JNSPG) established a dedicated, specialized social media team (SMT) in November 2016 to provide targeted improvement in digital outreach. Objective The goal of this study was to examine the impact of the JNSPG SMT as measured by increased engagement. Methods We analyzed various metrics, including impressions, engagements, retweets, likes, profile clicks, and URL clicks, from consecutive social media posts from the JNSPG’s Twitter and Facebook platforms between February 1, 2015 and February 28, 2019. Standard descriptive statistics were utilized. Results Between February 2015 and October 2016, when a specialized SMT was created, 170 tweets (8.1 tweets/month) were posted compared to 3220 tweets (115.0 tweets/month) between November 2016 and February 2019. All metrics significantly increased, including the impressions per tweet (mean 1646.3, SD 934.9 vs mean 4605.6, SD 65,546.5; P=.01), engagements per tweet (mean 35.2, SD 40.6 vs mean 198.2, SD 1037.2; P<.001), retweets (mean 2.5, SD 2.8 vs mean 10.5, SD 15.3; P<.001), likes (mean 2.5, SD 4.0 vs mean 18.0, SD 37.9; P<.001), profile clicks (mean 1.5, SD 2.0 vs mean 5.2, SD 43.3; P<.001), and URL clicks (mean 13.1, SD 14.9 vs mean 38.3, SD 67.9; P<.001). Tweets that were posted on the weekend compared to weekdays had significantly more retweets (mean 9.2, SD 9.8 vs mean 13.4, SD 25.6; P<.001), likes (mean 15.3, SD 17.9 vs mean 23.7, SD 70.4; P=.001), and URL clicks (mean 33.4, SD 40.5 vs mean 49.5, SD 117.3; P<.001). Between November 2015 and October 2016, 49 Facebook posts (2.3 posts/month) were sent compared to 2282 posts (81.5 posts/month) sent between November 2016 and February 2019. All Facebook metrics significantly increased, including impressions (mean 5475.9, SD 5483.0 vs mean 8506.1, SD 13,113.9; P<.001), engagements (mean 119.3, SD 194.8 vs mean 283.8, SD 733.8; P<.001), and reach (mean 2266.6, SD 2388.3 vs mean 5344.1, SD 8399.2; P<.001). Weekend Facebook posts had significantly more impressions per post (mean 7967.9, SD 9901.0 vs mean 9737.8, SD 19,013.4; P=.03) and a higher total reach (mean 4975.8, SD 6309.8 vs mean 6108.2, SD 12,219.7; P=.03) than weekday posts. Conclusions Social media has been established as a crucial tool for the propagation of neurosurgical research and education. Implementation of the JNSPG specialized SMT had a demonstrable impact on increasing the online visibility of social media content.
Collapse
Affiliation(s)
- Joseph R Linzey
- Department of Neurosurgery, University of Michigan, Ann Arbor, MI, United States
| | - Faith Robertson
- Department of Neurosurgery, Massachusetts General Hospital and Harvard Medical School, Boston, MA, United States
| | - Ali S Haider
- Department of Industrial and Systems Engineering, Texas A&M University, College Station, TX, United States
| | | | - Justin Z Wang
- Division of Neurosurgery, Faculty of Kinesiology and Physical Education, University of Toronto, Toronto, ON, Canada
| | - Gillian Shasby
- Journal of Neurosurgery Publishing Group, Charlottesville, VA, United States
| | - Naif M Alotaibi
- Department of Neurosurgery, Massachusetts General Hospital and Harvard Medical School, Boston, MA, United States
| | - Aaron A Cohen-Gadol
- Department of Neurological Surgery, Indiana University, Indianapolis, IN, United States
| | - James T Rutka
- Division of Neurosurgery, Faculty of Kinesiology and Physical Education, University of Toronto, Toronto, ON, Canada
| |
Collapse
|
14
|
|