1
|
Cerda IH, Zhang E, Dominguez M, Ahmed M, Lang M, Ashina S, Schatman ME, Yong RJ, Fonseca ACG. Artificial Intelligence and Virtual Reality in Headache Disorder Diagnosis, Classification, and Management. Curr Pain Headache Rep 2024:10.1007/s11916-024-01279-7. [PMID: 38836996 DOI: 10.1007/s11916-024-01279-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/20/2024] [Indexed: 06/06/2024]
Abstract
PURPOSE OF REVIEW This review provides an overview of the current and future role of artificial intelligence (AI) and virtual reality (VR) in addressing the complexities inherent to the diagnosis, classification, and management of headache disorders. RECENT FINDINGS Through machine learning and natural language processing approaches, AI offers unprecedented opportunities to identify patterns within complex and voluminous datasets, including brain imaging data. This technology has demonstrated promise in optimizing diagnostic approaches to headache disorders and automating their classification, an attribute particularly beneficial for non-specialist providers. Furthermore, AI can enhance headache disorder management by enabling the forecasting of acute events of interest, such as migraine headaches or medication overuse, and by guiding treatment selection based on insights from predictive modeling. Additionally, AI may facilitate the streamlining of treatment efficacy monitoring and enable the automation of real-time treatment parameter adjustments. VR technology, on the other hand, offers controllable and immersive experiences, thus providing a unique avenue for the investigation of the sensory-perceptual symptomatology associated with certain headache disorders. Moreover, recent studies suggest that VR, combined with biofeedback, may serve as a viable adjunct to conventional treatment. Addressing challenges to the widespread adoption of AI and VR in headache medicine, including reimbursement policies and data privacy concerns, mandates collaborative efforts from stakeholders to enable the equitable, safe, and effective utilization of these technologies in advancing headache disorder care. This review highlights the potential of AI and VR to support precise diagnostics, automate classification, and enhance management strategies for headache disorders.
Collapse
Affiliation(s)
| | - Emily Zhang
- Harvard Medical School, Boston, MA, USA
- Department of Anesthesiology, Critical Care, and Pain Medicine, Massachusetts General Hospital, Boston, MA, USA
| | - Moises Dominguez
- Department of Neurology, Weill Cornell Medical College, New York Presbyterian Hospital, New York, NY, USA
| | | | - Min Lang
- Harvard Medical School, Boston, MA, USA
- Department of Radiology, Massachusetts General Hospital, Boston, MA, USA
| | - Sait Ashina
- Harvard Medical School, Boston, MA, USA
- Department of Neurology, Beth Israel Deaconess Medical Center, Boston, MA, USA
- Department of Anesthesiology, Critical Care, and Pain Medicine, Beth Israel Deaconess Medical Center, Boston, MA, USA
| | - Michael E Schatman
- Department of Anesthesiology, Perioperative Care, and Pain Medicine, NYU Grossman School of Medicine, New York, NY, USA
- Department of Population Health-Division of Medical Ethics, NYU Grossman School of Medicine, New York, NY, USA
| | - R Jason Yong
- Harvard Medical School, Boston, MA, USA
- Brigham and Women's Hospital, Department of Anesthesiology, Perioperative, and Pain Medicine, 75 Francis Street, Boston, MA, 02115, USA
| | - Alexandra C G Fonseca
- Harvard Medical School, Boston, MA, USA.
- Brigham and Women's Hospital, Department of Anesthesiology, Perioperative, and Pain Medicine, 75 Francis Street, Boston, MA, 02115, USA.
| |
Collapse
|
2
|
Mazzolenis ME, Bulat E, Schatman ME, Gumb C, Gilligan CJ, Yong RJ. The Ethical Stewardship of Artificial Intelligence in Chronic Pain and Headache: A Narrative Review. Curr Pain Headache Rep 2024:10.1007/s11916-024-01272-0. [PMID: 38809404 DOI: 10.1007/s11916-024-01272-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/04/2024] [Indexed: 05/30/2024]
Abstract
PURPOSE OF REVIEW As artificial intelligence (AI) and machine learning (ML) are becoming more pervasive in medicine, understanding their ethical considerations for chronic pain and headache management is crucial for optimizing their safety. RECENT FINDINGS We reviewed thirty-eight editorial and original research articles published between 2018 and 2023, focusing on the application of AI and ML to chronic pain or headache. The core medical principles of beneficence, non-maleficence, autonomy, and justice constituted the evaluation framework. The AI applications addressed topics such as pain intensity prediction, diagnostic aides, risk assessment for medication misuse, empowering patients to self-manage their conditions, and optimizing access to care. Virtually all AI applications aligned both positively and negatively with specific medical ethics principles. This review highlights the potential of AI to enhance patient outcomes and physicians' experiences in managing chronic pain and headache. We emphasize the importance of carefully considering the advantages, disadvantages, and unintended consequences of utilizing AI tools in chronic pain and headache, and propose the four core principles of medical ethics as an evaluation framework.
Collapse
Affiliation(s)
- Maria Emilia Mazzolenis
- John A. Paulson School of Engineering and Applied Sciences, Harvard University, Cambridge, MA, USA
| | - Evgeny Bulat
- Department of Anesthesiology, Perioperative and Pain Medicine, Brigham and Women's Hospital, Harvard Medical School, 75 Francis Street, Boston, 02115, MA, USA
| | - Michael E Schatman
- Department of Anesthesiology, Perioperative Care, and Pain Medicine, Department of Population Health - Division of Medical Ethics, New York University Grossman School of Medicine, New York, NY, USA
| | - Chris Gumb
- John A. Paulson School of Engineering and Applied Sciences, Harvard University, Cambridge, MA, USA
| | - Christopher J Gilligan
- Department of Anesthesiology, Robert Wood Johnson University Hospital, Rutgers Robert Wood Johnson Medical School, New Brunswick, NJ, USA
| | - Robert J Yong
- Department of Anesthesiology, Perioperative and Pain Medicine, Brigham and Women's Hospital, Harvard Medical School, 75 Francis Street, Boston, 02115, MA, USA.
| |
Collapse
|
3
|
Chiang CC, Luo M, Dumkrieger G, Trivedi S, Chen YC, Chao CJ, Schwedt TJ, Sarker A, Banerjee I. A large language model-based generative natural language processing framework fine-tuned on clinical notes accurately extracts headache frequency from electronic health records. Headache 2024; 64:400-409. [PMID: 38525734 DOI: 10.1111/head.14702] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2023] [Revised: 02/18/2024] [Accepted: 02/19/2024] [Indexed: 03/26/2024]
Abstract
OBJECTIVE To develop a natural language processing (NLP) algorithm that can accurately extract headache frequency from free-text clinical notes. BACKGROUND Headache frequency, defined as the number of days with any headache in a month (or 4 weeks), remains a key parameter in the evaluation of treatment response to migraine preventive medications. However, due to the variations and inconsistencies in documentation by clinicians, significant challenges exist to accurately extract headache frequency from the electronic health record (EHR) by traditional NLP algorithms. METHODS This was a retrospective cross-sectional study with patients identified from two tertiary headache referral centers, Mayo Clinic Arizona and Mayo Clinic Rochester. All neurology consultation notes written by 15 specialized clinicians (11 headache specialists and 4 nurse practitioners) between 2012 and 2022 were extracted and 1915 notes were used for model fine-tuning (90%) and testing (10%). We employed four different NLP frameworks: (1) ClinicalBERT (Bidirectional Encoder Representations from Transformers) regression model, (2) Generative Pre-Trained Transformer-2 (GPT-2) Question Answering (QA) model zero-shot, (3) GPT-2 QA model few-shot training fine-tuned on clinical notes, and (4) GPT-2 generative model few-shot training fine-tuned on clinical notes to generate the answer by considering the context of included text. RESULTS The mean (standard deviation) headache frequency of our training and testing datasets were 13.4 (10.9) and 14.4 (11.2), respectively. The GPT-2 generative model was the best-performing model with an accuracy of 0.92 (0.91, 0.93, 95% confidence interval [CI]) and R2 score of 0.89 (0.87, 0.90, 95% CI), and all GPT-2-based models outperformed the ClinicalBERT model in terms of exact matching accuracy. Although the ClinicalBERT regression model had the lowest accuracy of 0.27 (0.26, 0.28), it demonstrated a high R2 score of 0.88 (0.85, 0.89), suggesting the ClinicalBERT model can reasonably predict the headache frequency within a range of ≤ ± 3 days, and the R2 score was higher than the GPT-2 QA zero-shot model or GPT-2 QA model few-shot training fine-tuned model. CONCLUSION We developed a robust information extraction model based on a state-of-the-art large language model, a GPT-2 generative model that can extract headache frequency from EHR free-text clinical notes with high accuracy and R2 score. It overcame several challenges related to different ways clinicians document headache frequency that were not easily achieved by traditional NLP models. We also showed that GPT-2-based frameworks outperformed ClinicalBERT in terms of accuracy in extracting headache frequency from clinical notes. To facilitate research in the field, we released the GPT-2 generative model and inference code with open-source license of community use in GitHub. Additional fine-tuning of the algorithm might be required when applied to different health-care systems for various clinical use cases.
Collapse
Affiliation(s)
| | - Man Luo
- Department of Radiology, Mayo Clinic, Phoenix, Arizona, USA
| | | | | | - Yi-Chieh Chen
- Department of Pharmacy, Mayo Clinic, Rochester, Minnesota, USA
| | - Chieh-Ju Chao
- Department of Cardiology, Mayo Clinic, Rochester, Minnesota, USA
| | - Todd J Schwedt
- Department of Neurology, Mayo Clinic, Phoenix, Arizona, USA
| | - Abeed Sarker
- Department of Biomedical Informatics, School of Medicine, Emory University, Atlanta, Georgia, USA
| | - Imon Banerjee
- Department of Radiology, Mayo Clinic, Phoenix, Arizona, USA
- School of Computing and Augmented Intelligence, Arizona State University, Tempe, Arizona, USA
| |
Collapse
|
4
|
Torrente A, Maccora S, Prinzi F, Alonge P, Pilati L, Lupica A, Di Stefano V, Camarda C, Vitabile S, Brighina F. The Clinical Relevance of Artificial Intelligence in Migraine. Brain Sci 2024; 14:85. [PMID: 38248300 PMCID: PMC10813497 DOI: 10.3390/brainsci14010085] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2023] [Revised: 01/09/2024] [Accepted: 01/11/2024] [Indexed: 01/23/2024] Open
Abstract
Migraine is a burdensome neurological disorder that still lacks clear and easily accessible diagnostic biomarkers. Furthermore, a straightforward pathway is hard to find for migraineurs' management, so the search for response predictors has become urgent. Nowadays, artificial intelligence (AI) has pervaded almost every aspect of our lives, and medicine has not been missed. Its applications are nearly limitless, and the ability to use machine learning approaches has given researchers a chance to give huge amounts of data new insights. When it comes to migraine, AI may play a fundamental role, helping clinicians and patients in many ways. For example, AI-based models can increase diagnostic accuracy, especially for non-headache specialists, and may help in correctly classifying the different groups of patients. Moreover, AI models analysing brain imaging studies reveal promising results in identifying disease biomarkers. Regarding migraine management, AI applications showed value in identifying outcome measures, the best treatment choices, and therapy response prediction. In the present review, the authors introduce the various and most recent clinical applications of AI regarding migraine.
Collapse
Affiliation(s)
- Angelo Torrente
- Department of Biomedicine, Neuroscience and Advanced Diagnostics (Bi.N.D.), University of Palermo, 90127 Palermo, Italy; (A.T.); (S.M.); (F.P.); (P.A.); (L.P.); (A.L.); (V.D.S.); (C.C.); (S.V.)
| | - Simona Maccora
- Department of Biomedicine, Neuroscience and Advanced Diagnostics (Bi.N.D.), University of Palermo, 90127 Palermo, Italy; (A.T.); (S.M.); (F.P.); (P.A.); (L.P.); (A.L.); (V.D.S.); (C.C.); (S.V.)
- Neurology Unit, ARNAS Civico di Cristina and Benfratelli Hospitals, 90127 Palermo, Italy
| | - Francesco Prinzi
- Department of Biomedicine, Neuroscience and Advanced Diagnostics (Bi.N.D.), University of Palermo, 90127 Palermo, Italy; (A.T.); (S.M.); (F.P.); (P.A.); (L.P.); (A.L.); (V.D.S.); (C.C.); (S.V.)
- Department of Computer Science and Technology, University of Cambridge, Cambridge CB2 1TN, UK
| | - Paolo Alonge
- Department of Biomedicine, Neuroscience and Advanced Diagnostics (Bi.N.D.), University of Palermo, 90127 Palermo, Italy; (A.T.); (S.M.); (F.P.); (P.A.); (L.P.); (A.L.); (V.D.S.); (C.C.); (S.V.)
| | - Laura Pilati
- Department of Biomedicine, Neuroscience and Advanced Diagnostics (Bi.N.D.), University of Palermo, 90127 Palermo, Italy; (A.T.); (S.M.); (F.P.); (P.A.); (L.P.); (A.L.); (V.D.S.); (C.C.); (S.V.)
- Neurology and Stroke Unit, P.O. “S. Antonio Abate”, 91016 Trapani, Italy
| | - Antonino Lupica
- Department of Biomedicine, Neuroscience and Advanced Diagnostics (Bi.N.D.), University of Palermo, 90127 Palermo, Italy; (A.T.); (S.M.); (F.P.); (P.A.); (L.P.); (A.L.); (V.D.S.); (C.C.); (S.V.)
| | - Vincenzo Di Stefano
- Department of Biomedicine, Neuroscience and Advanced Diagnostics (Bi.N.D.), University of Palermo, 90127 Palermo, Italy; (A.T.); (S.M.); (F.P.); (P.A.); (L.P.); (A.L.); (V.D.S.); (C.C.); (S.V.)
| | - Cecilia Camarda
- Department of Biomedicine, Neuroscience and Advanced Diagnostics (Bi.N.D.), University of Palermo, 90127 Palermo, Italy; (A.T.); (S.M.); (F.P.); (P.A.); (L.P.); (A.L.); (V.D.S.); (C.C.); (S.V.)
| | - Salvatore Vitabile
- Department of Biomedicine, Neuroscience and Advanced Diagnostics (Bi.N.D.), University of Palermo, 90127 Palermo, Italy; (A.T.); (S.M.); (F.P.); (P.A.); (L.P.); (A.L.); (V.D.S.); (C.C.); (S.V.)
| | - Filippo Brighina
- Department of Biomedicine, Neuroscience and Advanced Diagnostics (Bi.N.D.), University of Palermo, 90127 Palermo, Italy; (A.T.); (S.M.); (F.P.); (P.A.); (L.P.); (A.L.); (V.D.S.); (C.C.); (S.V.)
| |
Collapse
|
5
|
Chiang CC, Luo M, Dumkrieger G, Trivedi S, Chen YC, Chao CJ, Schwedt TJ, Sarker A, Banerjee I. A Large Language Model-Based Generative Natural Language Processing Framework Finetuned on Clinical Notes Accurately Extracts Headache Frequency from Electronic Health Records. MEDRXIV : THE PREPRINT SERVER FOR HEALTH SCIENCES 2023:2023.10.02.23296403. [PMID: 37873417 PMCID: PMC10593021 DOI: 10.1101/2023.10.02.23296403] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/25/2023]
Abstract
Background Headache frequency, defined as the number of days with any headache in a month (or four weeks), remains a key parameter in the evaluation of treatment response to migraine preventive medications. However, due to the variations and inconsistencies in documentation by clinicians, significant challenges exist to accurately extract headache frequency from the electronic health record (EHR) by traditional natural language processing (NLP) algorithms. Methods This was a retrospective cross-sectional study with human subjects identified from three tertiary headache referral centers- Mayo Clinic Arizona, Florida, and Rochester. All neurology consultation notes written by more than 10 headache specialists between 2012 to 2022 were extracted and 1915 notes were used for model fine-tuning (90%) and testing (10%). We employed four different NLP frameworks: (1) ClinicalBERT (Bidirectional Encoder Representations from Transformers) regression model (2) Generative Pre-Trained Transformer-2 (GPT-2) Question Answering (QA) Model zero-shot (3) GPT-2 QA model few-shot training fine-tuned on Mayo Clinic notes; and (4) GPT-2 generative model few-shot training fine-tuned on Mayo Clinic notes to generate the answer by considering the context of included text. Results The GPT-2 generative model was the best-performing model with an accuracy of 0.92[0.91 - 0.93] and R2 score of 0.89[0.87, 0.9], and all GPT2-based models outperformed the ClinicalBERT model in terms of the exact matching accuracy. Although the ClinicalBERT regression model had the lowest accuracy 0.27[0.26 - 0.28], it demonstrated a high R2 score 0.88[0.85, 0.89], suggesting the ClinicalBERT model can reasonably predict the headache frequency within a range of ≤ ± 3 days, and the R2 score was higher than the GPT-2 QA zero-shot model or GPT-2 QA model few-shot training fine-tuned model. Conclusion We developed a robust model based on a state-of-the-art large language model (LLM)- a GPT-2 generative model that can extract headache frequency from EHR free-text clinical notes with high accuracy and R2 score. It overcame several challenges related to different ways clinicians document headache frequency that were not easily achieved by traditional NLP models. We also showed that GPT2-based frameworks outperformed ClinicalBERT in terms of accuracy in extracting headache frequency from clinical notes. To facilitate research in the field, we released the GPT-2 generative model and inference code with open-source license of community use in GitHub.
Collapse
Affiliation(s)
| | - Man Luo
- Department of Radiology, Mayo Clinic, Phoenix, AZ
| | | | | | | | - Chieh-Ju Chao
- Department of Cardiology, Mayo Clinic, Rochester, MN
| | | | - Abeed Sarker
- Department of Biomedical Informatics, School of Medicine, Emory University, Atlanta, GA
| | - Imon Banerjee
- Department of Radiology, Mayo Clinic, Phoenix, AZ
- School of Computing and Augmented Intelligence, Arizona State University
| |
Collapse
|