1
|
Loor-Torres R, Duran M, Toro-Tobon D, Chavez MM, Ponce O, Jacome CS, Torres DS, Perneth SA, Montori V, Golembiewski E, Osorio MB, Fan JW, Ospina NS, Wu Y, Brito JP. A Systematic Review of Natural Language Processing Methods and Applications in Thyroidology. MAYO CLINIC PROCEEDINGS. DIGITAL HEALTH 2024; 2:270-279. [PMID: 38938930 PMCID: PMC11210322 DOI: 10.1016/j.mcpdig.2024.03.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 06/29/2024]
Abstract
This study aimed to review the application of natural language processing (NLP) in thyroid-related conditions and to summarize current challenges and potential future directions. We performed a systematic search of databases for studies describing NLP applications in thyroid conditions published in English between January 1, 2012 and November 4, 2022. In addition, we used a snowballing technique to identify studies missed in the initial search or published after our search timeline until April 1, 2023. For included studies, we extracted the NLP method (eg, rule-based, machine learning, deep learning, or hybrid), NLP application (eg, identification, classification, and automation), thyroid condition (eg, thyroid cancer, thyroid nodule, and functional or autoimmune disease), data source (eg, electronic health records, health forums, medical literature databases, or genomic databases), performance metrics, and stages of development. We identified 24 eligible NLP studies focusing on thyroid-related conditions. Deep learning-based methods were the most common (38%), followed by rule-based (21%), and traditional machine learning (21%) methods. Thyroid nodules (54%) and thyroid cancer (29%) were the primary conditions under investigation. Electronic health records were the dominant data source (17/24, 71%), with imaging reports being the most frequently used (15/17, 88%). There is increasing interest in NLP applications for thyroid-related studies, mostly addressing thyroid nodules and using deep learning-based methodologies with limited external validation. However, none of the reviewed NLP applications have reached clinical practice. Several limitations, including inconsistent clinical documentation and model portability, need to be addressed to promote the evaluation and implementation of NLP applications to support patient care in thyroidology.
Collapse
Affiliation(s)
- Ricardo Loor-Torres
- Knowledge and Evaluation Research Unit (R.L.-T., M.D., M.M.C., C.S.., D.S.T., S.A.P., V.M., E.G., M.B.O., J.P.B.), Division of Endocrinology, Diabetes, Metabolism, and Nutrition (D.T.-T., J.P.B.), Department of Medicine, and Department of Artificial Intelligence and Informatics (N.S.O.), Mayo Clinic, Rochester, MN; University of Edinburgh, Edinburgh, Scotland, United Kingdom (D.S.T.); Montefiore Health Center, Albert Einstein College of Medicine, New York, NY (J.W.F.); Division of Endocrinology, Department of Medicine (N.S.O.), and Department of Health Outcomes and Biomedical Informatics (Y.W.), University of Florida, Gainesville, FL; and Respiratory, Cardiovascular, and Renal Pathobiology and Bioengineering, Universitat de Barcelona, Spain (D.S.T.)
| | - Mayra Duran
- Knowledge and Evaluation Research Unit (R.L.-T., M.D., M.M.C., C.S.., D.S.T., S.A.P., V.M., E.G., M.B.O., J.P.B.), Division of Endocrinology, Diabetes, Metabolism, and Nutrition (D.T.-T., J.P.B.), Department of Medicine, and Department of Artificial Intelligence and Informatics (N.S.O.), Mayo Clinic, Rochester, MN; University of Edinburgh, Edinburgh, Scotland, United Kingdom (D.S.T.); Montefiore Health Center, Albert Einstein College of Medicine, New York, NY (J.W.F.); Division of Endocrinology, Department of Medicine (N.S.O.), and Department of Health Outcomes and Biomedical Informatics (Y.W.), University of Florida, Gainesville, FL; and Respiratory, Cardiovascular, and Renal Pathobiology and Bioengineering, Universitat de Barcelona, Spain (D.S.T.)
| | - David Toro-Tobon
- Knowledge and Evaluation Research Unit (R.L.-T., M.D., M.M.C., C.S.., D.S.T., S.A.P., V.M., E.G., M.B.O., J.P.B.), Division of Endocrinology, Diabetes, Metabolism, and Nutrition (D.T.-T., J.P.B.), Department of Medicine, and Department of Artificial Intelligence and Informatics (N.S.O.), Mayo Clinic, Rochester, MN; University of Edinburgh, Edinburgh, Scotland, United Kingdom (D.S.T.); Montefiore Health Center, Albert Einstein College of Medicine, New York, NY (J.W.F.); Division of Endocrinology, Department of Medicine (N.S.O.), and Department of Health Outcomes and Biomedical Informatics (Y.W.), University of Florida, Gainesville, FL; and Respiratory, Cardiovascular, and Renal Pathobiology and Bioengineering, Universitat de Barcelona, Spain (D.S.T.)
| | - Maria Mateo Chavez
- Knowledge and Evaluation Research Unit (R.L.-T., M.D., M.M.C., C.S.., D.S.T., S.A.P., V.M., E.G., M.B.O., J.P.B.), Division of Endocrinology, Diabetes, Metabolism, and Nutrition (D.T.-T., J.P.B.), Department of Medicine, and Department of Artificial Intelligence and Informatics (N.S.O.), Mayo Clinic, Rochester, MN; University of Edinburgh, Edinburgh, Scotland, United Kingdom (D.S.T.); Montefiore Health Center, Albert Einstein College of Medicine, New York, NY (J.W.F.); Division of Endocrinology, Department of Medicine (N.S.O.), and Department of Health Outcomes and Biomedical Informatics (Y.W.), University of Florida, Gainesville, FL; and Respiratory, Cardiovascular, and Renal Pathobiology and Bioengineering, Universitat de Barcelona, Spain (D.S.T.)
| | - Oscar Ponce
- Knowledge and Evaluation Research Unit (R.L.-T., M.D., M.M.C., C.S.., D.S.T., S.A.P., V.M., E.G., M.B.O., J.P.B.), Division of Endocrinology, Diabetes, Metabolism, and Nutrition (D.T.-T., J.P.B.), Department of Medicine, and Department of Artificial Intelligence and Informatics (N.S.O.), Mayo Clinic, Rochester, MN; University of Edinburgh, Edinburgh, Scotland, United Kingdom (D.S.T.); Montefiore Health Center, Albert Einstein College of Medicine, New York, NY (J.W.F.); Division of Endocrinology, Department of Medicine (N.S.O.), and Department of Health Outcomes and Biomedical Informatics (Y.W.), University of Florida, Gainesville, FL; and Respiratory, Cardiovascular, and Renal Pathobiology and Bioengineering, Universitat de Barcelona, Spain (D.S.T.)
| | - Cristian Soto Jacome
- Knowledge and Evaluation Research Unit (R.L.-T., M.D., M.M.C., C.S.., D.S.T., S.A.P., V.M., E.G., M.B.O., J.P.B.), Division of Endocrinology, Diabetes, Metabolism, and Nutrition (D.T.-T., J.P.B.), Department of Medicine, and Department of Artificial Intelligence and Informatics (N.S.O.), Mayo Clinic, Rochester, MN; University of Edinburgh, Edinburgh, Scotland, United Kingdom (D.S.T.); Montefiore Health Center, Albert Einstein College of Medicine, New York, NY (J.W.F.); Division of Endocrinology, Department of Medicine (N.S.O.), and Department of Health Outcomes and Biomedical Informatics (Y.W.), University of Florida, Gainesville, FL; and Respiratory, Cardiovascular, and Renal Pathobiology and Bioengineering, Universitat de Barcelona, Spain (D.S.T.)
| | - Danny Segura Torres
- Knowledge and Evaluation Research Unit (R.L.-T., M.D., M.M.C., C.S.., D.S.T., S.A.P., V.M., E.G., M.B.O., J.P.B.), Division of Endocrinology, Diabetes, Metabolism, and Nutrition (D.T.-T., J.P.B.), Department of Medicine, and Department of Artificial Intelligence and Informatics (N.S.O.), Mayo Clinic, Rochester, MN; University of Edinburgh, Edinburgh, Scotland, United Kingdom (D.S.T.); Montefiore Health Center, Albert Einstein College of Medicine, New York, NY (J.W.F.); Division of Endocrinology, Department of Medicine (N.S.O.), and Department of Health Outcomes and Biomedical Informatics (Y.W.), University of Florida, Gainesville, FL; and Respiratory, Cardiovascular, and Renal Pathobiology and Bioengineering, Universitat de Barcelona, Spain (D.S.T.)
| | - Sandra Algarin Perneth
- Knowledge and Evaluation Research Unit (R.L.-T., M.D., M.M.C., C.S.., D.S.T., S.A.P., V.M., E.G., M.B.O., J.P.B.), Division of Endocrinology, Diabetes, Metabolism, and Nutrition (D.T.-T., J.P.B.), Department of Medicine, and Department of Artificial Intelligence and Informatics (N.S.O.), Mayo Clinic, Rochester, MN; University of Edinburgh, Edinburgh, Scotland, United Kingdom (D.S.T.); Montefiore Health Center, Albert Einstein College of Medicine, New York, NY (J.W.F.); Division of Endocrinology, Department of Medicine (N.S.O.), and Department of Health Outcomes and Biomedical Informatics (Y.W.), University of Florida, Gainesville, FL; and Respiratory, Cardiovascular, and Renal Pathobiology and Bioengineering, Universitat de Barcelona, Spain (D.S.T.)
| | - Victor Montori
- Knowledge and Evaluation Research Unit (R.L.-T., M.D., M.M.C., C.S.., D.S.T., S.A.P., V.M., E.G., M.B.O., J.P.B.), Division of Endocrinology, Diabetes, Metabolism, and Nutrition (D.T.-T., J.P.B.), Department of Medicine, and Department of Artificial Intelligence and Informatics (N.S.O.), Mayo Clinic, Rochester, MN; University of Edinburgh, Edinburgh, Scotland, United Kingdom (D.S.T.); Montefiore Health Center, Albert Einstein College of Medicine, New York, NY (J.W.F.); Division of Endocrinology, Department of Medicine (N.S.O.), and Department of Health Outcomes and Biomedical Informatics (Y.W.), University of Florida, Gainesville, FL; and Respiratory, Cardiovascular, and Renal Pathobiology and Bioengineering, Universitat de Barcelona, Spain (D.S.T.)
| | - Elizabeth Golembiewski
- Knowledge and Evaluation Research Unit (R.L.-T., M.D., M.M.C., C.S.., D.S.T., S.A.P., V.M., E.G., M.B.O., J.P.B.), Division of Endocrinology, Diabetes, Metabolism, and Nutrition (D.T.-T., J.P.B.), Department of Medicine, and Department of Artificial Intelligence and Informatics (N.S.O.), Mayo Clinic, Rochester, MN; University of Edinburgh, Edinburgh, Scotland, United Kingdom (D.S.T.); Montefiore Health Center, Albert Einstein College of Medicine, New York, NY (J.W.F.); Division of Endocrinology, Department of Medicine (N.S.O.), and Department of Health Outcomes and Biomedical Informatics (Y.W.), University of Florida, Gainesville, FL; and Respiratory, Cardiovascular, and Renal Pathobiology and Bioengineering, Universitat de Barcelona, Spain (D.S.T.)
| | - Mariana Borras Osorio
- Knowledge and Evaluation Research Unit (R.L.-T., M.D., M.M.C., C.S.., D.S.T., S.A.P., V.M., E.G., M.B.O., J.P.B.), Division of Endocrinology, Diabetes, Metabolism, and Nutrition (D.T.-T., J.P.B.), Department of Medicine, and Department of Artificial Intelligence and Informatics (N.S.O.), Mayo Clinic, Rochester, MN; University of Edinburgh, Edinburgh, Scotland, United Kingdom (D.S.T.); Montefiore Health Center, Albert Einstein College of Medicine, New York, NY (J.W.F.); Division of Endocrinology, Department of Medicine (N.S.O.), and Department of Health Outcomes and Biomedical Informatics (Y.W.), University of Florida, Gainesville, FL; and Respiratory, Cardiovascular, and Renal Pathobiology and Bioengineering, Universitat de Barcelona, Spain (D.S.T.)
| | - Jungwei W Fan
- Knowledge and Evaluation Research Unit (R.L.-T., M.D., M.M.C., C.S.., D.S.T., S.A.P., V.M., E.G., M.B.O., J.P.B.), Division of Endocrinology, Diabetes, Metabolism, and Nutrition (D.T.-T., J.P.B.), Department of Medicine, and Department of Artificial Intelligence and Informatics (N.S.O.), Mayo Clinic, Rochester, MN; University of Edinburgh, Edinburgh, Scotland, United Kingdom (D.S.T.); Montefiore Health Center, Albert Einstein College of Medicine, New York, NY (J.W.F.); Division of Endocrinology, Department of Medicine (N.S.O.), and Department of Health Outcomes and Biomedical Informatics (Y.W.), University of Florida, Gainesville, FL; and Respiratory, Cardiovascular, and Renal Pathobiology and Bioengineering, Universitat de Barcelona, Spain (D.S.T.)
| | - Naykky Singh Ospina
- Knowledge and Evaluation Research Unit (R.L.-T., M.D., M.M.C., C.S.., D.S.T., S.A.P., V.M., E.G., M.B.O., J.P.B.), Division of Endocrinology, Diabetes, Metabolism, and Nutrition (D.T.-T., J.P.B.), Department of Medicine, and Department of Artificial Intelligence and Informatics (N.S.O.), Mayo Clinic, Rochester, MN; University of Edinburgh, Edinburgh, Scotland, United Kingdom (D.S.T.); Montefiore Health Center, Albert Einstein College of Medicine, New York, NY (J.W.F.); Division of Endocrinology, Department of Medicine (N.S.O.), and Department of Health Outcomes and Biomedical Informatics (Y.W.), University of Florida, Gainesville, FL; and Respiratory, Cardiovascular, and Renal Pathobiology and Bioengineering, Universitat de Barcelona, Spain (D.S.T.)
| | - Yonghui Wu
- Knowledge and Evaluation Research Unit (R.L.-T., M.D., M.M.C., C.S.., D.S.T., S.A.P., V.M., E.G., M.B.O., J.P.B.), Division of Endocrinology, Diabetes, Metabolism, and Nutrition (D.T.-T., J.P.B.), Department of Medicine, and Department of Artificial Intelligence and Informatics (N.S.O.), Mayo Clinic, Rochester, MN; University of Edinburgh, Edinburgh, Scotland, United Kingdom (D.S.T.); Montefiore Health Center, Albert Einstein College of Medicine, New York, NY (J.W.F.); Division of Endocrinology, Department of Medicine (N.S.O.), and Department of Health Outcomes and Biomedical Informatics (Y.W.), University of Florida, Gainesville, FL; and Respiratory, Cardiovascular, and Renal Pathobiology and Bioengineering, Universitat de Barcelona, Spain (D.S.T.)
| | - Juan P Brito
- Knowledge and Evaluation Research Unit (R.L.-T., M.D., M.M.C., C.S.., D.S.T., S.A.P., V.M., E.G., M.B.O., J.P.B.), Division of Endocrinology, Diabetes, Metabolism, and Nutrition (D.T.-T., J.P.B.), Department of Medicine, and Department of Artificial Intelligence and Informatics (N.S.O.), Mayo Clinic, Rochester, MN; University of Edinburgh, Edinburgh, Scotland, United Kingdom (D.S.T.); Montefiore Health Center, Albert Einstein College of Medicine, New York, NY (J.W.F.); Division of Endocrinology, Department of Medicine (N.S.O.), and Department of Health Outcomes and Biomedical Informatics (Y.W.), University of Florida, Gainesville, FL; and Respiratory, Cardiovascular, and Renal Pathobiology and Bioengineering, Universitat de Barcelona, Spain (D.S.T.)
| |
Collapse
|