1
|
Zhou H, Wang HL, Duan YY, Yan ZN, Luo R, Lv XX, Xie Y, Zhang JY, Yang JM, Xue MD, Fang Y, Lu L, Liu PR, Ye ZW. Enhancing Orthopedic Knowledge Assessments: The Performance of Specialized Generative Language Model Optimization. Curr Med Sci 2024:10.1007/s11596-024-2929-4. [PMID: 39368054 DOI: 10.1007/s11596-024-2929-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2024] [Accepted: 08/18/2024] [Indexed: 10/07/2024]
Abstract
OBJECTIVE This study aimed to evaluate and compare the effectiveness of knowledge base-optimized and unoptimized large language models (LLMs) in the field of orthopedics to explore optimization strategies for the application of LLMs in specific fields. METHODS This research constructed a specialized knowledge base using clinical guidelines from the American Academy of Orthopaedic Surgeons (AAOS) and authoritative orthopedic publications. A total of 30 orthopedic-related questions covering aspects such as anatomical knowledge, disease diagnosis, fracture classification, treatment options, and surgical techniques were input into both the knowledge base-optimized and unoptimized versions of the GPT-4, ChatGLM, and Spark LLM, with their generated responses recorded. The overall quality, accuracy, and comprehensiveness of these responses were evaluated by 3 experienced orthopedic surgeons. RESULTS Compared with their unoptimized LLMs, the optimized version of GPT-4 showed improvements of 15.3% in overall quality, 12.5% in accuracy, and 12.8% in comprehensiveness; ChatGLM showed improvements of 24.8%, 16.1%, and 19.6%, respectively; and Spark LLM showed improvements of 6.5%, 14.5%, and 24.7%, respectively. CONCLUSION The optimization of knowledge bases significantly enhances the quality, accuracy, and comprehensiveness of the responses provided by the 3 models in the orthopedic field. Therefore, knowledge base optimization is an effective method for improving the performance of LLMs in specific fields.
Collapse
Affiliation(s)
- Hong Zhou
- Department of Orthopedics Surgery, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China
- Laboratory of Intelligent Medicine, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China
| | - Hong-Lin Wang
- Department of Orthopedics Surgery, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China
- Laboratory of Intelligent Medicine, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China
| | - Yu-Yu Duan
- Laboratory of Intelligent Medicine, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China
- College of Chinese Medicine, Hubei University of Chinese Medicine, Wuhan, 433065, China
| | - Zi-Neng Yan
- Department of Orthopedics Surgery, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China
- Laboratory of Intelligent Medicine, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China
| | - Rui Luo
- Department of Orthopedics Surgery, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China
- Laboratory of Intelligent Medicine, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China
| | - Xiang-Xin Lv
- Department of Orthopedics Surgery, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China
- Laboratory of Intelligent Medicine, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China
| | - Yi Xie
- Department of Orthopedics Surgery, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China
- Laboratory of Intelligent Medicine, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China
| | - Jia-Yao Zhang
- Department of Orthopedics Surgery, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China
- Laboratory of Intelligent Medicine, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China
| | - Jia-Ming Yang
- Department of Orthopedics Surgery, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China
- Laboratory of Intelligent Medicine, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China
| | - Ming-di Xue
- Department of Orthopedics Surgery, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China
- Laboratory of Intelligent Medicine, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China
| | - Ying Fang
- Department of Orthopedics Surgery, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China
- Laboratory of Intelligent Medicine, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China
| | - Lin Lu
- Laboratory of Intelligent Medicine, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China.
- Department of Orthopedics, Renmin Hospital of Wuhan University, Wuhan, 433060, China.
| | - Peng-Ran Liu
- Department of Orthopedics Surgery, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China.
- Laboratory of Intelligent Medicine, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China.
| | - Zhe-Wei Ye
- Department of Orthopedics Surgery, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China.
- Laboratory of Intelligent Medicine, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China.
| |
Collapse
|
2
|
Fukuda N, Konda S, Umehara J, Hirashima M. Efficient musculoskeletal annotation using free-form deformation. Sci Rep 2024; 14:16077. [PMID: 38992241 PMCID: PMC11239816 DOI: 10.1038/s41598-024-67125-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2024] [Accepted: 07/08/2024] [Indexed: 07/13/2024] Open
Abstract
Traditionally, constructing training datasets for automatic muscle segmentation from medical images involved skilled operators, leading to high labor costs and limited scalability. To address this issue, we developed a tool that enables efficient annotation by non-experts and assessed its effectiveness for training an automatic segmentation network. Our system allows users to deform a template three-dimensional (3D) anatomical model to fit a target magnetic-resonance image using free-form deformation with independent control points for axial, sagittal, and coronal directions. This method simplifies the annotation process by allowing non-experts to intuitively adjust the model, enabling simultaneous annotation of all muscles in the template. We evaluated the quality of the tool-assisted segmentation performed by non-experts, which achieved a Dice coefficient greater than 0.75 compared to expert segmentation, without significant errors such as mislabeling adjacent muscles or omitting musculature. An automatic segmentation network trained with datasets created using this tool demonstrated performance comparable to or superior to that of networks trained with expert-generated datasets. This innovative tool significantly reduces the time and labor costs associated with dataset creation for automatic muscle segmentation, potentially revolutionizing medical image annotation and accelerating the development of deep learning-based segmentation networks in various clinical applications.
Collapse
Affiliation(s)
- Norio Fukuda
- Center for Information and Neural Networks (CiNet), Advanced ICT Research Institute, National Institute of Information and Communications Technology (NICT), 1-4 Yamadaoka, Suita, Osaka, 565-0871, Japan
| | - Shoji Konda
- Center for Information and Neural Networks (CiNet), Advanced ICT Research Institute, National Institute of Information and Communications Technology (NICT), 1-4 Yamadaoka, Suita, Osaka, 565-0871, Japan
- Department of Health and Sport Sciences, Graduate School of Medicine, Osaka University, 1-17 Machikaneyama-Cho, Toyonaka, Osaka, 560-0043, Japan
| | - Jun Umehara
- Center for Information and Neural Networks (CiNet), Advanced ICT Research Institute, National Institute of Information and Communications Technology (NICT), 1-4 Yamadaoka, Suita, Osaka, 565-0871, Japan
- Faculty of Rehabilitation, Kansai Medical University, 18-89 Uyama-Higashi, Hirakata, Osaka, 573-1136, Japan
| | - Masaya Hirashima
- Center for Information and Neural Networks (CiNet), Advanced ICT Research Institute, National Institute of Information and Communications Technology (NICT), 1-4 Yamadaoka, Suita, Osaka, 565-0871, Japan.
- Graduate School of Frontier Biosciences, Osaka University, 1-3 Yamadaoka, Suita, Osaka, 565-0871, Japan.
| |
Collapse
|
3
|
Yu Q, Wang G, Cheng H, Guo W, Liu Y. The segmentation and intelligent recognition of structural surfaces in borehole images based on the U2-Net network. PLoS One 2024; 19:e0299471. [PMID: 38451909 PMCID: PMC10919631 DOI: 10.1371/journal.pone.0299471] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2023] [Accepted: 02/10/2024] [Indexed: 03/09/2024] Open
Abstract
Structural planes decrease the strength and stability of rock masses, severely affecting their mechanical properties and deformation and failure characteristics. Therefore, investigation and analysis of structural planes are crucial tasks in mining rock mechanics. The drilling camera obtains image information of deep structural planes of rock masses through high-definition camera methods, providing important data sources for the analysis of deep structural planes of rock masses. This paper addresses the problems of high workload, low efficiency, high subjectivity, and poor accuracy brought about by manual processing based on current borehole image analysis and conducts an intelligent segmentation study of borehole image structural planes based on the U2-Net network. By collecting data from 20 different borehole images in different lithological regions, a dataset consisting of 1,013 borehole images with structural plane type, lithology, and color was established. Data augmentation methods such as image flipping, color jittering, blurring, and mixup were applied to expand the dataset to 12,421 images, meeting the requirements for deep network training data. Based on the PyTorch deep learning framework, the initial U2-Net network weights were set, the learning rate was set to 0.001, the training batch was 4, and the Adam optimizer adaptively adjusted the learning rate during the training process. A dedicated network model for segmenting structural planes was obtained, and the model achieved a maximum F-measure value of 0.749 when the confidence threshold was set to 0.7, with an accuracy rate of up to 0.85 within the range of recall rate greater than 0.5. Overall, the model has high accuracy for segmenting structural planes and very low mean absolute error, indicating good segmentation accuracy and certain generalization of the network. The research method in this paper can serve as a reference for the study of intelligent identification of structural planes in borehole images.
Collapse
Affiliation(s)
- Qingjun Yu
- Chifengshan Jinhongling Nonferrous Mining Co., Ltd, Inner Mongolia, PR China
| | - Guannan Wang
- Chifengshan Jinhongling Nonferrous Mining Co., Ltd, Inner Mongolia, PR China
| | - Hai Cheng
- Key Laboratory of Ministry of Education on Safe Mining of Deep Metal Mines, Northeastern University, Shenyang, PR China
| | - Wenzhi Guo
- Key Laboratory of Ministry of Education on Safe Mining of Deep Metal Mines, Northeastern University, Shenyang, PR China
| | - Yanbiao Liu
- Key Laboratory of Ministry of Education on Safe Mining of Deep Metal Mines, Northeastern University, Shenyang, PR China
| |
Collapse
|
4
|
Cao L, Zeng L, Wang Y, Cao J, Han Z, Chen Y, Wang Y, Zhong G, Qiao S. U 2-Net and ResNet50-Based Automatic Pipeline for Bacterial Colony Counting. Microorganisms 2024; 12:201. [PMID: 38258027 PMCID: PMC10820204 DOI: 10.3390/microorganisms12010201] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2023] [Revised: 01/15/2024] [Accepted: 01/16/2024] [Indexed: 01/24/2024] Open
Abstract
In this paper, an automatic colony counting system based on an improved image preprocessing algorithm and convolutional neural network (CNN)-assisted automatic counting method was developed. Firstly, we assembled an LED backlighting illumination platform as an image capturing system to obtain photographs of laboratory cultures. Consequently, a dataset was introduced consisting of 390 photos of agar plate cultures, which included 8 microorganisms. Secondly, we implemented a new algorithm for image preprocessing based on light intensity correction, which facilitated clearer differentiation between colony and media areas. Thirdly, a U2-Net was used to predict the probability distribution of the edge of the Petri dish in images to locate region of interest (ROI), and then threshold segmentation was applied to separate it. This U2-Net achieved an F1 score of 99.5% and a mean absolute error (MAE) of 0.0033 on the validation set. Then, another U2-Net was used to separate the colony region within the ROI. This U2-Net achieved an F1 score of 96.5% and an MAE of 0.005 on the validation set. After that, the colony area was segmented into multiple components containing single or adhesive colonies. Finally, the colony components (CC) were innovatively rotated and the image crops were resized as the input (with 14,921 image crops in the training set and 4281 image crops in the validation set) for the ResNet50 network to automatically count the number of colonies. Our method achieved an overall recovery of 97.82% for colony counting and exhibited excellent performance in adhesion classification. To the best of our knowledge, the proposed "light intensity correction-based image preprocessing→U2-Net segmentation for Petri dish edge→U2-Net segmentation for colony region→ResNet50-based counting" scheme represents a new attempt and demonstrates a high degree of automation and accuracy in recognizing and counting single-colony and multi-colony targets.
Collapse
Affiliation(s)
- Libo Cao
- Center for Global Health, Nanjing Medical University, Nanjing 211166, China (Y.W.)
| | - Liping Zeng
- Department of Pathogen Biology, School of Basic Medical Sciences, Nanjing Medical University, Nanjing 211166, China;
| | - Yaoxuan Wang
- Center for Global Health, Nanjing Medical University, Nanjing 211166, China (Y.W.)
| | - Jiayi Cao
- Center for Global Health, Nanjing Medical University, Nanjing 211166, China (Y.W.)
| | - Ziyu Han
- Center for Global Health, Nanjing Medical University, Nanjing 211166, China (Y.W.)
| | - Yang Chen
- Center for Global Health, Nanjing Medical University, Nanjing 211166, China (Y.W.)
| | - Yuxi Wang
- Center for Global Health, Nanjing Medical University, Nanjing 211166, China (Y.W.)
| | - Guowei Zhong
- Center for Global Health, Nanjing Medical University, Nanjing 211166, China (Y.W.)
| | - Shanlei Qiao
- Center for Global Health, Nanjing Medical University, Nanjing 211166, China (Y.W.)
| |
Collapse
|
5
|
Decaux N, Conze PH, Ropars J, He X, Sheehan FT, Pons C, Salem DB, Brochard S, Rousseau F. Semi-automatic muscle segmentation in MR images using deep registration-based label propagation. PATTERN RECOGNITION 2023; 140:109529. [PMID: 37383565 PMCID: PMC10299801 DOI: 10.1016/j.patcog.2023.109529] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/30/2023]
Abstract
Fully automated approaches based on convolutional neural networks have shown promising performances on muscle segmentation from magnetic resonance (MR) images, but still rely on an extensive amount of training data to achieve valuable results. Muscle segmentation for pediatric and rare diseases cohorts is therefore still often done manually. Producing dense delineations over 3D volumes remains a time-consuming and tedious task, with significant redundancy between successive slices. In this work, we propose a segmentation method relying on registration-based label propagation, which provides 3D muscle delineations from a limited number of annotated 2D slices. Based on an unsupervised deep registration scheme, our approach ensures the preservation of anatomical structures by penalizing deformation compositions that do not produce consistent segmentation from one annotated slice to another. Evaluation is performed on MR data from lower leg and shoulder joints. Results demonstrate that the proposed few-shot multi-label segmentation model outperforms state-of-the-art techniques.
Collapse
Affiliation(s)
- Nathan Decaux
- LaTIM UMR 1101, Inserm, Brest, France
- IMT Atlantique, Brest, France
| | | | - Juliette Ropars
- LaTIM UMR 1101, Inserm, Brest, France
- University Hospital of Brest, Brest, France
| | | | | | - Christelle Pons
- LaTIM UMR 1101, Inserm, Brest, France
- University Hospital of Brest, Brest, France
- Fondation ILDYS, Brest, France
| | - Douraied Ben Salem
- LaTIM UMR 1101, Inserm, Brest, France
- University Hospital of Brest, Brest, France
| | - Sylvain Brochard
- LaTIM UMR 1101, Inserm, Brest, France
- University Hospital of Brest, Brest, France
| | | |
Collapse
|
6
|
Flannery SW, Barnes DA, Costa MQ, Menghini D, Kiapour AM, Walsh EG, Kramer DE, Murray MM, Fleming BC. Automated segmentation of the healed anterior cruciate ligament from T 2 * relaxometry MRI scans. J Orthop Res 2023; 41:649-656. [PMID: 35634860 PMCID: PMC9708947 DOI: 10.1002/jor.25390] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/13/2022] [Revised: 05/16/2022] [Accepted: 05/26/2022] [Indexed: 02/04/2023]
Abstract
Collagen organization of the anterior cruciate ligament (ACL) can be evaluated using T2 * relaxometry. However, T2 * mapping requires manual image segmentation, which is a time-consuming process and prone to inter- and intra- segmenter variability. Automating segmentation would address these challenges. A model previously trained using Constructive Interference in Steady State (CISS) scans was applied to T2 * segmentation via transfer learning. It was hypothesized that there would be no significant differences in the model's segmentation performance between T2 * and CISS, structural measures versus ground truth manual segmentation, and reliability versus independent and retest manual segmentation. Transfer learning was conducted using 54 T2 * scans of the ACL. Segmentation performance was assessed with Dice coefficient, precision, and sensitivity, and structurally with T2 * value, volume, subvolume proportions, and cross-sectional area. Model performance relative to independent manual segmentation and repeated segmentation by the ground truth segmenter (retest) were evaluated on a random subset. Segmentation performance was analyzed with Mann-Whitney U tests, structural measures with Wilcoxon signed-rank tests, and performance relative to manual segmentation with repeated-measures analysis of variance/Tukey tests (α = 0.05). T2 * segmentation performance was not significantly different from CISS on all measures (p > 0.35). No significant differences were detected in structural measures (p > 0.50). Automatic segmentation performed as well as the retest on all segmentation measures, whereas independent segmentations were lower than retest and/or automatic segmentation (p < 0.023). Structural measures were not significantly different between segmenters. The automatic segmentation model performed as well on the T2 * sequence as on CISS and outperformed independent manual segmentation while performing as well as retest segmentation.
Collapse
Affiliation(s)
- Sean W. Flannery
- Department of Orthopaedics, Warren Alpert Medical School of Brown University/Rhode Island Hospital, Providence, RI, USA
| | - Dominique A. Barnes
- Department of Orthopaedics, Warren Alpert Medical School of Brown University/Rhode Island Hospital, Providence, RI, USA
| | - Meggin Q. Costa
- Department of Orthopaedics, Warren Alpert Medical School of Brown University/Rhode Island Hospital, Providence, RI, USA
| | - Danilo Menghini
- Department of Orthopaedic Surgery, Boston Children’s Hospital, Harvard Medical School, Boston, MA, USA
| | - Ata M. Kiapour
- Department of Orthopaedic Surgery, Boston Children’s Hospital, Harvard Medical School, Boston, MA, USA
| | - Edward G. Walsh
- Department of Neuroscience, Division of Biology and Medicine, Brown University, Providence, RI, USA
| | - Dennis E. Kramer
- Department of Orthopaedic Surgery, Boston Children’s Hospital, Harvard Medical School, Boston, MA, USA
| | - Martha M. Murray
- Department of Orthopaedic Surgery, Boston Children’s Hospital, Harvard Medical School, Boston, MA, USA
| | - Braden C. Fleming
- Department of Orthopaedics, Warren Alpert Medical School of Brown University/Rhode Island Hospital, Providence, RI, USA
| |
Collapse
|
7
|
Bonaldi L, Pretto A, Pirri C, Uccheddu F, Fontanella CG, Stecco C. Deep Learning-Based Medical Images Segmentation of Musculoskeletal Anatomical Structures: A Survey of Bottlenecks and Strategies. Bioengineering (Basel) 2023; 10:137. [PMID: 36829631 PMCID: PMC9952222 DOI: 10.3390/bioengineering10020137] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/25/2022] [Revised: 01/13/2023] [Accepted: 01/17/2023] [Indexed: 01/22/2023] Open
Abstract
By leveraging the recent development of artificial intelligence algorithms, several medical sectors have benefited from using automatic segmentation tools from bioimaging to segment anatomical structures. Segmentation of the musculoskeletal system is key for studying alterations in anatomical tissue and supporting medical interventions. The clinical use of such tools requires an understanding of the proper method for interpreting data and evaluating their performance. The current systematic review aims to present the common bottlenecks for musculoskeletal structures analysis (e.g., small sample size, data inhomogeneity) and the related strategies utilized by different authors. A search was performed using the PUBMED database with the following keywords: deep learning, musculoskeletal system, segmentation. A total of 140 articles published up until February 2022 were obtained and analyzed according to the PRISMA framework in terms of anatomical structures, bioimaging techniques, pre/post-processing operations, training/validation/testing subset creation, network architecture, loss functions, performance indicators and so on. Several common trends emerged from this survey; however, the different methods need to be compared and discussed based on each specific case study (anatomical region, medical imaging acquisition setting, study population, etc.). These findings can be used to guide clinicians (as end users) to better understand the potential benefits and limitations of these tools.
Collapse
Affiliation(s)
- Lorenza Bonaldi
- Department of Civil, Environmental and Architectural Engineering, University of Padova, Via F. Marzolo 9, 35131 Padova, Italy
| | - Andrea Pretto
- Department of Industrial Engineering, University of Padova, Via Venezia 1, 35121 Padova, Italy
| | - Carmelo Pirri
- Department of Neuroscience, University of Padova, Via A. Gabelli 65, 35121 Padova, Italy
| | - Francesca Uccheddu
- Department of Industrial Engineering, University of Padova, Via Venezia 1, 35121 Padova, Italy
- Centre for Mechanics of Biological Materials (CMBM), University of Padova, Via F. Marzolo 9, 35131 Padova, Italy
| | - Chiara Giulia Fontanella
- Department of Industrial Engineering, University of Padova, Via Venezia 1, 35121 Padova, Italy
- Centre for Mechanics of Biological Materials (CMBM), University of Padova, Via F. Marzolo 9, 35131 Padova, Italy
| | - Carla Stecco
- Department of Neuroscience, University of Padova, Via A. Gabelli 65, 35121 Padova, Italy
- Centre for Mechanics of Biological Materials (CMBM), University of Padova, Via F. Marzolo 9, 35131 Padova, Italy
| |
Collapse
|