Automated comprehensive Adolescent Idiopathic Scoliosis assessment using MVC-Net

Validation of Artificial Intelligence in the Classification of Adolescent Idiopathic Scoliosis and the Compairment to Clinical Manual Handling

OBJECTIVE

The accurate measurement of Cobb angles is crucial for the effective clinical management of patients with adolescent idiopathic scoliosis (AIS). The Lenke classification system plays a pivotal role in determining the appropriate fusion levels for treatment planning. However, the presence of interobserver variability and time-intensive procedures presents challenges for clinicians. The purpose of this study is to compare the measurement accuracy of our developed artificial intelligence measurement system for Cobb angles and Lenke classification in AIS patients with manual measurements to validate its feasibility.

METHODS

An artificial intelligence (AI) system measured the Cobb angle of AIS patients using convolutional neural networks, which identified the vertebral boundaries and sequences, recognized the upper and lower end vertebras, and estimated the Cobb angles of the proximal thoracic, main thoracic, and thoracolumbar/lumbar curves sequentially. Accordingly, the Lenke classifications of scoliosis were divided by oscillogram and defined by the AI system. Furthermore, a man-machine comparison (n = 300) was conducted for senior spine surgeons (n = 2), junior spine surgeons (n = 2), and the AI system for the image measurements of proximal thoracic (PT), main thoracic (MT), thoracolumbar/lumbar (TL/L), thoracic sagittal profile T5-T12, bending views PT, bending views MT, bending views TL/L, the Lenke classification system, the lumbar modifier, and sagittal thoracic alignment.

RESULTS

In the AI system, the calculation time for each patient's data was 0.2 s, while the measurement time for each surgeon was 23.6 min. The AI system showed high accuracy in the recognition of the Lenke classification and had high reliability compared to senior doctors (ICC 0.962).

CONCLUSION

The AI system has high reliability for the Lenke classification and is a potential auxiliary tool for spinal surgeons.

Deep Learning Method for Precise Landmark Identification and Structural Assessment of Whole-Spine Radiographs

This study measured parameters automatically by marking the point for measuring each parameter on whole-spine radiographs. Between January 2020 and December 2021, 1017 sequential lateral whole-spine radiographs were retrospectively obtained. Of these, 819 and 198 were used for training and testing the performance of the landmark detection model, respectively. To objectively evaluate the program's performance, 690 whole-spine radiographs from four other institutions were used for external validation. The combined dataset comprised radiographs from 857 female and 850 male patients (average age 42.2 ± 27.3 years; range 20-85 years). The landmark localizer showed the highest accuracy in identifying cervical landmarks (median error 1.5-2.4 mm), followed by lumbosacral landmarks (median error 2.1-3.0 mm). However, thoracic landmarks displayed larger localization errors (median 2.4-4.3 mm), indicating slightly reduced precision compared with the cervical and lumbosacral regions. The agreement between the deep learning model and two experts was good to excellent, with intraclass correlation coefficient values >0.88. The deep learning model also performed well on the external validation set. There were no statistical differences between datasets in all parameters, suggesting that the performance of the artificial intelligence model created was excellent. The proposed automatic alignment analysis system identified anatomical landmarks and positions of the spine with high precision and generated various radiograph imaging parameters that had a good correlation with manual measurements.

Anatomical Prior and Inter-Slice Consistency for Semi-Supervised Vertebral Structure Detection in 3D Ultrasound Volume

Three-dimensional (3D) ultrasound imaging technique has been applied for scoliosis assessment, but the current assessment method only uses coronal projection images and cannot illustrate the 3D deformity and vertebra rotation. The vertebra detection is essential to reveal 3D spine information, but the detection task is challenging due to complex data and limited annotations. We propose VertMatch to detect vertebral structures in 3D ultrasound volume containing a detector and classifier. The detector network finds the potential positions of structures on transverse slice globally, and then the local patches are cropped based on detected positions. The classifier is used to distinguish whether the patches contain real vertebral structures and screen the predicted positions from the detector. VertMatch utilizes unlabeled data in a semi-supervised manner, and we develop two novel techniques for semi-supervised learning: 1) anatomical prior is used to acquire high-quality pseudo labels; 2) inter-slice consistency is used to utilize more unlabeled data by inputting multiple adjacent slices. Experimental results demonstrate that VertMatch can detect vertebra accurately in ultrasound volume and outperforms state-of-the-art methods. Moreover, VertMatch is also validated in automatic spinous process angle measurement on forty subjects with scoliosis, and the results illustrate that it can be a promising approach for the 3D assessment of scoliosis.

Landet: an efficient physics-informed deep learning approach for automatic detection of anatomical landmarks and measurement of spinopelvic alignment

PURPOSE

An efficient physics-informed deep learning approach for extracting spinopelvic measures from X-ray images is introduced and its performance is evaluated against manual annotations.

METHODS

Two datasets, comprising a total of 1470 images, were collected to evaluate the model's performance. We propose a novel method of detecting landmarks as objects, incorporating their relationships as constraints (LanDet). Using this approach, we trained our deep learning model to extract five spine and pelvis measures: Sacrum Slope (SS), Pelvic Tilt (PT), Pelvic Incidence (PI), Lumbar Lordosis (LL), and Sagittal Vertical Axis (SVA). The results were compared to manually labelled test dataset (GT) as well as measures annotated separately by three surgeons.

RESULTS

The LanDet model was evaluated on the two datasets separately and on an extended dataset combining both. The final accuracy for each measure is reported in terms of Mean Absolute Error (MAE), Standard Deviation (SD), and R Pearson correlation coefficient as follows: [ S S ∘ : 3.7 ( 2.7 ) , R = 0.89 ] ,[ P T ∘ : 1.3 ( 1.1 ) , R = 0.98 ] , [ P I ∘ : 4.2 ( 3.1 ) , R = 0.93 ] , [ L L ∘ : 5.1 ( 6.4 ) , R = 0.83 ] , [ S V A ( m m ) : 2.1 ( 1.9 ) , R = 0.96 ] . To assess model reliability and compare it against surgeons, the intraclass correlation coefficient (ICC) metric is used. The model demonstrated better consistency with surgeons with all values over 0.88 compared to what was previously reported in the literature.

CONCLUSION

The LanDet model exhibits competitive performance compared to existing literature. The effectiveness of the physics-informed constraint method, utilized in our landmark detection as object algorithm, is highlighted. Furthermore, we addressed the limitations of heatmap-based methods for anatomical landmark detection and tackled issues related to mis-identifying of similar or adjacent landmarks instead of intended landmark using this novel approach.

Deep Learning-Assisted Quantitative Measurement of Thoracolumbar Fracture Features on Lateral Radiographs

OBJECTIVE

This study aimed to develop and validate a deep learning (DL) algorithm for the quantitative measurement of thoracolumbar (TL) fracture features, and to evaluate its efficacy across varying levels of clinical expertise.

METHODS

Using the pretrained Mask Region-Based Convolutional Neural Networks model, originally developed for vertebral body segmentation and fracture detection, we fine-tuned the model and added a new module for measuring fracture metrics-compression rate (CR), Cobb angle (CA), Gardner angle (GA), and sagittal index (SI)-from lumbar spine lateral radiographs. These metrics were derived from six-point labeling by 3 radiologists, forming the ground truth (GT). Training utilized 1,000 nonfractured and 318 fractured radiographs, while validations employed 213 internal and 200 external fractured radiographs. The accuracy of the DL algorithm in quantifying fracture features was evaluated against GT using the intraclass correlation coefficient. Additionally, 4 readers with varying expertise levels, including trainees and an attending spine surgeon, performed measurements with and without DL assistance, and their results were compared to GT and the DL model.

RESULTS

The DL algorithm demonstrated good to excellent agreement with GT for CR, CA, GA, and SI in both internal (0.860, 0.944, 0.932, and 0.779, respectively) and external (0.836, 0.940, 0.916, and 0.815, respectively) validations. DL-assisted measurements significantly improved most measurement values, particularly for trainees.

CONCLUSION

The DL algorithm was validated as an accurate tool for quantifying TL fracture features using radiographs. DL-assisted measurement is expected to expedite the diagnostic process and enhance reliability, particularly benefiting less experienced clinicians.

Novel AI-Based Algorithm for the Automated Measurement of Cervical Sagittal Balance Parameters. A Validation Study on Pre- and Postoperative Radiographs of 129 Patients

STUDY DESIGN

Retrospective, mono-centric cohort research study.

OBJECTIVES

The analysis of cervical sagittal balance parameters is essential for preoperative planning and dependent on the physician's experience. A fully automated artificial intelligence-based algorithm could contribute to an objective analysis and save time. Therefore, this algorithm should be validated in this study.

METHODS

Two surgeons measured C2-C7 lordosis, C1-C7 Sagittal Vertical Axis (SVA), C2-C7-SVA, C7-slope and T1-slope in pre- and postoperative lateral cervical X-rays of 129 patients undergoing anterior cervical surgery. All parameters were measured twice by surgeons and compared to the measurements by the AI algorithm consisting of 4 deep convolutional neural networks. Agreement between raters was quantified, among other metrics, by mean errors and single measure intraclass correlation coefficients for absolute agreement.

RESULTS

ICC-values for intra- (range: .92-1.0) and inter-rater (.91-1.0) reliability reflect excellent agreement between human raters. The AI-algorithm could determine all parameters with excellent ICC-values (preop:0.80-1.0; postop:0.86-.99). For a comparison between the AI algorithm and 1 surgeon, mean errors were smallest for C1-C7 SVA (preop: -.3 mm (95% CI:-.6 to -.1 mm), post: .3 mm (.0-.7 mm)) and largest for C2-C7 lordosis (preop:-2.2° (-2.9 to -1.6°), postop: 2.3°(-3.0 to -1.7°)). The automatic measurement was possible in 99% and 98% of pre- and postoperative images for all parameters except T1 slope, which had a detection rate of 48% and 51% in pre- and postoperative images.

CONCLUSION

This study validates that an AI-algorithm can reliably measure cervical sagittal balance parameters automatically in patients suffering from degenerative spinal diseases. It may simplify manual measurements and autonomously analyze large-scale datasets. Further studies are required to validate the algorithm on a larger and more diverse patient cohort.

A Dual Coordinate System Vertebra Landmark Detection Network with Sparse-to-Dense Vertebral Line Interpolation

Precise surveillance and assessment of spinal disorders are important for improving health care and patient survival rates. The assessment of spinal disorders, such as scoliosis assessment, depends heavily on precise vertebra landmark localization. However, existing methods usually search for only a handful of keypoints in a high-resolution image. In this paper, we propose the S2D-VLI VLDet network, a unified end-to-end vertebra landmark detection network for the assessment of scoliosis. The proposed network considers the spatially relevant information both from inside and between vertebrae. The new vertebral line interpolation method converts the training labels from sparse to dense, which can improve the network learning process and method performance. In addition, through the combined use of the Cartesian and polar coordinate systems in our method, the symmetric mean absolute percentage error (SMAPE) in scoliosis assessment can be reduced substantially. Specifically, as shown in the experiments, the SMAPE value decreases from 9.82 to 8.28. The experimental results indicate that our proposed approach is beneficial for estimating the Cobb angle and identifying landmarks in X-ray scans with low contrast.

Machine Learning in Spine Surgery: A Narrative Review

Artificial intelligence and machine learning (ML) can offer revolutionary advances in their application to the field of spine surgery. Within the past 5 years, novel applications of ML have assisted in surgical decision-making, intraoperative imaging and navigation, and optimization of clinical outcomes. ML has the capacity to address many different clinical needs and improve diagnostic and surgical techniques. This review will discuss current applications of ML in the context of spine surgery by breaking down its implementation preoperatively, intraoperatively, and postoperatively. Ethical considerations to ML and challenges in ML implementation must be addressed to maximally benefit patients, spine surgeons, and the healthcare system. Areas for future research in augmented reality and mixed reality, along with limitations in generalizability and bias, will also be highlighted.

The Comparison of Convolutional Neural Networks and the Manual Measurement of Cobb Angle in Adolescent Idiopathic Scoliosis

STUDY DESIGN

Comparative study.

OBJECTIVE

To compare manual and deep learning-based automated measurement of Cobb angle in adolescent idiopathic scoliosis.

METHODS

We proposed a fully automated framework to measure the Cobb angle of AIS patients. Whole-spine images of 500 AIS individuals were collected. 200 digital radiographic (DR) images were labeled manually as training set, and the remaining 300 images were used to validate by mean absolute error (MAE), Pearson or spearman correlation coefficients, and intra/interclass correlation coefficients (ICCs). The relationship between accuracy of vertebral boundary identification and the subjective image quality score was evaluated.

RESULTS

The PT, MT, and TL/L Cobb angles were measured by the automated framework within 300 milliseconds. Remarkable 2.92° MAE, .967 ICC, and high correlation coefficient (r = .972) were obtained for the major curve. The MAEs of PT, MT, and TL/L were 3.04°, 2.72°, and 2.53°, respectively. The ICCs of these 3 curves were .936, .977, and .964, respectively. 88.7% (266/300) of cases had a difference range of ±5°, with 84.3% (253/300) for PT, 89.7% (269/300) for MT, and 93.0% (279/300) for TL/L. The decreased bone/soft tissue contrast (2.94 vs 3.26; P=.039) and bone sharpness (2.97 vs 3.35; P=.029) were identified in the images with MAE exceeding 5°.

CONCLUSION

The fully automated framework not only identifies the vertebral boundaries, vertebral sequences, the upper/lower end vertebras and apical vertebra, but also calculates the Cobb angle of PT, MT, and TL/L curves sequentially. The framework would shed new light on the assessment of AIS curvature.

SpineHRformer: A Transformer-Based Deep Learning Model for Automatic Spine Deformity Assessment with Prospective Validation

The Cobb angle (CA) serves as the principal method for assessing spinal deformity, but manual measurements of the CA are time-consuming and susceptible to inter- and intra-observer variability. While learning-based methods, such as SpineHRNet+, have demonstrated potential in automating CA measurement, their accuracy can be influenced by the severity of spinal deformity, image quality, relative position of rib and vertebrae, etc. Our aim is to create a reliable learning-based approach that provides consistent and highly accurate measurements of the CA from posteroanterior (PA) X-rays, surpassing the state-of-the-art method. To accomplish this, we introduce SpineHRformer, which identifies anatomical landmarks, including the vertices of endplates from the 7th cervical vertebra (C7) to the 5th lumbar vertebra (L5) and the end vertebrae with different output heads, enabling the calculation of CAs. Within our SpineHRformer, a backbone HRNet first extracts multi-scale features from the input X-ray, while transformer blocks extract local and global features from the HRNet outputs. Subsequently, an output head to generate heatmaps of the endplate landmarks or end vertebra landmarks facilitates the computation of CAs. We used a dataset of 1934 PA X-rays with diverse degrees of spinal deformity and image quality, following an 8:2 ratio to train and test the model. The experimental results indicate that SpineHRformer outperforms SpineHRNet+ in landmark detection (Mean Euclidean Distance: 2.47 pixels vs. 2.74 pixels), CA prediction (Pearson correlation coefficient: 0.86 vs. 0.83), and severity grading (sensitivity: normal-mild; 0.93 vs. 0.74, moderate; 0.74 vs. 0.77, severe; 0.74 vs. 0.7). Our approach demonstrates greater robustness and accuracy compared to SpineHRNet+, offering substantial potential for improving the efficiency and reliability of CA measurements in clinical settings.

Applying Machine Learning and Point-Set Registration to Automatically Measure the Severity of Spinal Curvature on Radiographs

OBJECTIVE

Measuring the severity of the lateral spinal curvature, or Cobb angle, is critical for monitoring and making treatment decisions for children with adolescent idiopathic scoliosis (AIS). However, manual measurement is time-consuming and subject to human error. Therefore, clinicians seek an automated measurement method to streamline workflow and improve accuracy. This paper reports on a novel machine learning algorithm of cascaded convolutional neural networks (CNN) to measure the Cobb angle on spinal radiographs automatically.

METHODS

The developed method consisted of spinal column segmentation using a CNN, vertebra localization and segmentation using iterative vertebra body location coupled with another CNN, point-set registration to correct vertebra segmentations, and Cobb angle measurement using the final segmentations. Measurement performance was evaluated with the circular mean absolute error (CMAE) and percentage within clinical acceptance ([Formula: see text]) between automatic and manual measurements. Analysis was separated by curve severity to identify any potential systematic biases using independent samples Student's t-tests.

RESULTS

The method detected 346 of the 352 manually measured Cobb angles (98%), with a CMAE of 2.8° and 91% of measurements within the 5° clinical acceptance. No statistically significant differences were found between the CMAEs of mild ([Formula: see text]), moderate (25°-45°), and severe ([Formula: see text]) groups. The average measurement time per radiograph was 17.7±10.2s, improving upon the estimated average of 30s it takes an experienced rater to measure. Additionally, the algorithm outputs segmentations with the measurement, allowing clinicians to interpret measurement results.

DISCUSSION/CONCLUSION

The developed method measured Cobb angles on radiographs automatically with high accuracy, quick measurement time, and interpretability, suggesting clinical feasibility.

Machine Learning-Based Measurement of Regional and Global Spinal Parameters Using the Concept of Incidence Angle of Inflection Points

This study delves into the application of convolutional neural networks (CNNs) in evaluating spinal sagittal alignment, introducing the innovative concept of incidence angles of inflection points (IAIPs) as intuitive parameters to capture the interplay between pelvic and spinal alignment. Pioneering the fusion of IAIPs with machine learning for sagittal alignment analysis, this research scrutinized whole-spine lateral radiographs from hundreds of patients who visited a single institution, utilizing high-quality images for parameter assessments. Noteworthy findings revealed robust success rates for certain parameters, including pelvic and C2 incidence angles, but comparatively lower rates for sacral slope and L1 incidence. The proposed CNN-based machine learning method demonstrated remarkable efficiency, achieving an impressive 80 percent detection rate for various spinal angles, such as lumbar lordosis and thoracic kyphosis, with a precise error threshold of 3.5°. Further bolstering the study's credibility, measurements derived from the novel formula closely aligned with those directly extracted from the CNN model. In conclusion, this research underscores the utility of the CNN-based deep learning algorithm in delivering precise measurements of spinal sagittal parameters, and highlights the potential for integrating machine learning with the IAIP concept for comprehensive data accumulation in the domain of sagittal spinal alignment analysis, thus advancing our understanding of spinal health.

Emerging Technologies within Spine Surgery

New innovations within spine surgery continue to propel the field forward. These technologies improve surgeons' understanding of their patients and allow them to optimize treatment planning both in the operating room and clinic. Additionally, changes in the implants and surgeon practice habits continue to evolve secondary to emerging biomaterials and device design. With ongoing advancements, patients can expect enhanced preoperative decision-making, improved patient outcomes, and better intraoperative execution. Additionally, these changes may decrease many of the most common complications following spine surgery in order to reduce morbidity, mortality, and the need for reoperation. This article reviews some of these technological advancements and how they are projected to impact the field. As the field continues to advance, it is vital that practitioners remain knowledgeable of these changes in order to provide the most effective treatment possible.

Automatic Calculation of Cervical Spine Parameters Using Deep Learning: Development and Validation on an External Dataset

STUDY DESIGN

Retrospective data analysis.

OBJECTIVES

This study aims to develop a deep learning model for the automatic calculation of some important spine parameters from lateral cervical radiographs.

METHODS

We collected two datasets from two different institutions. The first dataset of 1498 images was used to train and optimize the model to find the best hyperparameters while the second dataset of 79 images was used as an external validation set to evaluate the robustness and generalizability of our model. The performance of the model was assessed by calculating the median absolute errors between the model prediction and the ground truth for the following parameters: T1 slope, C7 slope, C2-C7 angle, C2-C6 angle, Sagittal Vertical Axis (SVA), C0-C2, Redlund-Johnell distance (RJD), the cranial tilting (CT) and the craniocervical angle (CCA).

RESULTS

Regarding the angles, we found median errors of 1.66° (SD 2.46°), 1.56° (1.95°), 2.46° (SD 2.55), 1.85° (SD 3.93°), 1.25° (SD 1.83°), .29° (SD .31°) and .67° (SD .77°) for T1 slope, C7 slope, C2-C7, C2-C6, C0-C2, CT, and CCA respectively. As concerns the distances, we found median errors of .55 mm (SD .47 mm) and .47 mm (.62 mm) for SVA and RJD respectively.

CONCLUSIONS

In this work, we developed a model that was able to accurately predict cervical spine parameters from lateral cervical radiographs. In particular, the performances on the external validation set demonstrate the robustness and the high degree of generalizability of our model on images acquired in a different institution.

Automatic measurement of the Cobb angle for adolescent idiopathic scoliosis using convolutional neural network

This study proposes a convolutional neural network method for automatic vertebrae detection and Cobb angle (CA) measurement on X-ray images for scoliosis. 1021 full-length X-ray images of the whole spine of patients with adolescent idiopathic scoliosis (AIS) were used for training and segmentation. The proposed AI algorithm's results were compared with those of the manual method by six doctors using the intraclass correlation coefficient (ICC). The ICCs recorded by six doctors and AI were excellent or good, with a value of 0.973 for the major curve in the standing position. The mean error between AI and doctors was not affected by the angle size, with AI tending to measure 1.7°-2.2° smaller than that measured by the doctors. The proposed method showed a high correlation with the doctors' measurements, regardless of the CA size, doctors' experience, and patient posture. The proposed method showed excellent reliability, indicating that it is a promising automated method for measuring CA in patients with AIS.

Validation of an artificial intelligence-based method to automate Cobb angle measurement on spinal radiographs of children with adolescent idiopathic scoliosis

BACKGROUND

Accurately measuring the Cobb angle on radiographs is crucial for diagnosis and treatment decisions for adolescent idiopathic scoliosis (AIS). However, manual Cobb angle measurement is time-consuming and subject to measurement variation, especially for inexperienced clinicians.

AIM

This study aimed to validate a novel artificial-intelligence-based (AI) algorithm that automatically measures the Cobb angle on radiographs.

DESIGN

This is a retrospective cross-sectional study.

SETTING

The population of patients attended the Stollery Children's Hospital in Alberta, Canada.

POPULATION

Children who: 1) were diagnosed with AIS, 2) were aged between 10 and 18 years old, 3) had no prior surgery, and 4) had a radiograph out of brace, were enrolled.

METHODS

A total of 330 spinal radiographs were used. Among those, 130 were used for AI model development and 200 were used for measurement validation. Automatic Cobb angle measurements were validated by comparing them with manual ones measured by a rater with 20+ years of experience. Analysis was performed using the standard error of measurement (SEM), inter-method intraclass correlation coefficient (ICC2,1), and percentage of measurements within clinical acceptance (≤5°). Subgroup analysis was conducted by severity, region, and X-ray system to identify any systematic biases.

RESULTS

The AI method detected 346 of 352 manually measured curves (mean±standard deviation: 24.7±9.5°), achieving 91% (316/346) of measurements within clinical acceptance. Excellent reliability was obtained with 0.92 ICC and 0.79° SEM. Comparable performance was found throughout all subgroups, and no systematic biases in performance affecting any subgroup were discovered. The algorithm measured each radiograph approximately 18s on average which is slightly faster than the estimated measurement time of an experienced rater. Radiographs taken by the EOS X-ray system were measured more quickly on average than those taken by a conventional digital X-ray system (10s vs. 26s).

CONCLUSIONS

An AI-based algorithm was developed to measure the Cobb angle automatically on radiographs and yielded reliable measurements quickly. The algorithm provides detailed images on how the angles were measured, providing interpretability that can give clinicians confidence in the measurements.

CLINICAL REHABILITATION IMPACT

Employing the algorithm in practice could streamline clinical workflow and optimize measurement accuracy and speed in order to inform AIS treatment decisions.

The role of Artificial intelligence in the assessment of the spine and spinal cord

Artificial intelligence (AI) application development is underway in all areas of radiology where many promising tools are focused on the spine and spinal cord. In the past decade, multiple spine AI algorithms have been created based on radiographs, computed tomography, and magnetic resonance imaging. These algorithms have wide-ranging purposes including automatic labeling of vertebral levels, automated description of disc degenerative changes, detection and classification of spine trauma, identification of osseous lesions, and the assessment of cord pathology. The overarching goals for these algorithms include improved patient throughput, reducing radiologist workload burden, and improving diagnostic accuracy. There are several pre-requisite tasks required in order to achieve these goals, such as automatic image segmentation, facilitating image acquisition and postprocessing. In this narrative review, we discuss some of the important imaging AI solutions that have been developed for the assessment of the spine and spinal cord. We focus on their practical applications and briefly discuss some key requirements for the successful integration of these tools into practice. The potential impact of AI in the imaging assessment of the spine and cord is vast and promises to provide broad reaching improvements for clinicians, radiologists, and patients alike.

Automatic deep learning-based assessment of spinopelvic coronal and sagittal alignment

PURPOSE

The purpose of this study was to evaluate an artificial intelligence (AI) solution for estimating coronal and sagittal spinopelvic alignment on conventional uniplanar two-dimensional whole-spine radiograph.

MATERIAL AND METHODS

This retrospective observational study included 100 patients (35 men, 65 women) with a median age of 14 years (IQR: 13, 15.25; age range: 3-64 years) who underwent conventional uniplanar two-dimensional whole-spine radiograph in standing position between January and July 2022. Ten most commonly used spinopelvic coronal and sagittal parameters were retrospectively measured without AI by a junior radiologist and approved or adjusted by a senior musculoskeletal radiologist to reach final measurements. Final measurements were used as the ground truth to assess AI performance for each parameter. AI performances were estimated using mean absolute errors (MAE), intraclass correlation coefficient (ICCs), and accuracy for selected clinically relevant thresholds. Readers visually classified AI outputs to assess reliability at a patient-level.

RESULTS

AI solution showed excellent consistency without bias in coronal (ICCs ≥ 0.95; MAE ≤ 2.9° or 1.97 mm) and sagittal (ICCs ≥ 0.85; MAE ≤ 4.4° or 2.7 mm) spinopelvic evaluation, except for kyphosis (ICC = 0.58; MAE = 8.7°). AI accuracy to classify low Cobb angle, severe scoliosis or frontal pelvic asymmetry was 91% (95% CI: 85-96), 99% (95% CI: 97-100) and 94% (95% CI: 89-98), respectively. Overall, AI provided reliable measurements in 72/100 patients (72%).

CONCLUSION

The AI solution used in this study for combined coronal and sagittal spinopelvic balance assessment provides results consistent with those of a senior musculoskeletal radiologist, and shows potential benefit for reducing workload in future routine implementation.

Automated measurement of spine indices on axial MR images for lumbar spinal stenosis diagnosis using segmentation-guided regression network

PURPOSE

Automated measurement of spine indices on axial magnetic resonance (MR) images plays a significant role in lumbar spinal stenosis diagnosis. Existing direct spine indices measurement approaches fail to explicitly focus on the task-specific region or feature channel with the additional information for guiding. We aim to achieve accurate spine indices measurement by introducing the guidance of the segmentation task.

METHODS

In this paper, we propose a segmentation-guided regression network (SGRNet) to achieve automated spine indices measurement. SGRNet consists of a segmentation path for generating the spine segmentation prediction and a regression path for producing spine indices estimation. The segmentation path is a U-Net-like network which includes a segmentation encoder and a decoder which generates multilevel segmentation features and segmentation prediction. The proposed segmentation-guided attention module (SGAM) in the regression encoder extracts the attention-aware regression feature under the guidance of the segmentation feature. Based on the attention-aware regression feature, a fully connected layer is utilized to output the accurate spine indices estimation.

RESULTS

Experiments on the open-access Lumbar Spine MRI data set show that SGRNet achieves state-of-the-art performance with a mean absolute error of 0.49 mm and mean Pearson correlation coefficient of 0.956 for four indices estimation.

CONCLUSIONS

The proposed SGAM in SGRNet is capable of improving the performance of spine indices measurement by focusing on the task-specific region and feature channel under the guidance of the segmentation task.

Multi-perspective region-based CNNs for vertebrae labeling in intraoperative long-length images

PURPOSE

Effective aggregation of intraoperative x-ray images that capture the patient anatomy from multiple view-angles has the potential to enable and improve automated image analysis that can be readily performed during surgery. We present multi-perspective region-based neural networks that leverage knowledge of the imaging geometry for automatic vertebrae labeling in Long-Film images - a novel tomographic imaging modality with an extended field-of-view for spine imaging.

METHOD

A multi-perspective network architecture was designed to exploit small view-angle disparities produced by a multi-slot collimator and consolidate information from overlapping image regions. A second network incorporates large view-angle disparities to jointly perform labeling on images from multiple views (viz., AP and lateral). A recurrent module incorporates contextual information and enforce anatomical order for the detected vertebrae. The three modules are combined to form the multi-view multi-slot (MVMS) network for labeling vertebrae using images from all available perspectives. The network was trained on images synthesized from 297 CT images and tested on 50 AP and 50 lateral Long-Film images acquired from 13 cadaveric specimens. Labeling performance of the multi-perspective networks was evaluated with respect to the number of vertebrae appearances and presence of surgical instrumentation.

RESULTS

The MVMS network achieved an F1 score of >96% and an average vertebral localization error of 3.3 mm, with 88.3% labeling accuracy on both AP and lateral images - (15.5% and 35.0% higher than conventional Faster R-CNN on AP and lateral views, respectively). Aggregation of multiple appearances of the same vertebra using the multi-slot network significantly improved the labeling accuracy (p < 0.05). Using the multi-view network, labeling accuracy on the more challenging lateral views was improved to the same level as that of the AP views. The approach demonstrated robustness to the presence of surgical instrumentation, commonly encountered in intraoperative images, and achieved comparable performance in images with and without instrumentation (88.9% vs. 91.2% labeling accuracy).

CONCLUSION

The MVMS network demonstrated effective multi-perspective aggregation, providing means for accurate, automated vertebrae labeling during spine surgery. The algorithms may be generalized to other imaging tasks and modalities that involve multiple views with view-angle disparities (e.g., bi-plane radiography). Predicted labels can help avoid adverse events during surgery (e.g., wrong-level surgery), establish correspondence with labels in preoperative modalities to facilitate image registration, and enable automated measurement of spinal alignment metrics for intraoperative assessment of spinal curvature.

The current and future roles of artificial intelligence in pediatric radiology

Artificial intelligence (AI) is a broad and complicated concept that has begun to affect many areas of medicine, perhaps none so much as radiology. While pediatric radiology has been less affected than other radiology subspecialties, there are some well-developed and some nascent applications within the field. This review focuses on the use of AI within pediatric radiology for image interpretation, with descriptive summaries of the literature to date. We highlight common features that enable successful application of the technology, along with some of the limitations that can inhibit the development of this field. We present some ideas for further research in this area and challenges that must be overcome, with an understanding that technology often advances in unpredictable ways.

Artificial Intelligence in Spinal Imaging: Current Status and Future Directions

Spinal maladies are among the most common causes of pain and disability worldwide. Imaging represents an important diagnostic procedure in spinal care. Imaging investigations can provide information and insights that are not visible through ordinary visual inspection. Multiscale in vivo interrogation has the potential to improve the assessment and monitoring of pathologies thanks to the convergence of imaging, artificial intelligence (AI), and radiomic techniques. AI is revolutionizing computer vision, autonomous driving, natural language processing, and speech recognition. These revolutionary technologies are already impacting radiology, diagnostics, and other fields, where automated solutions can increase precision and reproducibility. In the first section of this narrative review, we provide a brief explanation of the many approaches currently being developed, with a particular emphasis on those employed in spinal imaging studies. The previously documented uses of AI for challenges involving spinal imaging, including imaging appropriateness and protocoling, image acquisition and reconstruction, image presentation, image interpretation, and quantitative image analysis, are then detailed. Finally, the future applications of AI to imaging of the spine are discussed. AI has the potential to significantly affect every step in spinal imaging. AI can make images of the spine more useful to patients and doctors by improving image quality, imaging efficiency, and diagnostic accuracy.

Detection of Lumbar Spondylolisthesis from X-ray Images Using Deep Learning Network

Spondylolisthesis refers to the displacement of a vertebral body relative to the vertrabra below it, which can cause radicular symptoms, back pain or leg pain. It usually occurs in the lower lumbar spine, especially in women over the age of 60. The prevalence of spondylolisthesis is expected to rise as the global population ages, requiring prudent action to promptly identify it in clinical settings. The goal of this study was to develop a computer-aided diagnostic (CADx) algorithm, LumbarNet, and to evaluate the efficiency of this model in automatically detecting spondylolisthesis from lumbar X-ray images. Built upon U-Net, feature fusion module (FFM) and collaborating with (i) a P-grade, (ii) a piecewise slope detection (PSD) scheme, and (iii) a dynamic shift (DS), LumbarNet was able to analyze complex structural patterns on lumbar X-ray images, including true lateral, flexion, and extension lateral views. Our results showed that the model achieved a mean intersection over union (mIOU) value of 0.88 in vertebral region segmentation and an accuracy of 88.83% in vertebral slip detection. We conclude that LumbarNet outperformed U-Net, a commonly used method in medical image segmentation, and could serve as a reliable method to identify spondylolisthesis.

The application of artificial intelligence in spine surgery

Due to its obvious advantages in processing big data and image information, the combination of artificial intelligence and medical care may profoundly change medical practice and promote the gradual transition from traditional clinical care to precision medicine mode. In this artical, we reviewed the relevant literatures and found that artificial intelligence was widely used in spine surgery. The application scenarios included etiology, diagnosis, treatment, postoperative prognosis and decision support systems of spinal diseases. The shift to artificial intelligence model in medicine constantly improved the level of doctors' diagnosis and treatment and the development of orthopedics.

Spinopelvic measurements of sagittal balance with deep learning: systematic review and critical evaluation

PURPOSE

To summarize and critically evaluate the existing studies for spinopelvic measurements of sagittal balance that are based on deep learning (DL).

METHODS

Three databases (PubMed, WoS and Scopus) were queried for records using keywords related to DL and measurement of sagittal balance. After screening the resulting 529 records that were augmented with specific web search, 34 studies published between 2017 and 2022 were included in the final review, and evaluated from the perspective of the observed sagittal spinopelvic parameters, properties of spine image datasets, applied DL methodology and resulting measurement performance.

RESULTS

Studies reported DL measurement of up to 18 different spinopelvic parameters, but the actual number depended on the image field of view. Image datasets were composed of lateral lumbar spine and whole spine X-rays, biplanar whole spine X-rays and lumbar spine magnetic resonance cross sections, and were increasing in size or enriched by augmentation techniques. Spinopelvic parameter measurement was approached either by landmark detection or structure segmentation, and U-Net was the most frequently applied DL architecture. The latest DL methods achieved excellent performance in terms of mean absolute error against reference manual measurements (~ 2° or ~ 1 mm).

CONCLUSION

Although the application of relatively complex DL architectures resulted in an improved measurement accuracy of sagittal spinopelvic parameters, future methods should focus on multi-institution and multi-observer analyses as well as uncertainty estimation and error handling implementations for integration into the clinical workflow. Further advances will enhance the predictive analytics of DL methods for spinopelvic parameter measurement.

LEVEL OF EVIDENCE I

Diagnostic: individual cross-sectional studies with the consistently applied reference standard and blinding.

Institution-wide shape analysis of 3D spinal curvature and global alignment parameters

The spine is an articulated, 3D structure with 6 degrees of translational and rotational freedom. Clinical studies have shown spinal deformities are associated with pain and functional disability in both adult and pediatric populations. Clinical decision making relies on accurate characterization of the spinal deformity and monitoring of its progression over time. However, Cobb angle measurements are time-consuming, are limited by interobserver variability, and represent a simplified 2D view of a 3D structure. Instead, spine deformities can be described by 3D shape parameters, addressing the limitations of current measurement methods. To this end, we develop and validate a deep learning algorithm to automatically extract the vertebral midline (from the upper endplate of S1 to the lower endplate of C7) for frontal and lateral radiographs. Our results demonstrate robust performance across datasets and patient populations. Approximations of 3D spines are reconstructed from the unit normalized midline curves of 20,118 pairs of full spine radiographs belonging to 15,378 patients acquired at our institution between 2008 and 2020. The resulting 3D dataset is used to describe global imbalance parameters in the patient population and to build a statistical shape model to describe global spine shape variations in preoperative deformity patients via eight interpretable shape parameters. The developed method can identify patient subgroups with similar shape characteristics without relying on an existing shape classification system.

Current development and prospects of deep learning in spine image analysis: a literature review

BACKGROUND AND OBJECTIVE

As the spine is pivotal in the support and protection of human bodies, much attention is given to the understanding of spinal diseases. Quick, accurate, and automatic analysis of a spine image greatly enhances the efficiency with which spine conditions can be diagnosed. Deep learning (DL) is a representative artificial intelligence technology that has made encouraging progress in the last 6 years. However, it is still difficult for clinicians and technicians to fully understand this rapidly evolving field due to the diversity of applications, network structures, and evaluation criteria. This study aimed to provide clinicians and technicians with a comprehensive understanding of the development and prospects of DL spine image analysis by reviewing published literature.

METHODS

A systematic literature search was conducted in the PubMed and Web of Science databases using the keywords "deep learning" and "spine". Date ranges used to conduct the search were from 1 January, 2015 to 20 March, 2021. A total of 79 English articles were reviewed.

KEY CONTENT AND FINDINGS

The DL technology has been applied extensively to the segmentation, detection, diagnosis, and quantitative evaluation of spine images. It uses static or dynamic image information, as well as local or non-local information. The high accuracy of analysis is comparable to that achieved manually by doctors. However, further exploration is needed in terms of data sharing, functional information, and network interpretability.

CONCLUSIONS

The DL technique is a powerful method for spine image analysis. We believe that, with the joint efforts of researchers and clinicians, intelligent, interpretable, and reliable DL spine analysis methods will be widely applied in clinical practice in the future.

A Review of the Methods on Cobb Angle Measurements for Spinal Curvature

Scoliosis is a common disease of the spine and requires regular monitoring due to its progressive properties. A preferred indicator to assess scoliosis is by the Cobb angle, which is currently measured either manually by the relevant medical staff or semi-automatically, aided by a computer. These methods are not only labor-intensive but also vary in precision by the inter-observer and intra-observer. Therefore, a reliable and convenient method is urgently needed. With the development of computer vision and deep learning, it is possible to automatically calculate the Cobb angles by processing X-ray or CT/MR/US images. In this paper, the research progress of Cobb angle measurement in recent years is reviewed from the perspectives of computer vision and deep learning. By comparing the measurement effects of typical methods, their advantages and disadvantages are analyzed. Finally, the key issues and their development trends are also discussed.

Machine Learning Applications of Surgical Imaging for the Diagnosis and Treatment of Spine Disorders: Current State of the Art

Recent developments in machine learning (ML) methods demonstrate unparalleled potential for application in the spine. The ability for ML to provide diagnostic faculty, produce novel insights from existing capabilities, and augment or accelerate elements of surgical planning and decision making at levels equivalent or superior to humans will tremendously benefit spine surgeons and patients alike. In this review, we aim to provide a clinically relevant outline of ML-based technology in the contexts of spinal deformity, degeneration, and trauma, as well as an overview of commercial-level and precommercial-level surgical assist systems and decisional support tools. Furthermore, we briefly discuss potential applications of generative networks before highlighting some of the limitations of ML applications. We conclude that ML in spine imaging represents a significant addition to the neurosurgeon's armamentarium-it has the capacity to directly address and manifest clinical needs and improve diagnostic and procedural quality and safety-but is yet subject to challenges that must be addressed before widespread implementation.

W-Transformer: Accurate Cobb angles estimation by using a transformer-based hybrid structure

BACKGROUND

Scoliosis is a type of spinal deformity, which is harmful to a person's health. In severe cases, it can trigger paralysis or death. The measurement of Cobb angle plays an essential role in assessing the severity of scoliosis.

PURPOSE

The aim of this paper is to propose an automatic system for landmark detection and Cobb angle estimation, which can effectively help clinicians diagnose and treat scoliosis.

METHODS

A novel hybrid framework was proposed to measure Cobb angle precisely for clinical diagnosis, which was referred as W-Transformer due to its w-shaped architecture. First, a convolutional neural network of cascade residual blocks as our backbone was designed. Then a transformer was fused to learn the dependency information between spine and landmarks. In addition, a reinforcement branch was designed to improve the overlap of landmarks, and an improved prediction module was proposed to fine-tune the final coordinates of landmarks in Cobb angles estimation. Besides, the public AASCE MICCAI 2019 challenge was served as dataset. It supplies 609 manually labeled spine AP X-ray images, each of which contains a total of 68 landmark labels and three Cobb Angles tags.

RESULTS

From the perspective of the AASCE MICCAI 2019 challenge, we achieved a lower symmetric mean absolute percentage error (SMAPE) of 8.26% for all Cobb angles and the lowest averaged detection error of 50.89 in terms of landmark detection, compared with many state-of-the-art methods. We also provided the SMAPEs for the Cobb angles of the Proximal-Thoracic (PT), the Main-Thoracic (MT) and the Thoracic-Lumbar (TL) area, which are 5.27%, 14.59% and 20.97% respectively, however, these data were not covered in most previous studies. Statistical analysis demonstrates that our model has obtained a high level of Pearson correlation coefficient of 0.9398 (p<0.001), which shows excellent reliability of our model. Our model can yield 0.9489 (p<0.001), 0.8817 (p<0.001) and 0.9149 (p<0.001$) for PT, MT and TL, respectively. The overall variability of Cobb angle measurement is less than 4°, implying clinical value. And the mean absolute deviation (Standard Deviation) for three regions is 3.64° (4.13°), 3.84° (4.66°) and 3.80° (4.19°). The results of Student paired t-test indicate that no statistically significant differences are observed between manual measurement and our automatic approach (p value is always > 0.05). Regarding the diagnosis of scoliosis (Cobb angle > 10°), the proposed method achieves a high sensitivity of 0.9577 and a specificity of 0.8475 for all spinal regions.

CONCLUSIONS

This study offers a brand-new automatic approach that is potentially of great benefit of the complex task of landmark detection and Cobb angle evaluation, which can provide helpful navigation information about the early diagnosis of scoliosis. This article is protected by copyright. All rights reserved.

Intelligent Evaluation of Global Spinal Alignment by a Decentralized Convolutional Neural Network

Degenerative changes of the spine can cause spinal misalignment, with part of the spine arching beyond normal limits or moving in an incorrect direction, potentially resulting in back pain and significantly limiting a person’s mobility. The most important parameters related to spinal misalignment include pelvic incidence, pelvic tilt, lumbar lordosis, thoracic kyphosis, and cervical lordosis. As a general rule, alignment of the spine for diagnosis and surgical treatment is estimated based on geometrical parameters measured manually by experienced doctors. However, these measurements consume the time and effort of experts to perform repetitive tasks that could be automated, especially with the powerful support of current artificial intelligence techniques. This paper focuses on creation of a decentralized convolutional neural network to precisely measure 12 spinal alignment parameters. Specifically, this method is based on detecting regions of interest with its dimensions that decrease by three orders of magnitude to focus on the necessary region to provide the output as key points. Using these key points, parameters representing spinal alignment are calculated. The quality of the method’s performance, which is the consistency of the measurement results with manual measurement, is validated by 30 test cases and shows 10 of 12 parameters with a correlation coefficient > 0.8, with pelvic tilt having the smallest absolute deviation of 1.156°.

MPF-net: An effective framework for automated cobb angle estimation

In clinical practice, the Cobb angle is the gold standard for idiopathic scoliosis assessment, which can provide an important reference for clinicians to make surgical plan and give medical care to patients. Currently, the Cobb angle is measured manually on both anterior-posterior(AP) view X-rays and lateral(LAT) view X-rays. The clinicians first find four landmarks on each vertebra, and then they extend the line from landmarks and measure the Cobb angle by rules. The whole process is time-consuming and subjective, so that the automated Cobb angle estimation is required for efficient and reliable Cobb angle measurement. The noise in X-rays and the occlusion of vertebras are the main difficulties for automated Cobb angle estimation, and it is challenging to utilize the information between the multi-view X-rays of the same patient. Addressing these problems, in this paper, we propose an effective framework named MPF-net by using deep learning methods for automated Cobb angle estimation. We combine a vertebra detection branch and a landmark prediction branch based on the backbone convolutional neural network, which can provide the bounded area for landmark prediction. Then we propose a proposal correlation module to utilize the information between neighbor vertebras, so that we can find the vertebras hidden by ribcage and arms on LAT X-rays. We also design a feature fusion module to utilize the information in both AP and LAT X-rays for better performance. The experiment results on 2738 pair of X-rays show that our proposed MPF-net achieves precise vertebra detection and landmark prediction performance, and we get impressive 3.52 and 4.05 circular mean absolute errors on AP and LAT X-rays respectively, which is much better than previous methods. Therefore, we can provide clinicians with automated, efficient and reliable Cobb angle measurement.

An artificial intelligence powered platform for auto-analyses of spine alignment irrespective of image quality with prospective validation

BACKGROUND

Assessment of spine alignment is crucial in the management of scoliosis, but current auto-analysis of spine alignment suffers from low accuracy. We aim to develop and validate a hybrid model named SpineHRNet+, which integrates artificial intelligence (AI) and rule-based methods to improve auto-alignment reliability and interpretability.

METHODS

From December 2019 to November 2020, 1,542 consecutive patients with scoliosis attending two local scoliosis clinics (The Duchess of Kent Children's Hospital at Sandy Bay in Hong Kong; Queen Mary Hospital in Pok Fu Lam on Hong Kong Island) were recruited. The biplanar radiographs of each patient were collected with our medical machine EOS™. The collected radiographs were recaptured using smartphones or screenshots, with deidentified images securely stored. Manually labelled landmarks and alignment parameters by a spine surgeon were considered as ground truth (GT). The data were split 8:2 to train and internally test SpineHRNet+, respectively. This was followed by a prospective validation on another 337 patients. Quantitative analyses of landmark predictions were conducted, and reliabilities of auto-alignment were assessed using linear regression and Bland-Altman plots. Deformity severity and sagittal abnormality classifications were evaluated by confusion matrices.

FINDINGS

SpineHRNet+ achieved accurate landmark detection with mean Euclidean distance errors of 2·78 and 5·52 pixels on posteroanterior and lateral radiographs, respectively. The mean angle errors between predictions and GT were 3·18° and 6·32° coronally and sagittally. All predicted alignments were strongly correlated with GT (p < 0·001, R2 > 0·97), with minimal overall difference visualised via Bland-Altman plots. For curve detections, 95·7% sensitivity and 88·1% specificity was achieved, and for severity classification, 88·6-90·8% sensitivity was obtained. For sagittal abnormalities, greater than 85·2-88·9% specificity and sensitivity were achieved.

INTERPRETATION

The auto-analysis provided by SpineHRNet+ was reliable and continuous and it might offer the potential to assist clinical work and facilitate large-scale clinical studies.

FUNDING

RGC Research Impact Fund (R5017-18F), Innovation and Technology Fund (ITS/404/18), and the AOSpine East Asia Fund (AOSEA(R)2019-06).

A Survey of Methods and Technologies Used for Diagnosis of Scoliosis

The purpose of this article is to present diagnostic methods used in the diagnosis of scoliosis in the form of a brief review. This article aims to point out the advantages of select methods. This article focuses on general issues without elaborating on problems strictly related to physiotherapy and treatment methods, which may be the subject of further discussions. By outlining and categorizing each method, we summarize relevant publications that may not only help introduce other researchers to the field but also be a valuable source for studying existing methods, developing new ones or choosing evaluation strategies.

Deep learning network for medical volume data segmentation based on multi axial plane fusion

BACKGROUND AND OBJECTIVE

High-dimensional data generally contains more accurate information for medical image, e.g., computerized tomography (CT) data can depict the three dimensional structure of organs more precisely. However, the data in high-dimension often needs enormous computation and has high memory requirements in the deep learning convolution networks, while dimensional reduction usually leads to performance degradation.

METHODS

In this paper, a two-dimensional deep learning segmentation network was proposed for medical volume data based on multi-pinacoidal plane fusion to cover more information under the control of computation.This approach has conducive compatibility while using the model proposed to extract the global information between different inputs layers.

RESULTS

Our approach has worked in different backbone network. Using the approach, DeepUnet's Dice coefficient (Dice) and Positive Predictive Value (PPV) are 0.883 and 0.982 showing the satisfied progress. Various backbones can enjoy the profit of the method.

CONCLUSIONS

Through the comparison of different backbones, it can be found that the proposed network with multi-pinacoidal plane fusion can achieve better results both quantitively and qualitatively.

The measurement of Cobb angle based on spine X-ray images using multi-scale convolutional neural network

Adolescent idiopathic scoliosis (AIS) is a structural spinal deformity mainly in the coronal plane and is among the most frequent deformities in children, adolescents, and young adults, with an overall prevalence of 0.47-5.2%. The Cobb angle is an objective measure to determine the progression of deformity and plays a critical role in the planning of surgical treatment. However, existing studies suggested that Cobb angle measurement is susceptible to inter- and intra-observer variability, as well as a high variability in the definition of the end vertebra. In this study, we proposed an automatic method for the spine vertebrae segmentation using Deeplab V3+, a powerful tool that has shown success in the image segmentation of other anatomical regions but spine, and Cobb angle measurement. The segmentation performance was compared to existing mainstay neural networks. Compared to U-Net, Residual U-Net and Dilated U-Net, our method using Deeplab V3+ showed the best performance in the Dice Similarity Coefficient (DSC), accuracy, sensitivity and Jaccard Index. An excellent correlation in the final Cobb angle calculation was achieved between the smallest distance point (SDP) method and two experts (> 0.95), with a small error in the angle estimation compared (MAE < 3°). The proposed method could provide a potential tool for the automatic estimation of the Cobb angle to improve the efficiency and accuracy of the treatment workflow for AIS.

Deep Learning Automates Measurement of Spinopelvic Parameters on Lateral Lumbar Radiographs

STUDY DESIGN

Cross-sectional database study.

OBJECTIVE

The objective of this study was to develop an algorithm for the automated measurement of spinopelvic parameters on lateral lumbar radiographs with comparable accuracy to surgeons.

SUMMARY OF BACKGROUND DATA

Sagittal alignment measurements are important for the evaluation of spinal disorders. Manual measurement methods are time-consuming and subject to rater-dependent error. Thus, a need exists to develop automated methods for obtaining sagittal measurements. Previous studies of automated measurement have been limited in accuracy, inapplicable to common plain films, or unable to measure pelvic parameters.

METHODS

Images from 816 patients receiving lateral lumbar radiographs were collected sequentially and used to develop a convolutional neural network (CNN) segmentation algorithm. A total of 653 (80%) of these radiographs were used to train and validate the CNN. This CNN was combined with a computer vision algorithm to create a pipeline for the fully automated measurement of spinopelvic parameters from lateral lumbar radiographs. The remaining 163 (20%) of radiographs were used to test this pipeline. Forty radiographs were selected from the test set and manually measured by three surgeons for comparison.

RESULTS

The CNN achieved an area under the receiver-operating curve of 0.956. Algorithm measurements of L1-S1 cobb angle, pelvic incidence, pelvic tilt, and sacral slope were not significantly different from surgeon measurement. In comparison to criterion standard measurement, the algorithm performed with a similar mean absolute difference to spine surgeons for L1-S1 Cobb angle (4.30° ± 4.14° vs. 4.99° ± 5.34°), pelvic tilt (2.14° ± 6.29° vs. 1.58° ± 5.97°), pelvic incidence (4.56° ± 5.40° vs. 3.74° ± 2.89°), and sacral slope (4.76° ± 6.93° vs. 4.75° ± 5.71°).

CONCLUSION

This algorithm measures spinopelvic parameters on lateral lumbar radiographs with comparable accuracy to surgeons. The algorithm could be used to streamline clinical workflow or perform large scale studies of spinopelvic parameters.Level of Evidence: 3.

2-step deep learning model for landmarks localization in spine radiographs

In this work we propose to use Deep Learning to automatically calculate the coordinates of the vertebral corners in sagittal x-rays images of the thoracolumbar spine and, from those landmarks, to calculate relevant radiological parameters such as L1–L5 and L1–S1 lordosis and sacral slope. For this purpose, we used 10,193 images annotated with the landmarks coordinates as the ground truth. We realized a model that consists of 2 steps. In step 1, we trained 2 Convolutional Neural Networks to identify each vertebra in the image and calculate the landmarks coordinates respectively. In step 2, we refined the localization using cropped images of a single vertebra as input to another convolutional neural network and we used geometrical transformations to map the corners to the original image. For the localization tasks, we used a differentiable spatial to numerical transform (DSNT) as the top layer. We evaluated the model both qualitatively and quantitatively on a set of 195 test images. The median localization errors relative to the vertebrae dimensions were 1.98% and 1.68% for x and y coordinates respectively. All the predicted angles were highly correlated with the ground truth, despite non-negligible absolute median errors of 1.84°, 2.43° and 1.98° for L1–L5, L1–S1 and SS respectively. Our model is able to calculate with good accuracy the coordinates of the vertebral corners and has a large potential for improving the reliability and repeatability of measurements in clinical tasks.

Artificial intelligence clustering of adult spinal deformity sagittal plane morphology predicts surgical characteristics, alignment, and outcomes

PURPOSE

AI algorithms have shown promise in medical image analysis. Previous studies of ASD clusters have analyzed alignment metrics-this study sought to complement these efforts by analyzing images of sagittal anatomical spinopelvic landmarks. We hypothesized that an AI algorithm would cluster preoperative lateral radiographs into groups with distinct morphology.

METHODS

This was a retrospective review of a multicenter, prospectively collected database of adult spinal deformity. A total of 915 patients with adult spinal deformity and preoperative lateral radiographs were included. A 2 × 3, self-organizing map-a form of artificial neural network frequently employed in unsupervised classification tasks-was developed. The mean spine shape was plotted for each of the six clusters. Alignment, surgical characteristics, and outcomes were compared.

RESULTS

Qualitatively, clusters C and D exhibited only mild sagittal plane deformity. Clusters B, E, and F, however, exhibited marked positive sagittal balance and loss of lumbar lordosis. Cluster A had mixed characteristics, likely representing compensated deformity. Patients in clusters B, E, and F disproportionately underwent 3-CO. PJK and PJF were particularly prevalent among clusters A and E. Among clusters B and F, patients who experienced PJK had significantly greater positive sagittal balance than those who did not.

CONCLUSIONS

This study clustered preoperative lateral radiographs of ASD patients into groups with highly distinct overall spinal morphology and association with sagittal alignment parameters, baseline HRQOL, and surgical characteristics. The relationship between SVA and PJK differed by cluster. This study represents significant progress toward incorporation of computer vision into clinically relevant classification systems in adult spinal deformity.

LEVEL OF EVIDENCE IV

Diagnostic: individual cross-sectional studies with the consistently applied reference standard and blinding.

Deep learning approach for automatic landmark detection and alignment analysis in whole-spine lateral radiographs

Human spinal balance assessment relies considerably on sagittal radiographic parameter measurement. Deep learning could be applied for automatic landmark detection and alignment analysis, with mild to moderate standard errors and favourable correlations with manual measurement. In this study, based on 2210 annotated images of various spinal disease aetiologies, we developed deep learning models capable of automatically locating 45 anatomic landmarks and subsequently generating 18 radiographic parameters on a whole-spine lateral radiograph. In the assessment of model performance, the localisation accuracy and learning speed were the highest for landmarks in the cervical area, followed by those in the lumbosacral, thoracic, and femoral areas. All the predicted radiographic parameters were significantly correlated with ground truth values (all p < 0.001). The human and artificial intelligence comparison revealed that the deep learning model was capable of matching the reliability of doctors for 15/18 of the parameters. The proposed automatic alignment analysis system was able to localise spinal anatomic landmarks with high accuracy and to generate various radiographic parameters with favourable correlations with manual measurements.

Applications of Machine Learning to Imaging of Spinal Disorders: Current Status and Future Directions

STUDY DESIGN

Narrative review.

OBJECTIVES

We aim to describe current progress in the application of artificial intelligence and machine learning technology to provide automated analysis of imaging in patients with spinal disorders.

METHODS

A literature search utilizing the PubMed database was performed. Relevant studies from all the evidence levels have been included.

RESULTS

Within spine surgery, artificial intelligence and machine learning technologies have achieved near-human performance in narrow image classification tasks on specific datasets in spinal degenerative disease, spinal deformity, spine trauma, and spine oncology.

CONCLUSION

Although substantial challenges remain to be overcome it is clear that artificial intelligence and machine learning technology will influence the practice of spine surgery in the future.

Classification of neurofibromatosis-related dystrophic or nondystrophic scoliosis based on image features using Bilateral CNN

PURPOSE

We developed a system that can automatically classify cases of scoliosis secondary to neurofibromatosis type 1 (NF1-S) using deep learning algorithms (DLAs) and improve the accuracy and effectiveness of classification, thereby assisting surgeons with the auxiliary diagnosis.

METHODS

Comprehensive experiments in NF1 classification were performed based on a dataset consisting 211 NF1-S (131 dystrophic and 80 nondystrophic NF1-S) patients. Additionally, 100 congenital scoliosis (CS), 100 adolescent idiopathic scoliosis (AIS) patients, and 114 normal controls were used for experiments in primary classification. For identification of NF1-S with nondystrophic or dystrophic curves, we devised a novel network (i.e., Bilateral convolutional neural network [CNN]) utilizing a bilinear-like operation to discover the similar interest features between whole spine AP and lateral x-ray images. The performance of Bilateral CNN was compared with spine surgeons, conventional DLAs (i.e., VGG-16, ResNet-50, and Bilinear CNN [BCNN]), recently proposed DLAs (i.e., ShuffleNet, MobileNet, and EfficientNet), and Two-path BCNN which was the extension of BCNN using AP and lateral x-ray images as inputs.

RESULTS

In NF1 classification, our proposed Bilateral CNN with 80.36% accuracy outperformed the other seven DLAs ranging from 61.90% to 76.19% with fivefold cross-validation. It also outperformed the spine surgeons (with an average accuracy of 77.5% for the senior surgeons and 65.0% for the junior surgeons). Our method is highly generalizable due to the proposed methodology and data augmentation. Furthermore, the heatmaps extracted by Bilateral CNN showed curve pattern and morphology of ribs and vertebrae contributing most to the classification results. In primary classification, our proposed method with an accuracy of 87.92% also outperformed all the other methods with varied accuracies between 52.58% and 83.35% with fivefold cross-validation.

CONCLUSIONS

The proposed Bilateral CNN can automatically capture representative features for classifying NF1-S utilizing AP and lateral x-ray images, leading to a relatively good performance. Moreover, the proposed method can identify other spine deformities for auxiliary diagnosis.

A narrative review of machine learning as promising revolution in clinical practice of scoliosis

Machine learning (ML), as an advanced domain of artificial intelligence (AI), is progressively changing our view of the world. By implementing its algorithms, our ability to detect previously undiscoverable patterns in data has the potential to revolutionize predictive analytics. Scoliosis, as a relatively specialized branch in the spine field, mainly covers the pediatric, adult and the elderly populations, and its diagnosis and treatment remain difficult. With recent efforts and interdisciplinary cooperation, ML has been widely applied to investigate issues related to scoliosis, and surprisingly augment a surgeon's ability in clinical practice related to scoliosis. Meanwhile, ML models penetrate in every stage of the clinical practice procedure of scoliosis. In this review, we first present a brief description of the application of ML in the clinical practice procedures regarding scoliosis, including screening, diagnosis and classification, surgical decision making, intraoperative manipulation, complication prediction, prognosis prediction and rehabilitation. Meanwhile, the ML models and specific applications adopted are presented. Additionally, current limitations and future directions are briefly discussed regarding its use in the field of scoliosis. We believe that the implementation of ML is a promising revolution to assist surgeons in all aspects of clinical practice related to scoliosis in the near future.