A Noninvasive 3D Body Scanner and Software Tool towards Analysis of Scoliosis

Measurement of distances and locations of thoracic and lumbar vertebral bodies from CT scans in cases of spinal deformation

BACKGROUND

Spinal deformations, except for acute injuries, are among the most frequent reasons for visiting an orthopaedic specialist and musculoskeletal treatment in adults and adolescents. Data on the morphology and anatomical structures of the spine are therefore of interest to orthopaedics, physicians, and medical scientists alike, in the broad field from diagnosis to therapy and in research.

METHODS

Along the course of developing supplementary methods that do not require the use of ionizing radiation in the assessment of scoliosis, twenty CT scans from females and males with various severity of spinal deformations and body shape have been analysed with respect to the transverse distances between the vertebral body and the spinous process end tip and the skin, respectively, at thoracic and lumbar vertebral levels. Further, the locations of the vertebral bodies have been analysed in relation to the patient's individual body shape and shown together with those from other patients by normalization to the area encompassed by the transverse body contour.

RESULTS

While the transverse distance from the vertebral body to the skin varies between patients, the distances from the vertebral body to the spinous processes end tips tend to be rather similar across different patients of the same gender. Tables list the arithmetic mean distances for all thoracic and lumbar vertebral levels and for different regions upon grouping into mild, medium, and strong spinal deformation and according to the range of spinal deformation.

CONCLUSIONS

The distances, the clustering of the locations of the vertebral bodies as a function of the vertebral level, and the trends therein could in the future be used in context with biomechanical modeling of a patient's individual spinal deformation in scoliosis assessment using 3D body scanner images during follow-up examinations.

Artificial Intelligence in Medical Imaging: Analyzing the Performance of ChatGPT and Microsoft Bing in Scoliosis Detection and Cobb Angle Assessment

Open-source artificial intelligence models (OSAIM) find free applications in various industries, including information technology and medicine. Their clinical potential, especially in supporting diagnosis and therapy, is the subject of increasingly intensive research. Due to the growing interest in artificial intelligence (AI) for diagnostic purposes, we conducted a study evaluating the capabilities of AI models, including ChatGPT and Microsoft Bing, in the diagnosis of single-curve scoliosis based on posturographic radiological images. Two independent neurosurgeons assessed the degree of spinal deformation, selecting 23 cases of severe single-curve scoliosis. Each posturographic image was separately implemented onto each of the mentioned platforms using a set of formulated questions, starting from 'What do you see in the image?' and ending with a request to determine the Cobb angle. In the responses, we focused on how these AI models identify and interpret spinal deformations and how accurately they recognize the direction and type of scoliosis as well as vertebral rotation. The Intraclass Correlation Coefficient (ICC) with a 'two-way' model was used to assess the consistency of Cobb angle measurements, and its confidence intervals were determined using the F test. Differences in Cobb angle measurements between human assessments and the AI ChatGPT model were analyzed using metrics such as RMSEA, MSE, MPE, MAE, RMSLE, and MAPE, allowing for a comprehensive assessment of AI model performance from various statistical perspectives. The ChatGPT model achieved 100% effectiveness in detecting scoliosis in X-ray images, while the Bing model did not detect any scoliosis. However, ChatGPT had limited effectiveness (43.5%) in assessing Cobb angles, showing significant inaccuracy and discrepancy compared to human assessments. This model also had limited accuracy in determining the direction of spinal curvature, classifying the type of scoliosis, and detecting vertebral rotation. Overall, although ChatGPT demonstrated potential in detecting scoliosis, its abilities in assessing Cobb angles and other parameters were limited and inconsistent with expert assessments. These results underscore the need for comprehensive improvement of AI algorithms, including broader training with diverse X-ray images and advanced image processing techniques, before they can be considered as auxiliary in diagnosing scoliosis by specialists.

Non-Invasive Assessment of Back Surface Topography: Technologies, Techniques and Clinical Utility

(1) Background: Frequent exposure to ionising radiation is often used to determine the diagnosis of adolescent idiopathic scoliosis (AIS), a lateral curvature of the spine in those aged between 10 and 18 years, and a treatment plan according to Cobb angle. This narrative review outlines the clinical utility of surface topography (ST), a radiation-free imaging modality. (2) Methods: Publicly available databases were searched to yield literature related to ST. Identified articles were classified based on the equipment used and in order of how it was developed, i.e., historical, recent developments, and state-of-the-art developments. (3) Conclusions: ST is a reliable cost-effective non-invasive technique that provides an alternative to radiation-based imaging to aid with the diagnosis and potential screening of AIS. Several scanning methods are available, which allows ST to be used in several clinical environments. Limitations of inter-reliability and differences of apparatus resulting in variations of data have been noted through this narrative review.

Mechatronic Design and Experimental Research of an Automated Photogrammetry-Based Human Body Scanner

The article concerns the mechatronic design and experimental investigations of the HUBO automated human body scanning system. Functional problems that should be solved by using the developed scanning system are defined. These include reducing the number of sensors used while eliminating the need to rotate a human and ensuring the automation of the scanning process. Research problems that should be the subject of experimental research are defined. The current state of the art in the field of systems and techniques for scanning the human figure is described. The functional and technical assumptions for the HUBO scanning system are formulated. The mechanical design of the scanner, the hardware and information system architectures as well as the user's mobile application are presented. The method of operation of the scanning system and its innovative features are discussed. It is demonstrated that the developed solution of the scanning system allows the identified problems to be overcome. The methodology of the experimental research of the scanning system based on the photogrammetry technique is described. The results of laboratory studies with the use of dummies and experimental research with human participation are presented. The scope of the research carried out allows answers to the identified research problems related to the scanning of the human figure using the photogrammetry technique to be obtained. As part of laboratory tests using a measuring dummy, a mean error of 0.65 mm and standard deviation of the mean of 0.65 mm were obtained for the best scanner configuration. Research with human participation was carried out for the scanner version, in which the scanning time was 30 s, with the possibility of its reduction to 15 s. The results of studies using realistic dummies and with human participation were compared using the root mean square error parameter (RMSE) provided by the AliceVision framework, which was available for all analyzed objects. As a result, it was observed that these results are comparable, i.e., the RMSE parameter is equal to about 1 px.

Reliability and Validity of Scoliosis Measurements Obtained with Surface Topography Techniques: A Systematic Review

BACKGROUND

Surface topography (ST) is one of the methods in scoliosis assessment. This study aimed to systematically review the reliability and validity of the ST measurements for assessing scoliosis.

METHODS

A literature search of four databases was performed and is reported following PRISMA guidelines. The methodological quality was evaluated using Brink and Louw appraisal tool and data extraction was performed. The results were analyzed and synthesized qualitatively using the level of evidence method.

RESULTS

Eighteen studies were included and analyzed. Four were evaluated for reliability, six for validity, and eight for reliability and validity. The methodological quality of fourteen studies was high. Good to excellent intra-investigator reliability was shown on asymmetry, sagittal, horizontal, and most frontal ST measurements (evidence level: strong). Asymmetry and most frontal, sagittal, horizontal ST measurements showed good to excellent inter-investigator reliability (evidence level: moderate). When comparing corresponding ST and radiological measurements, good to strong validity was shown on most frontal, sagittal, and asymmetry measurements (evidence level: strong). Formetric measurements had good intra-investigator reliability and validity (evidence level: strong).

CONCLUSIONS

Most asymmetry, sagittal, and frontal ST measurements showed satisfactory reliability and validity. Horizontal ST measurements showed good reliability and poor validity. The ST technique may have great potential in assessing scoliosis, especially in reducing radiation exposure and performing cosmetic assessments.

Scoliosis assessment tools to reduce follow-up X-rays

Purpose

Clinical examinations of scoliosis often includes X-rays. Regular clinical monitoring is recommended in particular at young age, because of the high risk of progression during periods of rapid growth. Supplementary methods free of ionizing radiation thus could help to reduce the potential risk of ionizing radiation related health problems.

Methods

Twelve 3D scan images from female and male patients with different types and severities of spinal deformations were analysed using body scanner image analysis tools. The scan images were captured with a 3D body scanner, which used an infrared sensor and a video camera. To calculate and compare with the patient's specific spinal deformations, simulations based on finite elements methods were performed on biomechanical models of ribcage and spinal column.

Results

The methods and parameters presented here are in good agreement with corresponding X-rays, used for comparison. High correlation coefficients of ‖ρ _s ‖ ≥ 0.87 between Cobb angle and lateral deviation, as well as between Cobb angle and rotation of the vertebrae, indicate that the parameters could provide supplementary informations in the assessment of spinal deformations. So-called apex angles, in addition introduced to relate the results of the present method with Cobb angles, show strong correlations of ‖ρ _s ‖ ≥ 0.68 and thus could be used for comparison in later follow-up examinations.

Conclusion

The user-friendly 3D body scanner image analysis tools enable orthopaedic specialists to simulate, visualize and inspect patient's specific spinal deformations. The method is intended to provide supplementary information in complement to the Cobb angle for the assessment of spinal deformations in clinical daily routine and might have the potential to reduce X-rays in follow-up examinations.

The Translational Potential of this article

The study presents a new method, based on 3D body scanner images and biomechanical modelling, that has the potential to reduce X-rays when monitoring scoliosis especially in young patients.

A non-invasive method for scoliosis assessment—A new mathematical concept using polar angle

Scoliosis is one of the most common pediatric spinal diseases that leads to a three-dimensional deformity of the spine and has a high risk of progression during growth. Regular clinical monitoring and follow-up X-rays are needed to providing proper treatment at that time. Repetitive X-rays can results in an increased risk of radiation related health problems. We present a non-invasive, ionizing radiation-free method for assessing scoliosis and its progression from the 3D images of the body torso, captured by a body scanner. A new concept is introduced based on a mathematical method in polar coordinate system to quantify and characterize the deformities in the torso from 2D transverse cross-sections of the 3D torso images at example cases for a healthy individual and for two patients with scoliosis. To capture quantitatively the characteristics of scoliosis, and to verify them at the example cases two asymmetry parameters and a linear fitting parameter are calculated: a) back side area asymmetry, b) left right area asymmetry, and c) coefficient of determination (R²). Within the analyzed patients, both the area asymmetries are maximum at the apex of scoliosis, and increase with the severity of scoliosis. R² values are smaller in the case of patients compared with the healthy. Furthermore, the parameters show a trend when compared with the Cobb angle from the X-ray and the findings match with clinical examination. Therefore, the quantities are able to capture, certain characteristics associated with scoliosis. These quantities can be compared as a measure of deformities of torso, during the follow-up examinations in the future, without ionizing radiations.

Obtaining patient torso geometry for the design of scoliosis braces. A study of the accuracy and repeatability of handheld 3D scanners

OBJECTIVE

Obtaining patient geometry is crucial in scoliosis brace design for patients with adolescent idiopathic scoliosis. Advances in 3D scanning technologies provide the opportunity to obtain patient geometries quickly with fewer resources during the design process compared with the plaster-cast method. This study assesses the accuracy and repeatability of such technologies for this application.

METHODS

The accuracy and repeatability of three different handheld scanners and phone-photogrammetry was assessed using different mesh generation software. Twenty-four scans of a single subject's torso were analyzed for accuracy and repeatability based on anatomical landmark distances and surface deviation maps.

RESULTS

Mark II and Structure ST01 scanners showed maximum mean surface deviations of 1.74 ± 3.63 mm and 1.64 ± 3.06 mm, respectively. Deviations were lower for the Peel 1 scanner (maximum of -0.35 ± 2.8 mm) but higher with the use of phone-photogrammetry (maximum of -5.1 ± 4.8 mm). The mean absolute errors of anatomical landmark distance measurements from torso meshes obtained with the Peel 1, Mark II, and ST01 scanners were all within 9.3 mm (3.6%), whereas phone-photogrammetry errors were as high as 18 mm (7%).

CONCLUSIONS

Low-cost Mark II and ST01 scanners are recommended for obtaining torso geometries because of their accuracy and repeatability. Subject's breathing/movement affects the resultant geometry around the abdominal and anterolateral regions.

Model-Based Radiation-Free Assessment of Scoliosis: A Principle Validation Study

Purpose

Adolescent scoliosis is one of the common pediatric spinal diseases which has a high risk of progression due to the rapid growth of the skeleton during the growing stage therefore needs regular clinical monitoring including X-rays. Because X-rays could lead to ionizing radiation-related health problems, an ionizing radiation-free, non-invasive method is presented here to estimate the degree of scoliosis and to potentially support the medical assessment.

Methods

The radiation-free body scanner provides a 3D surface scan of the torso. A basic 3D structure of the human ribcage and vertebral column was modeled and simulated with computer-aided design software and finite element method calculation. For comparison with X-rays, courses of vertebral columns derived from 3D torso images and 3D models were analyzed with respect to their apex positions and angles.

Results

The methods show good results in the estimation of the apex positions of scoliosis. Strong correlations (R = 0.8924) were found between the apex and Cobb angle from X-rays. Similar correlations (R = 0.8087) was obtained between the apex angles extracted from X-rays and the combination of torso scan images with 3D model simulations. Promising agreement was obtained between the spinal trajectories extracted from X-ray and 3D torso images.

Conclusions

Very strong correlations suggest that the apex angle could potentially be used for scoliosis assessment in follow-up examinations in complement to the Cobb angle. However, further improvements of the methods and tests on a larger number of data set are necessary before their introduction into the clinical application.

White-Light Body Scanning Captures Three-Dimensional Shoulder Deformity After Displaced Diaphyseal Clavicle Fracture

OBJECTIVE

We sought to determine if white-light three-dimensional (3D) body scanning can identify clinically relevant shoulder girdle deformity after displaced diaphyseal clavicle fracture (DCF).

METHODS

Adult patients with DCF (OTA/AO 15A) were prospectively enrolled. Four subcutaneous osseous landmarks were used to measure shoulder girdle morphology of the injured and uninjured shoulder. Measurements were made both manually with a tape measure and digitally with a white-light 3D scanner. Bilateral radiographs were obtained, and clavicle length was recorded. Quick-Disabilities of the Arm, Shoulder, and Hand surveys were administered at injury and at 6 and 12 weeks.

RESULTS

Twenty-two patients were included in the study. At the initial visit, all patients had significant differences in deformity measurements between injured and uninjured shoulders as measured by 3D scanning. There was no difference between shoulders measured using manual measurements. At 6 and 12 weeks, shoulder asymmetry was significantly less in patients treated with surgery compared with nonoperative patients as measured by the 3D scanner alone. Clavicle shortening measured on 3D scanning had weak and moderate positive correlations to radiographs (R = 0.27) and manual measurements (R = 0.53), respectively. Patients treated with surgery had significant functional improvements by 6 weeks, and a similar improvement was not seen until 12 weeks in nonsurgical patients.

CONCLUSION

White-light 3D scanning was able to identify and monitor clinically relevant shoulder girdle deformity after DCF. This tool may become a useful adjunct to clinical examination and radiographic assessment, when determining clinically relevant deformity thresholds. In the future, quantifying and understanding shoulder deformity may inform clinical decision making in these patients.

LEVEL OF EVIDENCE

Prognostic Level IV. See Instructions for Authors for a complete description of levels of evidence.

Assessment of adolescent idiopathic scoliosis from body scanner image by finite element simulations

Adolescent idiopathic scoliosis, is a three-dimensional spinal deformity characterized by lateral curvature and axial rotation around the vertical body axis of the spine, the cause of which is yet unknown. The fast progression entails regular clinical monitoring, including X-rays. Here we present an approach to evaluate scoliosis from the three-dimensional image of a patient’s torso, captured by an ionizing radiation free body scanner, in combination with a model of the ribcage and spine. A skeletal structure of the ribcage and vertebral column was modelled with computer aided designed software and was used as an initial structure for macroscopic finite element method simulations. The basic vertebral column model was created for an adult female in an upright position. The model was then used to simulate the patient specific scoliotic spine configurations. The simulations showed that a lateral translation of a vertebral body results in an effective axial rotation and could reproduce the spinal curvatures. The combined method of three-dimensional body scan and finite element model simulations thus provide quantitative anatomical information about the position, rotation and inclination of the thoracic and lumbar vertebrae within a three-dimensional torso. Furthermore, the simulations showed unequal distributions of stress and strain profiles across the intervertebral discs, due to their distortions, which might help to further understand the pathogenesis of scoliosis.

An ontology-based module of the information system ScolioMedIS for 3D digital diagnosis of adolescent scoliosis

BACKGROUND AND OBJECTIVE

Conventional information systems are built on top of a relational database. The main weakness of these systems is impossibility to define stable data schema ahead when the knowledge of the system is evolving and dynamic. The widely accepted alternatives to relational databases are ontologies that can be used for designing information systems. Many research papers describe various methods for improving reliability and precision in generating the type of the Lenke classification based on the image processing techniques or a computer program, but all of them require radiograph images. The main objective of this paper is to demonstrate the development of an ontology-based module of the information system ScolioMedIS for adolescent idiopathic scoliosis (AIS) diagnosis and monitoring, which uses optical 3D methods to determine the Lenke classification of AIS and to avoid harmful effects of traditional radiation diagnosis.

METHODS

For creating an ontology-based module of the ScolioMedIS we used the following steps: specification, conceptualization, formalization and implementation. In the specification and conceptualization phase we performed data collection and analysis to define domain, concepts and relationships for ontology design. In the formalization and implementation stage we developed the OBR-Scolio ontology and the ontology-based module of the ScolioMedIS. The module employs the Protégé-OWL API, as a collection of Java interfaces for the OBR-Scolio ontology, which enables the creating, deleting, and editing of the basic elements of the OBR-Scolio ontology, as well as the querying of the ontology.

RESULTS

The ontology-based module of ScolioMedIS is tested on the datasets of 20 female and 15 male patients with AIS between the ages of 11 and 18, to categorize spinal curvatures and to automatically generate statistical indicators about the frequency of the basic spinal curvatures, degree of progression or regression of deformity and statistical indicators about curvature characteristics according to the Lenke classification system and Lenke scoliosis types. Results are then compared with analysis of the Lenke classification of 315 observed patients, performed using traditional radiation techniques.

CONCLUSIONS

This part of the system allows continuous monitoring of the progression/regression of spinal curvatures for each registered patient, which may provide a better management of scoliosis (diagnosis and treatment).