A method to reconstruct patient-specific proximal femur surface models from planar pre-operative radiographs

3D shape reconstruction of the femur from planar X-ray images using statistical shape and appearance models

Major trauma is a condition that can result in severe bone damage. Customised orthopaedic reconstruction allows for limb salvage surgery and helps to restore joint alignment. For the best possible outcome three dimensional (3D) medical imaging is necessary, but its availability and access, especially in developing countries, can be challenging. In this study, 3D bone shapes of the femur reconstructed from planar radiographs representing bone defects were evaluated for use in orthopaedic surgery. Statistical shape and appearance models generated from 40 cadaveric X-ray computed tomography (CT) images were used to reconstruct 3D bone shapes. The reconstruction simulated bone defects of between 0% and 50% of the whole bone, and the prediction accuracy using anterior-posterior (AP) and anterior-posterior/medial-lateral (AP/ML) X-rays were compared. As error metrics for the comparison, measures evaluating the distance between contour lines of the projections as well as a measure comparing similarities in image intensities were used. The results were evaluated using the root-mean-square distance for surface error as well as differences in commonly used anatomical measures, including bow, femoral neck, diaphyseal-condylar and version angles between reconstructed surfaces from the shape model and the intact shape reconstructed from the CT image. The reconstructions had average surface errors between 1.59 and 3.59 mm with reconstructions using the contour error metric from the AP/ML directions being the most accurate. Predictions of bow and femoral neck angles were well below the clinical threshold accuracy of 3°, diaphyseal-condylar angles were around the threshold of 3° and only version angle predictions of between 5.3° and 9.3° were above the clinical threshold, but below the range reported in clinical practice using computer navigation (i.e., 17° internal to 15° external rotation). This study shows that the reconstructions from partly available planar images using statistical shape and appearance models had an accuracy which would support their potential use in orthopaedic reconstruction.

2D-3D reconstruction of distal forearm bone from actual X-ray images of the wrist using convolutional neural networks

The purpose of the study was to develop a deep learning network for estimating and constructing highly accurate 3D bone models directly from actual X-ray images and to verify its accuracy. The data used were 173 computed tomography (CT) images and 105 actual X-ray images of a healthy wrist joint. To compensate for the small size of the dataset, digitally reconstructed radiography (DRR) images generated from CT were used as training data instead of actual X-ray images. The DRR-like images were generated from actual X-ray images in the test and adapted to the network, and high-accuracy estimation of a 3D bone model from a small data set was possible. The 3D shape of the radius and ulna were estimated from actual X-ray images with accuracies of 1.05 ± 0.36 and 1.45 ± 0.41 mm, respectively.

Bone Mechanoregulation Allows Subject-Specific Load Estimation Based on Time-Lapsed Micro-CT and HR-pQCT in Vivo

Patients at high risk of fracture due to metabolic diseases frequently undergo long-term antiresorptive therapy. However, in some patients, treatment is unsuccessful in preventing fractures or causes severe adverse health outcomes. Understanding load-driven bone remodelling, i.e., mechanoregulation, is critical to understand which patients are at risk for progressive bone degeneration and may enable better patient selection or adaptive therapeutic intervention strategies. Bone microarchitecture assessment using high-resolution peripheral quantitative computed tomography (HR-pQCT) combined with computed mechanical loads has successfully been used to investigate bone mechanoregulation at the trabecular level. To obtain the required mechanical loads that induce local variances in mechanical strain and cause bone remodelling, estimation of physiological loading is essential. Current models homogenise strain patterns throughout the bone to estimate load distribution in vivo, assuming that the bone structure is in biomechanical homoeostasis. Yet, this assumption may be flawed for investigating alterations in bone mechanoregulation. By further utilising available spatiotemporal information of time-lapsed bone imaging studies, we developed a mechanoregulation-based load estimation (MR) algorithm. MR calculates organ-scale loads by scaling and superimposing a set of predefined independent unit loads to optimise measured bone formation in high-, quiescence in medium-, and resorption in low-strain regions. We benchmarked our algorithm against a previously published load history (LH) algorithm using synthetic data, micro-CT images of murine vertebrae under defined experimental in vivo loadings, and HR-pQCT images from seven patients. Our algorithm consistently outperformed LH in all three datasets. In silico-generated time evolutions of distal radius geometries (n = 5) indicated significantly higher sensitivity, specificity, and accuracy for MR than LH (p < 0.01). This increased performance led to substantially better discrimination between physiological and extra-physiological loading in mice (n = 8). Moreover, a significantly (p < 0.01) higher association between remodelling events and computed local mechanical signals was found using MR [correct classification rate (CCR) = 0.42] than LH (CCR = 0.38) to estimate human distal radius loading. Future applications of MR may enable clinicians to link subtle changes in bone strength to changes in day-to-day loading, identifying weak spots in the bone microstructure for local intervention and personalised treatment approaches.

Stochastic PCA-Based Bone Models from Inverse Transform Sampling: Proof of Concept for Mandibles and Proximal Femurs

Principal components analysis is a powerful technique which can be used to reduce data dimensionality. With reference to three-dimensional bone shape models, it can be used to generate an unlimited number of models, defined by thousands of nodes, from a limited (less than twenty) number of scalars. The full procedure has been here described in detail and tested. Two databases were used as input data: the first database comprised 40 mandibles, while the second one comprised 98 proximal femurs. The “average shape” and principal components that were required to cover at least 90% of the whole variance were identified for both bones, as well as the statistical distributions of the respective principal components weights. Fifteen principal components sufficed to describe the mandibular shape, while nine components sufficed to describe the proximal femur morphology. A routine has been set up to generate any number of mandible or proximal femur geometries, according to the actual statistical shape distributions. The set-up procedure can be generalized to any bone shape given a sufficiently large database of the respective 3D shapes.

Validation of 3D finite element models from simulated DXA images for biofidelic simulations of sideways fall impact to the hip

Computed tomography (CT)-derived finite element (FE) models have been proposed as a tool to improve the current clinical assessment of osteoporosis and personalized hip fracture risk by providing an accurate estimate of femoral strength. However, this solution has two main drawbacks, namely: (i) 3D CT images are needed, whereas 2D dual-energy x-ray absorptiometry (DXA) images are more generally available, and (ii) quasi-static femoral strength is predicted as a surrogate for fracture risk, instead of predicting whether a fall would result in a fracture or not. The aim of this study was to combine a biofidelic fall simulation technique, based on 3D computed tomography (CT) data with an algorithm that reconstructs 3D femoral shape and BMD distribution from a 2D DXA image. This approach was evaluated on 11 pelvis-femur constructs for which CT scans, ex vivo sideways fall impact experiments and CT-derived biofidelic FE models were available. Simulated DXA images were used to reconstruct the 3D shape and bone mineral density (BMD) distribution of the left femurs by registering a projection of a statistical shape and appearance model with a genetic optimization algorithm. The 2D-to-3D reconstructed femurs were meshed, and the resulting FE models inserted into a biofidelic FE modeling pipeline for simulating a sideways fall. The median 2D-to-3D reconstruction error was 1.02 mm for the shape and 0.06 g/cm³ for BMD for the 11 specimens. FE models derived from simulated DXAs predicted the outcome of the falls in terms of fracture versus non-fracture with the same accuracy as the CT-derived FE models. This study represents a milestone towards improved assessment of hip fracture risk based on widely available clinical DXA images.

Estimating and abstracting the 3D structure of feline bones using neural networks on X-ray (2D) images

Computing 3D bone models using traditional Computed Tomography (CT) requires a high-radiation dose, cost and time. We present a fully automated, domain-agnostic method for estimating the 3D structure of a bone from a pair of 2D X-ray images. Our triplet loss-trained neural network extracts a 128-dimensional embedding of the 2D X-ray images. A classifier then finds the most closely matching 3D bone shape from a predefined set of shapes. Our predictions have an average root mean square (RMS) distance of 1.08 mm between the predicted and true shapes, making our approach more accurate than the average achieved by eight other examined 3D bone reconstruction approaches. Each embedding extracted from a 2D bone image is optimized to uniquely identify the 3D bone CT from which the 2D image originated and can serve as a kind of fingerprint of each bone; possible applications include faster, image content-based bone database searches for forensic purposes.

An analytical method to create patient-specific deformed bone models using X-ray images and a healthy bone model

Generation of patient-specific bone models from X-ray images is useful for various medical applications such as total hip replacement, implant manufacturing, knee kinematic studies and deformity correction. These models may provide valuable information required for a more reliable operation. In this work, we propose a new algorithm for generating patient-specific 3D models of femur and tibia with deformity, using only a generic healthy bone model and some simple measurements taken on the X-ray images of the diseased bone. Using the X-ray measurements, an interpolation function (a polynomial or a cubic spline) is fit to the mid-diaphyseal curve of the actual bone and the generic bone model is deformed in the guidance of this function with free form deformation method. The created models are intended to be used mainly for the visualization of fixation procedure in software-supported external fixation systems. An error measure is defined to quantify the error in this matching procedure. The method is found to be capable of producing deformed tibia models that satisfactorily reflect the actual bones, as confirmed by two orthopaedic surgeons who use software-supported external fixation systems regularly.

Review of 2-D/3-D Reconstruction Using Statistical Shape and Intensity Models and X-Ray Image Synthesis: Toward a Unified Framework

Patient-specific three-dimensional (3-D) bone models are useful for a number of clinical applications such as surgery planning, postoperative evaluation, as well as implant and prosthesis design. Two-dimensional-to-3-D (2-D/3-D) reconstruction, also known as model-to-modality or atlas-based 2-D/3-D registration, provides a means of obtaining a 3-D model of a patient's bones from their 2-D radiographs when 3-D imaging modalities are not available. The preferred approach for estimating both shape and density information (that would be present in a patient's computed tomography data) for 2-D/3-D reconstruction makes use of digitally reconstructed radiographs and deformable models in an iterative, non-rigid, intensity-based approach. Based on a large number of state-of-the-art 2-D/3-D bone reconstruction methods, a unified mathematical formulation of the problem is proposed in a common conceptual framework, using unambiguous terminology. In addition, shortcomings, recent adaptations, and persisting challenges are discussed along with insights for future research.

Three dimensional (3D) modelling and surgical planning in trauma and orthopaedics

INTRODUCTION

Three dimensional (3D) modelling facilitates visualization, manipulation, and analysis of image data, the three dimensional format of such image, allows a better appreciation of the geometry, size, and exact relationship between diseased and normal tissue. The role in orthopaedic surgical planning is highlighted.

DISCUSSION

Surgical procedures in orthopaedics and trauma rely on imaging, which in addition to making the diagnosis also assist in planning the elected surgical procedure through to a successful execution. In the area of trauma management, the use of 3D modelling eases the execution of fracture operative approach, reduction and appropriate fixation, especially in complex fractures, like in the acetabulum. Post trauma correction of deformities is made easier using 3D modelling in the preoperative surgical planning. For the purposes of tumour excision, a more acceptable margin of excision can be planned and successfully implemented. There is an increasing role for computer assisted procedures in arthroplasty, the use of a 3D image for preoperative planning promises to deliver patient specific bone cut in dimensions that will allow less of inappropriate loading thereby promoting longevity of the implant especially in younger patients.

CONCLUSION

The processes for acquiring 3D images need to be made simpler and easier to gain more widespread use in orthopaedics and trauma.

Patient-specific modelling of bone and bone-implant systems: the challenges

In the past three decades, finite element (FE) modelling has provided considerable understanding to the area of musculoskeletal biomechanics. However, most of this understanding has been generated using generic, standardised or idealised models. Patient-specific modelling (PSM) is almost never used for making clinical decisions. Imaging technologies have made it possible to create patient-specific geometries and FE meshes for modelling. While these have brought us closer to PSM, several challenges associated with the definition of material properties, loads, boundary conditions and interaction between components still need to be overcome. This study reviews the current status of PSM with respect to defining material behaviour and prescribing boundary conditions and interactions. With regard to the constitutive modelling of bone, it is seen that imaging is being increasingly used to define elastic properties (isotropic as well as anisotropic). However, the post-elastic and time-dependent behaviour, important for several modelling situations, is mostly obtained from in vitro experiments. Strain-based plasticity, not commonly available in FE codes, appears to have the potential of reducing an element of patient-specificity in modelling the yielding behaviour of bone. PSM of real boundary conditions that include muscles and ligaments continues to remain a challenge; many clinically relevant questions can be, however, answered without their inclusion. Simulation techniques to undertake PSM of interactions between bone and uncemented implants are available. Interference fit employed in both joint replacement fracture treatments induces considerable preload whose inclusion in models is important for the prediction of interface behaviour.