On the use of coupled shape priors for segmentation of magnetic resonance images of the knee

Dual output feature fusion networks for femoral segmentation and quantitative analysis of the knee joint

BACKGROUND

Magnetic resonance imaging (MRI) is the preferred imaging modality for diagnosing knee disease. Segmentation of the knee MRI images is essential for subsequent quantification of clinical parameters and treatment planning for knee prosthesis replacement. However, the segmentation remains difficult due to individual differences in anatomy, the difficulty of obtaining accurate edges at lower resolutions, and the presence of speckle noise and artifacts in the images. In addition, radiologists must manually measure the knee's parameters which is a laborious and time-consuming process.

PURPOSE

Automatic quantification of femoral morphological parameters can be of fundamental help in the design of prosthetic implants for the repair of the knee and the femur. Knowledge of knee femoral parameters can provide a basis for femoral repair of the knee, the design of fixation materials for femoral prostheses, and the replacement of prostheses.

METHODS

This paper proposes a new deep network architecture to comprehensively address these challenges. A dual output model structure is proposed, with a high and low layer fusion extraction feature module designed to extract rich features through the cross-fusion mechanism. A multi-scale edge information extraction spatial feature module is also developed to address the boundary-blurring problem.

RESULTS

Based on the precise automated segmentation results, 10 key clinical parameters were automatically measured for a knee femoral prosthesis replacement program. The correlation coefficients of the quantitative results of these parameters compared to manual results all achieved at least 0.92. The proposed method was extensively evaluated with MRIs of 78 patients' knees, and it consistently outperformed other methods used for segmentation.

CONCLUSIONS

The automated quantization process produced comparable measurements to those manually obtained by radiologists. This paper demonstrates the viability of automatic knee MRI image segmentation and quantitative analysis with the proposed method. This provides data to support the accuracy of assessing the progression and biomechanical changes of osteoarthritis of the knee using an automated process, thus saving valuable time for the radiologists and surgeons.

Automated segmentation of trabecular and cortical bone from proton density weighted MRI of the knee

Patient-specific implant design and pre- and intra-operative planning is becoming increasingly important in the orthopaedic field. For clinical feasibility of these techniques, fast and accurate segmentation of bone structures from MRI is essential. However, manual segmentation is time intensive and subject to inter- and intra-observer variation. The challenge in developing automatic segmentation algorithms for MRI data mainly exists in the inhomogeneity problem and the low contrast among cortical bone and adjacent tissues. In this paper, we proposed a method for automatic segmentation of knee bone structures for MRI data with a 3D local intensity clustering-based level set and a novel approach to determine the cortical boundary utilizing the normal vector of the trabecular surface. Application to clinical imaging data shows that our method is robust to MRI inhomogeneity. In comparing our method to manual segmentation in 18 femurs and tibiae, we found a dice similarity coefficient (DSC) of 0.9611 ± 0.0052 for the femurs and 0.9591 ± 0.0173 for tibiae. The average surface distance error was 0.4649 ± 0.1430 mm for the femurs and 0.4712 ± 0.2113 mm for the tibiae. The results of the automatic technique thus strongly corresponded to the manual segmentation using less than 3% of the time and with virtually no workload.

Graphical abstract

Automatic neuron segmentation and neural network analysis method for phase contrast microscopy images

Phase Contrast Microscopy (PCM) is an important tool for the long term study of living cells. Unlike fluorescence methods which suffer from photobleaching of fluorophore or dye molecules, PCM image contrast is generated by the natural variations in optical index of refraction. Unfortunately, the same physical principles which allow for these studies give rise to complex artifacts in the raw PCM imagery. Of particular interest in this paper are neuron images where these image imperfections manifest in very different ways for the two structures of specific interest: cell bodies (somas) and dendrites. To address these challenges, we introduce a novel parametric image model using the level set framework and an associated variational approach which simultaneously restores and segments this class of images. Using this technique as the basis for an automated image analysis pipeline, results for both the synthetic and real images validate and demonstrate the advantages of our approach.