Automated 3D method for the construction of flexible and reconfigurable numerical breast models from MRI scans

Repository of MRI-derived models of the breast with single and multiple benign and malignant tumors for microwave imaging research

The diagnosis of breast cancer through MicroWave Imaging (MWI) technology has been extensively researched over the past few decades. However, continuous improvements to systems are needed to achieve clinical viability. To this end, the numerical models employed in simulation studies need to be diversified, anatomically accurate, and also representative of the cases in clinical settings. Hence, we have created the first open-access repository of 3D anatomically accurate numerical models of the breast, derived from 3.0T Magnetic Resonance Images (MRI) of benign breast disease and breast cancer patients. The models include normal breast tissues (fat, fibroglandular, skin, and muscle tissues), and benign and cancerous breast tumors. The repository contains easily reconfigurable models which can be tumor-free or contain single or multiple tumors, allowing complex and realistic test scenarios needed for feasibility and performance assessment of MWI devices prior to experimental and clinical testing. It also includes an executable file which enables researchers to generate models incorporating the dielectric properties of breast tissues at a chosen frequency ranging from 3 to 10 GHz, thereby ensuring compatibility with a wide spectrum of research requirements and stages of development for any breast MWI prototype system. Currently, our dataset comprises MRI scans of 55 patients, but new exams will be continuously added.

Improving signal-to-noise ratio by maximal convolution of longitudinal and transverse magnetization components in MRI: application to the breast cancer detection

PURPOSE

The extraction of information from images provided by medical imaging systems may be employed to obtain the specific objectives in the various fields. The quantity of signal to noise ratio (SNR) plays a crucial role in displaying the image details. The higher the SNR value, the more the information is available.

METHODS

In this study, a new function has been formulated using the appropriate suggestions on convolutional combination of the longitudinal and transverse magnetization components related to the relaxation times of T1 and T2 in MRI, where by introducing the distinct index on the maximum value of this function, the new maps are constructed toward the best SNR. Proposed functions were analytically simulated using Matlab software and evaluated with respect to various relaxation times. This proposed method can be applied to any medical images. For instance, the T1- and T2-weighted images of the breast indicated in the reference [35] were selected for modelling and construction of the full width at x maximum (FWxM) map at the different values of x-parameter from 0.01 to 0.955 at 0.035 and 0.015 intervals. The range of x-parameter is between zero and one. To determine the maximum value of the derived SNR, these intervals have been first chosen arbitrarily. However, the smaller this interval, the more precise the value of the x-parameter at which the signal to noise is maximum.

RESULTS

The results showed that at an index value of x = 0.325, the new map of FWxM (0.325) will be constructed with a maximum derived SNR of 22.7 compared to the SNR values of T1- and T2-maps by 14.53 and 17.47, respectively.

CONCLUSION

By convolving two orthogonal magnetization vectors, the qualified images with higher new SNR were created, which included the image with the best SNR. In other words, to optimize the adoption of MRI technique and enable the possibility of wider use, an optimal and cost-effective examination has been suggested. Our proposal aims to shorten the MRI examination to further reduce interpretation times while maintaining primary sensitivity.

SIGNIFICANCE

Our findings may help to quantitatively identify the primary sources of each type of solid and sequential cancer.

Development of 3D MRI-Based Anatomically Realistic Models of Breast Tissues and Tumours for Microwave Imaging Diagnosis

Breast cancer diagnosis using radar-based medical MicroWave Imaging (MWI) has been studied in recent years. Realistic numerical and physical models of the breast are needed for simulation and experimental testing of MWI prototypes. We aim to provide the scientific community with an online repository of multiple accurate realistic breast tissue models derived from Magnetic Resonance Imaging (MRI), including benign and malignant tumours. Such models are suitable for 3D printing, leveraging experimental MWI testing. We propose a pre-processing pipeline, which includes image registration, bias field correction, data normalisation, background subtraction, and median filtering. We segmented the fat tissue with the region growing algorithm in fat-weighted Dixon images. Skin, fibroglandular tissue, and the chest wall boundary were segmented from water-weighted Dixon images. Then, we applied a 3D region growing and Hoshen-Kopelman algorithms for tumour segmentation. The developed semi-automatic segmentation procedure is suitable to segment tissues with a varying level of heterogeneity regarding voxel intensity. Two accurate breast models with benign and malignant tumours, with dielectric properties at 3, 6, and 9 GHz frequencies have been made available to the research community. These are suitable for microwave diagnosis, i.e., imaging and classification, and can be easily adapted to other imaging modalities.

Development of MRI-based axillary numerical models and estimation of axillary lymph node dielectric properties for microwave imaging

PURPOSE

Microwave imaging (MWI) has been studied as a complementary imaging modality to improve sensitivity and specificity of diagnosis of axillary lymph nodes (ALNs), which can be metastasized by breast cancer. The feasibility of such a system is based on the dielectric contrast between healthy and metastasized ALNs. However, reliable information such as anatomically realistic numerical models and matching dielectric properties of the axillary region and ALNs, which are crucial to develop MWI systems, are still limited in the literature. The purpose of this work is to develop a methodology to infer dielectric properties of structures from magnetic resonance imaging (MRI), in particular, ALNs. We further use this methodology, which is tailored for structures farther away from MR coils, to create MRI-based numerical models of the axillary region and share them with the scientific community, through an open-access repository.

METHODS

We use a dataset of breast MRI scans of 40 patients, 15 of them with metastasized ALNs. We apply image processing techniques to minimize the artifacts in MR images and segment the tissues of interest. The background, lung cavity, and skin are segmented using thresholding techniques and the remaining tissues are segmented using a K-means clustering algorithm. The ALNs are segmented combining the clustering results of two MRI sequences. The performance of this methodology was evaluated using qualitative criteria. We then apply a piecewise linear interpolation between voxel signal intensities and known dielectric properties, which allow us to create dielectric property maps within an MRI and consequently infer ALN properties. Finally, we compare healthy and metastasized ALN dielectric properties within and between patients, and we create an open-access repository of numerical axillary region numerical models which can be used for electromagnetic simulations.

RESULTS

The proposed methodology allowed creating anatomically realistic models of the axillary region, segmenting 80 ALNs and analyzing the corresponding dielectric properties. The estimated relative permittivity of those ALNs ranged from 16.6 to 49.3 at 5 GHz. We observe there is a high variability of dielectric properties of ALNs, which can be mainly related to the ALN size and, consequently, its composition. We verified an average dielectric contrast of 29% between healthy and metastasized ALNs. Our repository comprises 10 numerical models of the axillary region, from five patients, with variable number of metastasized ALNs and body mass index.

CONCLUSIONS

The observed contrast between healthy and metastasized ALNs is a good indicator for the feasibility of a MWI system aiming to diagnose ALNs. This paper presents new contributions regarding anatomical modeling and dielectric properties' characterization, in particular for axillary region applications.

Evaluating Performance of Microwave Image Reconstruction Algorithms: Extracting Tissue Types with Segmentation Using Machine Learning

Evaluating the quality of reconstructed images requires consistent approaches to extracting information and applying metrics. Partitioning medical images into tissue types permits the quantitative assessment of regions that contain a specific tissue. The assessment facilitates the evaluation of an imaging algorithm in terms of its ability to reconstruct the properties of various tissue types and identify anomalies. Microwave tomography is an imaging modality that is model-based and reconstructs an approximation of the actual internal spatial distribution of the dielectric properties of a breast over a reconstruction model consisting of discrete elements. The breast tissue types are characterized by their dielectric properties, so the complex permittivity profile that is reconstructed may be used to distinguish different tissue types. This manuscript presents a robust and flexible medical image segmentation technique to partition microwave breast images into tissue types in order to facilitate the evaluation of image quality. The approach combines an unsupervised machine learning method with statistical techniques. The key advantage for using the algorithm over other approaches, such as a threshold-based segmentation method, is that it supports this quantitative analysis without prior assumptions such as knowledge of the expected dielectric property values that characterize each tissue type. Moreover, it can be used for scenarios where there is a scarcity of data available for supervised learning. Microwave images are formed by solving an inverse scattering problem that is severely ill-posed, which has a significant impact on image quality. A number of strategies have been developed to alleviate the ill-posedness of the inverse scattering problem. The degree of success of each strategy varies, leading to reconstructions that have a wide range of image quality. A requirement for the segmentation technique is the ability to partition tissue types over a range of image qualities, which is demonstrated in the first part of the paper. The segmentation of images into regions of interest corresponding to various tissue types leads to the decomposition of the breast interior into disjoint tissue masks. An array of region and distance-based metrics are applied to compare masks extracted from reconstructed images and ground truth models. The quantitative results reveal the accuracy with which the geometric and dielectric properties are reconstructed. The incorporation of the segmentation that results in a framework that effectively furnishes the quantitative assessment of regions that contain a specific tissue is also demonstrated. The algorithm is applied to reconstructed microwave images derived from breasts with various densities and tissue distributions to demonstrate the flexibility of the algorithm and that it is not data-specific. The potential for using the algorithm to assist in diagnosis is exhibited with a tumor tracking example. This example also establishes the usefulness of the approach in evaluating the performance of the reconstruction algorithm in terms of its sensitivity and specificity to malignant tissue and its ability to accurately reconstruct malignant tissue.

Accurate construction of 3-D numerical breast models with anatomical information through MRI scans

The realistic numerical breast model is an important tool for verifying algorithms, improving design concepts, and exploring new technologies related to microwave breast cancer detection. Recently, several numerical breast models have been developed. However, these models do not include the real breast boundary and the chest region, which causes the electromagnetic wave propagation in the breast models to deviate from the actual situation. The proposed breast models in this paper overcome the significant deficiencies of the recent breast models in terms of structure completeness and authenticity. The model construction based on magnetic resonance imaging (MRI) scans is a multistep approach. Firstly, intensity inhomogeneity in MRI images is corrected by an improved nonparametric nonuniform intensity normalization (N4) algorithm. Then, a dual threshold and morphological transformation (DTMT) method is developed to segment the real breast region. Subsequently, a modified maximum inter-class variance (MICV) method is employed to automatically divide the breast region into the fat and the fibroglandular clusters with desired complexity. Finally, the dielectric properties of breast tissues are calculated by a piecewise weighted mapping method. The applicability and effectiveness of the proposed method are verified by constructing four breast models with varying tissue density, shape, and size. The constructed models in this study are significant to achieve reliable and precise effects for microwave breast cancer detection due to the accurate expression of the breast anatomical information and electromagnetic characteristics.

Enhancement of Multimodal Microwave-Ultrasound Breast Imaging Using a Deep-Learning Technique

We present a deep learning method used in conjunction with dual-modal microwave-ultrasound imaging to produce tomographic reconstructions of the complex-valued permittivity of numerical breast phantoms. We also assess tumor segmentation performance using the reconstructed permittivity as a feature. The contrast source inversion (CSI) technique is used to create the complex-permittivity images of the breast with ultrasound-derived tissue regions utilized as prior information. However, imaging artifacts make the detection of tumors difficult. To overcome this issue we train a convolutional neural network (CNN) that takes in, as input, the dual-modal CSI reconstruction and attempts to produce the true image of the complex tissue permittivity. The neural network consists of successive convolutional and downsampling layers, followed by successive deconvolutional and upsampling layers based on the U-Net architecture. To train the neural network, the input-output pairs consist of CSI's dual-modal reconstructions, along with the true numerical phantom images from which the microwave scattered field was synthetically generated. The reconstructed permittivity images produced by the CNN show that the network is not only able to remove the artifacts that are typical of CSI reconstructions, but can also improve the detectability of tumors. The performance of the CNN is assessed using a four-fold cross-validation on our dataset that shows improvement over CSI both in terms of reconstruction error and tumor segmentation performance.

Anthropomorphic breast model repository for research and development of microwave breast imaging technologies

A repository of anthropomorphic numerical breast models is made available for the scientific community to support research and development of microwave imaging technologies for diagnostic and therapeutic applications. These models are constructed from magnetic resonance imaging (MRI) scans acquired at our university hospital. Our 3D breast modelling method is used to translate the MRI scans into 3D models representing the geometry and microwave-frequency properties of tissues in the breast. The reconstructed models demonstrate anatomical realism, reconfigurable complexity, and flexibility to adapt to simulations of various microwave imaging techniques and prototype systems. With these models, realistic and rigorous test scenarios can be defined in simulations to support feasibility analysis, performance verification and design improvements of developing microwave imaging techniques, prior to testing on experimental systems. A repository of breast models is created which includes breasts of varying classification - fatty, scattered, heterogeneous, and dense. In addition, the models include brief documentation to facilitate researchers in selecting a model by matching its features with their requirements.

Integrating prior information into microwave tomography Part 1: Impact of detail on image quality

PURPOSE

The authors investigate the impact that incremental increases in the level of detail of patient-specific prior information have on image quality and the convergence behavior of an inversion algorithm in the context of near-field microwave breast imaging. A methodology is presented that uses image quality measures to characterize the ability of the algorithm to reconstruct both internal structures and lesions embedded in fibroglandular tissue. The approach permits key aspects that impact the quality of reconstruction of these structures to be identified and quantified. This provides insight into opportunities to improve image reconstruction performance.

METHODS

Patient-specific information is acquired using radar-based methods that form a regional map of the breast. This map is then incorporated into a microwave tomography algorithm. Previous investigations have demonstrated the effectiveness of this approach to improve image quality when applied to data generated with two-dimensional (2D) numerical models. The present study extends this work by generating prior information that is customized to vary the degree of structural detail to facilitate the investigation of the role of prior information in image formation. Numerical 2D breast models constructed from magnetic resonance (MR) scans, and reconstructions formed with a three-dimensional (3D) numerical breast model are used to assess if trends observed for the 2D results can be extended to 3D scenarios.

RESULTS

For the blind reconstruction scenario (i.e., no prior information), the breast surface is not accurately identified and internal structures are not clearly resolved. A substantial improvement in image quality is achieved by incorporating the skin surface map and constraining the imaging domain to the breast. Internal features within the breast appear in the reconstructed image. However, it is challenging to discriminate between adipose and glandular regions and there are inaccuracies in both the structural properties of the glandular region and the dielectric properties reconstructed within this structure. Using a regional map with a skin layer only marginally improves this situation. Increasing the structural detail in the prior information to include internal features leads to reconstructions for which the interface that delineates the fat and gland regions can be inferred. Different features within the glandular region corresponding to tissues with varying relative permittivity values, such as a lesion embedded within glandular structure, emerge in the reconstructed images.

CONCLUSION

Including knowledge of the breast surface and skin layer leads to a substantial improvement in image quality compared to the blind case, but the images have limited diagnostic utility for applications such as tumor response tracking. The diagnostic utility of the reconstruction technique is improved considerably when patient-specific structural information is used. This qualitative observation is supported quantitatively with image metrics.

Integrating prior information into microwave tomography part 2: Impact of errors in prior information on microwave tomography image quality

PURPOSE

The authors have developed a method to combine a patient-specific map of tissue structure and average dielectric properties with microwave tomography. The patient-specific map is acquired with radar-based techniques and serves as prior information for microwave tomography. The impact that the degree of structural detail included in this prior information has on image quality was reported in a previous investigation. The aim of the present study is to extend this previous work by identifying and quantifying the impact that errors in the prior information have on image quality, including the reconstruction of internal structures and lesions embedded in fibroglandular tissue. This study also extends the work of others reported in literature by emulating a clinical setting with a set of experiments that incorporate heterogeneity into both the breast interior and glandular region, as well as prior information related to both fat and glandular structures.

METHODS

Patient-specific structural information is acquired using radar-based methods that form a regional map of the breast. Errors are introduced to create a discrepancy in the geometry and electrical properties between the regional map and the model used to generate the data. This permits the impact that errors in the prior information have on image quality to be evaluated. Image quality is quantitatively assessed by measuring the ability of the algorithm to reconstruct both internal structures and lesions embedded in fibroglandular tissue. The study is conducted using both 2D and 3D numerical breast models constructed from MRI scans.

RESULTS

The reconstruction results demonstrate robustness of the method relative to errors in the dielectric properties of the background regional map, and to misalignment errors. These errors do not significantly influence the reconstruction accuracy of the underlying structures, or the ability of the algorithm to reconstruct malignant tissue. Although misalignment errors do not significantly impact the quality of the reconstructed fat and glandular structures for the 3D scenarios, the dielectric properties are reconstructed less accurately within the glandular structure for these cases relative to the 2D cases. However, general agreement between the 2D and 3D results was found.

CONCLUSION

A key contribution of this paper is the detailed analysis of the impact of prior information errors on the reconstruction accuracy and ability to detect tumors. The results support the utility of acquiring patient-specific information with radar-based techniques and incorporating this information into MWT. The method is robust to errors in the dielectric properties of the background regional map, and to misalignment errors. Completion of this analysis is an important step toward developing the method into a practical diagnostic tool.