Early detection of chemotherapy-refractory patients by monitoring textural alterations in diffuse optical spectroscopic images

Apriori prediction of chemotherapy response in locally advanced breast cancer patients using CT imaging and deep learning: transformer versus transfer learning

Objective

Neoadjuvant chemotherapy (NAC) is a key element of treatment for locally advanced breast cancer (LABC). Predicting the response to NAC for patients with Locally Advanced Breast Cancer (LABC) before treatment initiation could be beneficial to optimize therapy, ensuring the administration of effective treatments. The objective of the work here was to develop a predictive model to predict tumor response to NAC for LABC using deep learning networks and computed tomography (CT).

Materials and methods

Several deep learning approaches were investigated including ViT transformer and VGG16, VGG19, ResNet-50, Res-Net-101, Res-Net-152, InceptionV3 and Xception transfer learning networks. These deep learning networks were applied on CT images to assess the response to NAC. Performance was evaluated based on balanced_accuracy, accuracy, sensitivity and specificity classification metrics. A ViT transformer was applied to utilize the attention mechanism in order to increase the weight of important part image which leads to better discrimination between classes.

Results

Amongst the 117 LABC patients studied, 82 (70%) had clinical-pathological response and 35 (30%) had no response to NAC. The ViT transformer obtained the best performance range (accuracy = 71 ± 3% to accuracy = 77 ± 4%, specificity = 86 ± 6% to specificity = 76 ± 3%, sensitivity = 56 ± 4% to sensitivity = 52 ± 4%, and balanced_accuracy=69 ± 3% to balanced_accuracy=69 ± 3%) depending on the split ratio of train-data and test-data. Xception network obtained the second best results (accuracy = 72 ± 4% to accuracy = 65 ± 4, specificity = 81 ± 6% to specificity = 73 ± 3%, sensitivity = 55 ± 4% to sensitivity = 52 ± 5%, and balanced_accuracy = 66 ± 5% to balanced_accuracy = 60 ± 4%). The worst results were obtained using VGG-16 transfer learning network.

Conclusion

Deep learning networks in conjunction with CT imaging are able to predict the tumor response to NAC for patients with LABC prior to start. A ViT transformer could obtain the best performance, which demonstrated the importance of attention mechanism.

Deep learning of quantitative ultrasound multi-parametric images at pre-treatment to predict breast cancer response to chemotherapy

In this study, a novel deep learning-based methodology was investigated to predict breast cancer response to neo-adjuvant chemotherapy (NAC) using the quantitative ultrasound (QUS) multi-parametric imaging at pre-treatment. QUS multi-parametric images of breast tumors were generated using the data acquired from 181 patients diagnosed with locally advanced breast cancer and planned for NAC followed by surgery. The ground truth response to NAC was identified for each patient after the surgery using the standard clinical and pathological criteria. Two deep convolutional neural network (DCNN) architectures including the residual network and residual attention network (RAN) were explored for extracting optimal feature maps from the parametric images, with a fully connected network for response prediction. In different experiments, the features maps were derived from the tumor core only, as well as the core and its margin. Evaluation results on an independent test set demonstrate that the developed model with the RAN architecture to extract feature maps from the expanded parametric images of the tumor core and margin had the best performance in response prediction with an accuracy of 88% and an area under the receiver operating characteristic curve of 0.86. Ten-year survival analyses indicate statistically significant differences between the survival of the responders and non-responders identified based on the model prediction at pre-treatment and the standard criteria at post-treatment. The results of this study demonstrate the promising capability of DCNNs with attention mechanisms in predicting breast cancer response to NAC prior to the start of treatment using QUS multi-parametric images.

Characterizing intra-tumor regions on quantitative ultrasound parametric images to predict breast cancer response to chemotherapy at pre-treatment

The efficacy of quantitative ultrasound (QUS) multi-parametric imaging in conjunction with unsupervised classification algorithms was investigated for the first time in characterizing intra-tumor regions to predict breast tumor response to chemotherapy before the start of treatment. QUS multi-parametric images of breast tumors were generated using the ultrasound radiofrequency data acquired from 181 patients diagnosed with locally advanced breast cancer and planned for neo-adjuvant chemotherapy followed by surgery. A hidden Markov random field (HMRF) expectation maximization (EM) algorithm was applied to identify distinct intra-tumor regions on QUS multi-parametric images. Several features were extracted from the segmented intra-tumor regions and tumor margin on different parametric images. A multi-step feature selection procedure was applied to construct a QUS biomarker consisting of four features for response prediction. Evaluation results on an independent test set indicated that the developed biomarker coupled with a decision tree model with adaptive boosting (AdaBoost) as the classifier could predict the treatment response of patient at pre-treatment with an accuracy of 85.4% and an area under the receiver operating characteristic (ROC) curve (AUC) of 0.89. In comparison, the biomarkers consisted of the features derived from the entire tumor core (without consideration of the intra-tumor regions), and the entire tumor core and the tumor margin could predict the treatment response of patients with an accuracy of 74.5% and 76.4%, and an AUC of 0.79 and 0.76, respectively. Standard clinical features could predict the therapy response with an accuracy of 69.1% and an AUC of 0.6. Long-term survival analyses indicated that the patients predicted by the developed model as responders had a significantly better survival compared to the non-responders. Similar findings were observed for the two response cohorts identified at post-treatment based on standard clinical and pathological criteria. The results obtained in this study demonstrated the potential of QUS multi-parametric imaging integrated with unsupervised learning methods in identifying distinct intra-tumor regions in breast cancer to characterize its responsiveness to chemotherapy prior to the start of treatment.

Prediction of chemotherapy response in breast cancer patients at pre-treatment using second derivative texture of CT images and machine learning

•

Textural and second derivative textural features of CT images can be used in conjunction with machine learning models to predict breast cancer response to chemotherapy prior to the start of treatment.

•

The proposed predictive model separates the patients at pre-treatment into two cohorts (responders/non-responders) with significantly different survival.

•

The proposed methodology is a step forward towards the precision oncology paradigm for breast cancer patients.

Although neoadjuvant chemotherapy (NAC) is a crucial component of treatment for locally advanced breast cancer (LABC), only about 70% of patients respond to it. Effective adjustment of NAC for individual patients can significantly improve survival rates of those resistant to standard regimens. Thus, the early prediction of NAC outcome is of great importance in facilitating a personalized paradigm for breast cancer therapeutics. In this study, quantitative computed tomography (qCT) parametric imaging in conjunction with machine learning techniques were investigated to predict LABC tumor response to NAC. Textural and second derivative textural (SDT) features of CT images of 72 patients diagnosed with LABC were analysed before the initiation of NAC to quantify intra-tumor heterogeneity. These quantitative features were processed through a correlation-based feature reduction followed by a sequential feature selection with a bootstrap 0.632+ area under the receiver operating characteristic (ROC) curve (AUC0.632+) criterion. The best feature subset consisted of a combination of one textural and three SDT features. Using these features, an AdaBoost decision tree could predict the patient response with a cross-validated AUC0.632+ accuracy, sensitivity and specificity of 0.88, 85%, 88% and 75%, respectively. This study demonstrates, for the first time, that a combination of textural and SDT features of CT images can be used to predict breast cancer response NAC prior to the start of treatment which can potentially facilitate early therapy adjustments.

A priori prediction of response in multicentre locally advanced breast cancer (LABC) patients using quantitative ultrasound and derivative texture methods

PURPOSE

We develop a multi-centric response predictive model using QUS spectral parametric imaging and novel texture-derivate methods for determining tumour responses to neoadjuvant chemotherapy (NAC) prior to therapy initiation.

MATERIALS AND METHODS

QUS Spectroscopy provided parametric images of mid-band-fit (MBF), spectral-slope (SS), spectral-intercept (SI), average-scatterer-diameter (ASD), and average-acoustic-concentration (AAC) in 78 patients with locally advanced breast cancer (LABC) undergoing NAC. Ultrasound radiofrequency data were collected from Sunnybrook Health Sciences Center (SHSC), University of Texas MD Anderson Cancer Center (MD-ACC), and St. Michaels Hospital (SMH) using two different systems. Texture analysis was used to quantify heterogeneities of QUS parametric images. Further, a second-pass texture analysis was applied to obtain texture-derivate features. QUS, texture- and texture-derivate parameters were determined from both tumour core and a 5-mm tumour margin and were used in comparison to histopathological analysis for developing a response predictive model to classify responders versus non-responders. Model performance was assessed using leave-one-out cross-validation. Three standard classification algorithms including a linear discriminant analysis (LDA), k-nearest-neighbors (KNN), and support vector machines-radial basis function (SVM-RBF) were evaluated.

RESULTS

A combination of tumour core and margin classification resulted in a peak response prediction performance of 88% sensitivity, 78% specificity, 84% accuracy, 0.86 AUC, 84% PPV, and 83% NPV, achieved using the SVM-RBF classification algorithm. Other parameters and classifiers performed less well running from 66% to 80% accuracy.

CONCLUSIONS

A QUS-based framework and novel texture-derivative method enabled accurate prediction of responses to NAC. Multi-centric response predictive model provides indications of the robustness of the approach to variations due to different ultrasound systems and acquisition parameters.

Comparison of methods for texture analysis of QUS parametric images in the characterization of breast lesions

PURPOSE

Accurate and timely diagnosis of breast carcinoma is very crucial because of its high incidence and high morbidity. Screening can improve overall prognosis by detecting the disease early. Biopsy remains as the gold standard for pathological confirmation of malignancy and tumour grading. The development of diagnostic imaging techniques as an alternative for the rapid and accurate characterization of breast masses is necessitated. Quantitative ultrasound (QUS) spectroscopy is a modality well suited for this purpose. This study was carried out to evaluate different texture analysis methods applied on QUS spectral parametric images for the characterization of breast lesions.

METHODS

Parametric images of mid-band-fit (MBF), spectral-slope (SS), spectral-intercept (SI), average scatterer diameter (ASD), and average acoustic concentration (AAC) were determined using QUS spectroscopy from 193 patients with breast lesions. Texture methods were used to quantify heterogeneities of the parametric images. Three statistical-based approaches for texture analysis that include Gray Level Co-occurrence Matrix (GLCM), Gray Level Run-length Matrix (GRLM), and Gray Level Size Zone Matrix (GLSZM) methods were evaluated. QUS and texture-parameters were determined from both tumour core and a 5-mm tumour margin and were used in comparison to histopathological analysis in order to classify breast lesions as either benign or malignant. We developed a diagnostic model using different classification algorithms including linear discriminant analysis (LDA), k-nearest neighbours (KNN), support vector machine with radial basis function kernel (SVM-RBF), and an artificial neural network (ANN). Model performance was evaluated using leave-one-out cross-validation (LOOCV) and hold-out validation.

RESULTS

Classifier performances ranged from 73% to 91% in terms of accuracy dependent on tumour margin inclusion and classifier methodology. Utilizing information from tumour core alone, the ANN achieved the best classification performance of 93% sensitivity, 88% specificity, 91% accuracy, 0.95 AUC using QUS parameters and their GLSZM texture features.

CONCLUSIONS

A QUS-based framework and texture analysis methods enabled classification of breast lesions with >90% accuracy. The results suggest that optimizing method for extracting discriminative textural features from QUS spectral parametric images can improve classification performance. Evaluation of the proposed technique on a larger cohort of patients with proper validation technique demonstrated the robustness and generalization of the approach.

A Brain Tumor Segmentation Framework Based on Outlier Detection Using One-Class Support Vector Machine

Accurate segmentation of brain tumors is a challenging task and also a crucial step in diagnosis and treatment planning for cancer patients. Magnetic resonance imaging (MRI) is the standard imaging modality for detection, characterization, treatment planning and outcome evaluation of brain tumors. MRI scans are usually acquired at multiple sessions before and after the treatment. An automatic segmentation framework is highly desirable to segment brain tumors in MR images as it streamlines the image-guided radiation therapy workflow considerably. Automatic segmentation of brain tumors also facilitates an incremental development of data-driven systems for therapy outcome prediction based on radiomics analysis. In this study, an outlier-detection-based segmentation framework is proposed to delineate brain tumors in magnetic resonance (MR) images automatically. The proposed method considers the tumor and edema pixels in an MR image as outliers compared to the pixels associated with the healthy tissue. The framework generates two outlier masks using independent one-class support vector machines that operate on post-contrast T1-weighted (T1w) and T2-weighted-fluid-attenuation-inversion-recovery (T2-FLAIR) images. The outlier masks are subsequently refined and fused using a number of morphological and logical operators to estimate a tumor mask for each image slice. The framework was constructed and evaluated using the MRI data acquired from 35 and 5 patients with brain metastasis, respectively. The obtained results demonstrated an average Dice similarity coefficient and Hausdorff distance of 0.84 ± 0.06 and 1.85 ± 0.48 mm, respectively, between the manual (ground truth) and automatic tumor contours, on the independent test set.

Breast lesion characterization using Quantitative Ultrasound (QUS) and derivative texture methods

PURPOSE

Accurate and timely diagnosis of breast cancer is extremely important because of its high incidence and high morbidity. Early diagnosis of breast cancer through screening can improve overall prognosis. Currently, biopsy remains as the gold standard for tumor pathological confirmation. Development of diagnostic imaging techniques for rapid and accurate characterization of breast lesions is required. We aim to evaluate the usefulness of texture-derivate features of QUS spectral parametric images for non-invasive characterization of breast lesions.

METHODS

QUS Spectroscopy was used to determine parametric images of mid-band fit (MBF), spectral slope (SS), spectral intercept (SI), average scatterer diameter (ASD), and average acoustic concentration (AAC) in 204 patients with suspicious breast lesions. Subsequently, texture analysis techniques were used to generate texture maps from parametric images to quantify heterogeneities of QUS parametric images. Further, a second-pass texture analysis was applied to obtain texture-derivate features. QUS parameters, texture-parameters and texture-derivate parameters were determined from both tumor core and a 5-mm tumor margin and were used in comparison to histopathological analysis in order to develop a diagnostic model for classifying breast lesions as either benign or malignant. Both leave-one-out and hold-out cross-validations were used to evaluate the performance of the diagnostic model. Three standard classification algorithms including a linear discriminant analysis (LDA), k-nearest neighbors (KNN), and support vector machines-radial basis function (SVM-RBF) were evaluated.

RESULTS

Core and margin information using the SVM-RBF attained the best classification performance of 90% sensitivity, 92% specificity, 91% accuracy, and 0.93 AUC utilizing QUS parameters and their texture derivatives, evaluated using leave-one-out cross-validation. Implementation of hold-out cross-validation using combination of both core and margin information and SVM-RBF achieved average accuracy and AUC of 88% and 0.92, respectively.

CONCLUSIONS

QUS-based framework and derivative texture methods enable accurate classification of breast lesions. Evaluation of the proposed technique on a large cohort using hold-out cross-validation demonstrates its robustness and its generalization.

A priori prediction of tumour response to neoadjuvant chemotherapy in breast cancer patients using quantitative CT and machine learning

Response to Neoadjuvant chemotherapy (NAC) has demonstrated a high correlation to survival in locally advanced breast cancer (LABC) patients. An early prediction of responsiveness to NAC could facilitate treatment adjustments on an individual patient basis that would be expected to improve treatment outcomes and patient survival. This study investigated, for the first time, the efficacy of quantitative computed tomography (qCT) parametric imaging to characterize intra-tumour heterogeneity and its application in predicting tumour response to NAC in LABC patients. Textural analyses were performed on CT images acquired from 72 patients before the start of chemotherapy to determine quantitative features of intra-tumour heterogeneity. The best feature subset for response prediction was selected through a sequential feature selection with bootstrap 0.632 + area under the receiver operating characteristic (ROC) curve (\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$${\mathrm{A}\mathrm{U}\mathrm{C}}_{0.632+}$$\end{document}AUC0.632+) as a performance criterion. Several classifiers were evaluated for response prediction using the selected feature subset. Amongst the applied classifiers an Adaboost decision tree provided the best results with cross-validated \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$${\mathrm{A}\mathrm{U}\mathrm{C}}_{0.632+}$$\end{document}AUC0.632+, accuracy, sensitivity and specificity of 0.89, 84%, 80% and 88%, respectively. The promising results obtained in this study demonstrate the potential of the proposed biomarkers to be used as predictors of LABC tumour response to NAC prior to the start of treatment.

An Automatic Framework for Segmentation of Brain Tumours at Follow-up Scans after Radiation Therapy

Brain metastasis is the most common intracranial malignancy with a poor overall survival (OS) after treatment. The standard stereotactic radiation therapy (SRT) planning procedure for brain metastasis requires delineating the tumour volume on magnetic resonance (MR) images. MR images are also acquired at multiple follow-up scans after SRT to monitor the treatment outcome through measuring changes in the physical dimensions of the tumour. Such measurements require manual segmentation of the tumour volume on multiple slices of several follow-up images which is tedious and impedes the SRT evaluation work flow considerably. In this study, an automatic framework was proposed to segment the tumour volume on longitudinal MR images acquired at standard follow-up scans after SRT. The multi-step segmentation framework was based on region growing and morphological snakes models that applied the standard SRT planning tumour contour as a basis to approximate the tumour shape and location at each follow-up scan for an accurate automatic segmentation of tumour volume. The framework was evaluated using the MR imaging data acquired from five patients prior to and at three follow-up scans after SRT. The preliminary results indicated that the Dice similarity coefficient between the ground truth tumour masks and their automatically segmented counterparts ranged between 0.84 and 0.90, while the average Dice coefficient for all the follow-up scans was 0.88. The results obtained implied a good potential of the proposed framework for being incorporated into the SRT treatment planning and evaluation systems as well as outcome prediction models.

Quantitative MRI Biomarkers of Stereotactic Radiotherapy Outcome in Brain Metastasis

About 20-40% of cancer patients develop brain metastases, causing significant morbidity and mortality. Stereotactic radiation treatment is an established option that delivers high dose radiation to the target while sparing the surrounding normal tissue. However, up to 20% of metastatic brain tumours progress despite stereotactic treatment, and it can take months before it is evident on follow-up imaging. An early predictor of radiation therapy outcome in terms of tumour local failure (LF) is crucial, and can facilitate treatment adjustments or allow for early salvage treatment. In this study, an MR-based radiomics framework was proposed to derive and investigate quantitative MRI (qMRI) biomarkers for the outcome of LF in brain metastasis patients treated with hypo-fractionated stereotactic radiation therapy (SRT). The qMRI biomarkers were constructed through a multi-step feature extraction/reduction/selection framework using the conventional MR imaging data acquired from 100 patients (133 lesions), and were applied in conjunction with machine learning techniques for outcome prediction and risk assessment. The results indicated that the majority of the features in the optimal qMRI biomarkers characterize the heterogeneity in the surrounding regions of tumour including edema and tumour/lesion margins. The optimal qMRI biomarker consisted of five features that predict the outcome of LF with an area under the curve (AUC) of 0.79, and a cross-validated sensitivity and specificity of 81% and 79%, respectively. The Kaplan-Meier analyses showed a statistically significant difference in local control (p-value < 0.0001) and overall survival (p = 0.01). Findings from this study are a step towards using qMRI for early prediction of local failure in brain metastasis patients treated with SRT. This may facilitate early adjustments in treatment, such as surgical resection or salvage radiation, that can potentially improve treatment outcomes. Investigations on larger cohorts of patients are, however, required for further validation of the technique.

Influence of neoadjuvant chemotherapy on diffuse reflectance spectra of tissue in breast surgery specimens

Diffuse reflectance spectroscopy (DRS) can discriminate different tissue types based on optical characteristics. Since this technology has the ability to detect tumor tissue, several groups have proposed to use DRS for margin assessment during breast-conserving surgery for breast cancer. Nowadays, an increasing number of patients with breast cancer are being treated by neoadjuvant chemotherapy. Limited research has been published on the influence of neoadjuvant chemotherapy on the optical characteristics of the tissue. Hence, it is unclear whether margin assessment based on DRS is feasible in this specific group of patients. We investigate whether there is an effect of neoadjuvant chemotherapy on optical measurements of breast tissue. To this end, DRS measurements were performed on 92 ex-vivo breast specimens from 92 patients, treated with neoadjuvant chemotherapy and without neoadjuvant chemotherapy. Generalized estimating equation (GEE) models were generated, comparing the measurements of patients with and without neoadjuvant chemotherapy in datasets of different tissue types using a significance level of 5%. As input for the GEE models, either the intensity at a specific wavelength or a fit parameter, derived from the spectrum, was used. In the evaluation of the intensity, no influence of neoadjuvant chemotherapy was found, since none of the wavelengths were significantly different between the measurements with and the measurements without neoadjuvant chemotherapy in any of the datasets. These results were confirmed by the analysis of the fit parameters, which showed a significant difference for the amount of collagen in only one dataset. All other fit parameters were not significant for any of the datasets. These findings may indicate that assessment of the resection margin with DRS is also feasible in the growing population of breast cancer patients who receive neoadjuvant chemotherapy. However, it is possible that we did not detect neoadjuvant chemotherapy effect in the some of the datasets due to the small number of measurements in those datasets.

Monitoring breast cancer response to neoadjuvant chemotherapy with ultrasound signal statistics and integrated backscatter

Background

Neoadjuvant chemotherapy (NAC) is used in patients with breast cancer to reduce tumor focus, metastatic risk, and patient mortality. Monitoring NAC effects is necessary to capture resistant patients and stop or change treatment. The existing methods for evaluating NAC results have some limitations. The aim of this study was to assess the tumor response at an early stage, after the first doses of the NAC, based on the variability of the backscattered ultrasound energy, and backscatter statistics. The backscatter statistics has not previously been used to monitor NAC effects.

Methods

The B-mode ultrasound images and raw radio frequency data from breast tumors were obtained using an ultrasound scanner before chemotherapy and 1 week after each NAC cycle. The study included twenty-four malignant breast cancers diagnosed in sixteen patients and qualified for neoadjuvant treatment before surgery. The shape parameter of the homodyned K distribution and integrated backscatter, along with the tumor size in the longest dimension, were determined based on ultrasound data and used as markers for NAC response. Cancer tumors were assigned to responding and non-responding groups, according to histopathological evaluation, which was a reference in assessing the utility of markers. Statistical analysis was performed to rate the ability of markers to predict the final NAC response based on data obtained after subsequent therapeutic doses.

Results

Statistically significant differences (p<0.05) between groups were obtained after 2, 3, 4, and 5 doses of NAC for quantitative ultrasound markers and after 5 doses for the assessment based on maximum tumor dimension. Statistical analysis showed that, after the second and third NAC courses the classification based on integrated backscatter marker was characterized by an AUC of 0.69 and 0.82, respectively. The introduction of the second quantitative marker describing the statistical properties of scattering increased the corresponding AUC values to 0.82 and 0.91.

Conclusions

Quantitative ultrasound information can characterize the tumor's pathological response better and at an earlier stage of therapy than the assessment of the reduction of its dimensions. The introduction of statistical parameters of ultrasonic backscatter to monitor the effects of chemotherapy can increase the effectiveness of monitoring and contribute to a better personalization of NAC therapy.

Apparent Diffusion Coefficient Value to Evaluate Tumor Response After Neoadjuvant Chemotherapy in Patients with Breast Cancer

RATIONALE AND OBJECTIVES

This study explored tumor behavior in patients with breast cancer during neoadjuvant chemotherapy (NAC) by sequential measurements of tumor apparent diffusion coefficient (ADC) after each chemotherapy cycle. The aim was to determine if the tumor ADC is useful to differentiate complete pathological response (cPR) from partial pathological response (pPR) during NAC.

MATERIALS AND METHODS

A total of 16 cases (in 14 patients) with diagnosis of breast cancer eligible to receive NAC were included. There were 70 magnetic resonance imaging examinations performed, 5 for each patient, during NAC cycles. Diffusion-weighted imaging was performed on a 1.5T system (b values of 0 and 700s/mm²). Four ADC ratios between the five MRI examinations were obtained to assess ADC changes during NAC. Absence of invasive breast cancer at surgical specimens (Miller-Payne 5) was considered as cPR and was used as reference for ADC cutoff ratios.

RESULTS

In this study, we were able to differentiate between cPR and pPR, after two cycles of NAC until the end of NAC before surgery (ADC ratios 2-4). The thresholds to differentiate between cPR and pPR of ADC ratios 2, 3, and 4, were 1.14 × 10^-3mm²/s, 1.08 × 10^-3mm²/s, and 1.25 × 10^-3mm²/s, respectively, and have a cross-validated sensitivity and specificity of 79.2%, 79.7% (ADC ratio 2); 100%, 66.7% (ADC ratio 3); and 100%, 83.8% (ADC ratio 4), respectively.

CONCLUSIONS

The ADC ratios were useful to differentiate cPR from pPR in breast cancer tumors after NAC. Thus, it may be useful in tailoring treatment in these patients.

Deep reinforcement learning for automated radiation adaptation in lung cancer

PURPOSE

To investigate deep reinforcement learning (DRL) based on historical treatment plans for developing automated radiation adaptation protocols for nonsmall cell lung cancer (NSCLC) patients that aim to maximize tumor local control at reduced rates of radiation pneumonitis grade 2 (RP2).

METHODS

In a retrospective population of 114 NSCLC patients who received radiotherapy, a three-component neural networks framework was developed for deep reinforcement learning (DRL) of dose fractionation adaptation. Large-scale patient characteristics included clinical, genetic, and imaging radiomics features in addition to tumor and lung dosimetric variables. First, a generative adversarial network (GAN) was employed to learn patient population characteristics necessary for DRL training from a relatively limited sample size. Second, a radiotherapy artificial environment (RAE) was reconstructed by a deep neural network (DNN) utilizing both original and synthetic data (by GAN) to estimate the transition probabilities for adaptation of personalized radiotherapy patients' treatment courses. Third, a deep Q-network (DQN) was applied to the RAE for choosing the optimal dose in a response-adapted treatment setting. This multicomponent reinforcement learning approach was benchmarked against real clinical decisions that were applied in an adaptive dose escalation clinical protocol. In which, 34 patients were treated based on avid PET signal in the tumor and constrained by a 17.2% normal tissue complication probability (NTCP) limit for RP2. The uncomplicated cure probability (P+) was used as a baseline reward function in the DRL.

RESULTS

Taking our adaptive dose escalation protocol as a blueprint for the proposed DRL (GAN + RAE + DQN) architecture, we obtained an automated dose adaptation estimate for use at ∼2/3 of the way into the radiotherapy treatment course. By letting the DQN component freely control the estimated adaptive dose per fraction (ranging from 1-5 Gy), the DRL automatically favored dose escalation/de-escalation between 1.5 and 3.8 Gy, a range similar to that used in the clinical protocol. The same DQN yielded two patterns of dose escalation for the 34 test patients, but with different reward variants. First, using the baseline P+ reward function, individual adaptive fraction doses of the DQN had similar tendencies to the clinical data with an RMSE = 0.76 Gy; but adaptations suggested by the DQN were generally lower in magnitude (less aggressive). Second, by adjusting the P+ reward function with higher emphasis on mitigating local failure, better matching of doses between the DQN and the clinical protocol was achieved with an RMSE = 0.5 Gy. Moreover, the decisions selected by the DQN seemed to have better concordance with patients eventual outcomes. In comparison, the traditional temporal difference (TD) algorithm for reinforcement learning yielded an RMSE = 3.3 Gy due to numerical instabilities and lack of sufficient learning.

CONCLUSION

We demonstrated that automated dose adaptation by DRL is a feasible and a promising approach for achieving similar results to those chosen by clinicians. The process may require customization of the reward function if individual cases were to be considered. However, development of this framework into a fully credible autonomous system for clinical decision support would require further validation on larger multi-institutional datasets.

Breast-Lesion Characterization using Textural Features of Quantitative Ultrasound Parametric Maps

This study evaluated, for the first time, the efficacy of quantitative ultrasound (QUS) spectral parametric maps in conjunction with texture-analysis techniques to differentiate non-invasively benign versus malignant breast lesions. Ultrasound B-mode images and radiofrequency data were acquired from 78 patients with suspicious breast lesions. QUS spectral-analysis techniques were performed on radiofrequency data to generate parametric maps of mid-band fit, spectral slope, spectral intercept, spacing among scatterers, average scatterer diameter, and average acoustic concentration. Texture-analysis techniques were applied to determine imaging biomarkers consisting of mean, contrast, correlation, energy and homogeneity features of parametric maps. These biomarkers were utilized to classify benign versus malignant lesions with leave-one-patient-out cross-validation. Results were compared to histopathology findings from biopsy specimens and radiology reports on MR images to evaluate the accuracy of technique. Among the biomarkers investigated, one mean-value parameter and 14 textural features demonstrated statistically significant differences (p < 0.05) between the two lesion types. A hybrid biomarker developed using a stepwise feature selection method could classify the legions with a sensitivity of 96%, a specificity of 84%, and an AUC of 0.97. Findings from this study pave the way towards adapting novel QUS-based frameworks for breast cancer screening and rapid diagnosis in clinic.

Chemotherapy-Response Monitoring of Breast Cancer Patients Using Quantitative Ultrasound-Based Intra-Tumour Heterogeneities

Anti-cancer therapies including chemotherapy aim to induce tumour cell death. Cell death introduces alterations in cell morphology and tissue micro-structures that cause measurable changes in tissue echogenicity. This study investigated the effectiveness of quantitative ultrasound (QUS) parametric imaging to characterize intra-tumour heterogeneity and monitor the pathological response of breast cancer to chemotherapy in a large cohort of patients (n = 100). Results demonstrated that QUS imaging can non-invasively monitor pathological response and outcome of breast cancer patients to chemotherapy early following treatment initiation. Specifically, QUS biomarkers quantifying spatial heterogeneities in size, concentration and spacing of acoustic scatterers could predict treatment responses of patients with cross-validated accuracies of 82 ± 0.7%, 86 ± 0.7% and 85 ± 0.9% and areas under the receiver operating characteristic (ROC) curve of 0.75 ± 0.1, 0.80 ± 0.1 and 0.89 ± 0.1 at 1, 4 and 8 weeks after the start of treatment, respectively. The patients classified as responders and non-responders using QUS biomarkers demonstrated significantly different survivals, in good agreement with clinical and pathological endpoints. The results form a basis for using early predictive information on survival-linked patient response to facilitate adapting standard anti-cancer treatments on an individual patient basis.

Predicting breast cancer response to neoadjuvant chemotherapy using pretreatment diffuse optical spectroscopic texture analysis

Background:

Diffuse optical spectroscopy (DOS) has been demonstrated capable of monitoring response to neoadjuvant chemotherapy (NAC) in locally advanced breast cancer (LABC) patients. In this study, we evaluate texture features of pretreatment DOS functional maps for predicting LABC response to NAC.

Methods:

Locally advanced breast cancer patients (n=37) underwent DOS breast imaging before starting NAC. Breast tissue parametric maps were constructed and texture analyses were performed based on grey-level co-occurrence matrices for feature extraction. Ground truth labels as responders (R) or non-responders (NR) were assigned to patients based on Miller–Payne pathological response criteria. The capability of DOS textural features computed on volumetric tumour data before the start of treatment (i.e., ‘pretreatment’) to predict patient responses to NAC was evaluated using a leave-one-out validation scheme at subject level. Data were analysed using a logistic regression, naive Bayes, and k-nearest neighbour classifiers.

Results:

Data indicated that textural characteristics of pretreatment DOS parametric maps can differentiate between treatment response outcomes. The HbO₂ homogeneity resulted in the highest accuracy among univariate parameters in predicting response to chemotherapy: sensitivity (%Sn) and specificity (%Sp) were 86.5% and 89.0%, respectively, and accuracy was 87.8%. The highest predictors using multivariate (binary) combination features were the Hb-contrast+HbO₂-homogeneity, which resulted in a %Sn/%Sp=78.0/81.0% and an accuracy of 79.5%.

Conclusions:

This study demonstrated that the pretreatment DOS texture features can predict breast cancer response to NAC and potentially guide treatments.

Using DRS during breast conserving surgery: identifying robust optical parameters and influence of inter-patient variation

Successful breast conserving surgery consists of complete removal of the tumor while sparing healthy surrounding tissue. Despite currently available imaging and margin assessment tools, recognizing tumor tissue at a resection margin during surgery is challenging. Diffuse reflectance spectroscopy (DRS), which uses light for tissue characterization, can potentially guide surgeons to prevent tumor positive margins. However, inter-patient variation and changes in tissue physiology occurring during the resection might hamper this light-based technology. Here we investigate how inter-patient variation and tissue status (in vivo vs ex vivo) affect the performance of the DRS optical parameters. In vivo and ex vivo measurements of 45 breast cancer patients were obtained and quantified with an analytical model to acquire the optical parameters. The optical parameter representing the ratio between fat and water provided the best discrimination between normal and tumor tissue, with an area under the receiver operating characteristic curve of 0.94. There was no substantial influence of other patient factors such as menopausal status on optical measurements. Contrary to expectations, normalization of the optical parameters did not improve the discriminative power. Furthermore, measurements taken in vivo were not significantly different from the measurements taken ex vivo. These findings indicate that DRS is a robust technology for the detection of tumor tissue during breast conserving surgery.