External Validation of a Mammography-Derived AI-Based Risk Model in a U.S. Breast Cancer Screening Cohort of White and Black Women

Artificial intelligence-based computer-aided diagnosis abnormality score trends in the serial mammography of patients with breast cancer

PURPOSE

To explore the abnormality score trends of artificial intelligence-based computer-aided diagnosis (AI-CAD) in the serial mammography of patients until a final diagnosis of breast cancer.

METHOD

From 2015 to 2019, 126 breast cancer patients who had at least two previous mammograms obtained from 2008 up to cancer diagnosis were included. AI-CAD was retrospectively applied to 487 previous mammograms and all the abnormality scores calculated by AI-CAD were obtained. The contralateral breast of each affected breast was defined as the control group. We divided all mammograms by 6-month intervals from cancer diagnosis in reverse chronological order. The random coefficient model was used to estimate whether the chronological trend of AI-CAD abnormality scores differed between cancer and normal breasts. Subgroup analyses were performed according to mammographic visibility, invasiveness and molecular subtype of the invasive cancer.

RESULTS

Mean period from initial examination to cancer diagnosis was 6.0 years (range 1.7-10.7 years). The abnormality scores of breasts diagnosed with cancer showed a significantly increasing trend during the previous examination period (slope 0.6 per 6 months, p for the slope < 0.001), while the contralateral normal breast showed no trend (slope 0.03, p = 0.776). The difference in slope between the cancerous and contralateral breasts was significant (p < 0.001). For mammography-visible cancers, the abnormality scores in cancerous breasts showed a significant increasing trend (slope 0.8, p < 0.001), while for mammography-occult cancers, the trend was not significant (slope 0.1, p = 0.6). For invasive cancers, the slope of the abnormality scores showed a significant increasing trend (slope 1.4, p = 0.002), unlike ductal carcinoma in situ (DCIS) which showed no significant trend. There was no significant difference in the slope of abnormality scores among the subtypes of invasive cancers (p = 0.418).

CONCLUSION

Breasts diagnosed with cancer showed an increase in AI-CAD abnormality scores in previous serial mammograms, suggesting that AI-CAD could be useful for early detection of breast cancer.

Artificial Intelligence for Breast Cancer Risk Assessment

Breast cancer risk prediction models based on common clinical risk factors are used to identify women eligible for high-risk screening and prevention. Unfortunately, these models have only modest discriminatory accuracy with disparities in performance in underrepresented race and ethnicity groups. The field of artificial intelligence (AI) and deep learning are rapidly advancing the field of breast cancer risk prediction with the development of mammography-based AI breast cancer risk models. Early studies suggest mammography-based AI risk models may perform better than traditional risk factor-based models with more equitable performance.

Enhancing Accuracy in Breast Density Assessment Using Deep Learning: A Multicentric, Multi-Reader Study

The evaluation of mammographic breast density, a critical indicator of breast cancer risk, is traditionally performed by radiologists via visual inspection of mammography images, utilizing the Breast Imaging-Reporting and Data System (BI-RADS) breast density categories. However, this method is subject to substantial interobserver variability, leading to inconsistencies and potential inaccuracies in density assessment and subsequent risk estimations. To address this, we present a deep learning-based automatic detection algorithm (DLAD) designed for the automated evaluation of breast density. Our multicentric, multi-reader study leverages a diverse dataset of 122 full-field digital mammography studies (488 images in CC and MLO projections) sourced from three institutions. We invited two experienced radiologists to conduct a retrospective analysis, establishing a ground truth for 72 mammography studies (BI-RADS class A: 18, BI-RADS class B: 43, BI-RADS class C: 7, BI-RADS class D: 4). The efficacy of the DLAD was then compared to the performance of five independent radiologists with varying levels of experience. The DLAD showed robust performance, achieving an accuracy of 0.819 (95% CI: 0.736-0.903), along with an F1 score of 0.798 (0.594-0.905), precision of 0.806 (0.596-0.896), recall of 0.830 (0.650-0.946), and a Cohen's Kappa (κ) of 0.708 (0.562-0.841). The algorithm achieved robust performance that matches and in four cases exceeds that of individual radiologists. The statistical analysis did not reveal a significant difference in accuracy between DLAD and the radiologists, underscoring the model's competitive diagnostic alignment with professional radiologist assessments. These results demonstrate that the deep learning-based automatic detection algorithm can enhance the accuracy and consistency of breast density assessments, offering a reliable tool for improving breast cancer screening outcomes.

European validation of an image-derived AI-based short-term risk model for individualized breast cancer screening-a nested case-control study

Background

Image-derived artificial intelligence (AI)-based risk models for breast cancer have shown high discriminatory performances compared with clinical risk models based on family history and lifestyle factors. However, little is known about their generalizability across European screening settings. We therefore investigated the discriminatory performances of an AI-based risk model in European screening settings.

Methods

Using four European screening populations in three countries (Italy, Spain, Germany) screened between 2009 and 2020 for women aged 45-69, we performed a nested case-control study to assess the predictive performance of an AI-based risk model. In total, 739 women with incident breast cancers were included together with 7812 controls matched on year of study-entry. Mammographic features (density, microcalcifications, masses, left-right breast asymmetries of these features) were extracted using AI from negative digital mammograms at study-entry. Two-year absolute risks of breast cancer were predicted and assessed after two years of follow-up. Adjusted risk stratification performance metrics were reported per clinical guidelines.

Findings

The overall adjusted Area Under the receiver operating characteristic Curve (aAUC) of the AI risk model was 0.72 (95% CI 0.70-0.75) for breast cancers developed in four screening populations. In the 6.2% [529/8551] of women at high risk using the National Institute of Health and Care Excellence (NICE) guidelines thresholds, cancers were more likely diagnosed after 2 years follow-up, risk-ratio (RR) 6.7 (95% CI 5.6-8.0), compared with the 69% [5907/8551] of women classified at general risk by the model. Similar risk-ratios were observed across levels of mammographic density.

Interpretation

The AI risk model showed generalizable discriminatory performances across European populations and, predicted ∼30% of clinically relevant stage 2 and higher breast cancers in ∼6% of high-risk women who were sent home with a negative mammogram. Similar results were seen in women with fatty and dense breasts.

Funding

Swedish Research Council.

Artificial Intelligence-Driven Mammography-Based Future Breast Cancer Risk Prediction: A Systematic Review

PURPOSE

To summarize the literature regarding the performance of mammography-image based artificial intelligence (AI) algorithms, with and without additional clinical data, for future breast cancer risk prediction.

MATERIALS AND METHODS

A systematic literature review was performed using six databases (medRixiv, bioRxiv, Embase, Engineer Village, IEEE Xplore, and PubMed) from 2012 through September 30, 2022. Studies were included if they used real-world screening mammography examinations to validate AI algorithms for future risk prediction based on images alone or in combination with clinical risk factors. The quality of studies was assessed, and predictive accuracy was recorded as the area under the receiver operating characteristic curve (AUC).

RESULTS

Sixteen studies met inclusion and exclusion criteria, of which 14 studies provided AUC values. The median AUC performance of AI image-only models was 0.72 (range 0.62-0.90) compared with 0.61 for breast density or clinical risk factor-based tools (range 0.54-0.69). Of the seven studies that compared AI image-only performance directly to combined image + clinical risk factor performance, six demonstrated no significant improvement, and one study demonstrated increased improvement.

CONCLUSIONS

Early efforts for predicting future breast cancer risk based on mammography images alone demonstrate comparable or better accuracy to traditional risk tools with little or no improvement when adding clinical risk factor data. Transitioning from clinical risk factor-based to AI image-based risk models may lead to more accurate, personalized risk-based screening approaches.

Improved prediction of breast cancer risk based on phenotypic DNA damage repair capacity in peripheral blood B cells

Background

Standard Breast Cancer (BC) risk prediction models based only on epidemiologic factors generally have quite poor performance, and there have been a number of risk scores proposed to improve them, such as AI-based mammographic information, polygenic risk scores and pathogenic variants. Even with these additions BC risk prediction performance is still at best moderate. In that decreased DNA repair capacity (DRC) is a major risk factor for development of cancer, we investigated the potential to improve BC risk prediction models by including a measured phenotypic DRC assay.

Methods

Using blood samples from the Breast Cancer Family Registry we assessed the performance of phenotypic markers of DRC in 46 matched pairs of individuals, one from each pair with BC (with blood drawn before BC diagnosis) and the other from controls matched by age and time since blood draw. We assessed DRC in thawed cryopreserved peripheral blood mononuclear cells (PBMCs) by measuring γ-H2AX yields (a marker for DNA double-strand breaks) at multiple times from 1 to 20 hrs after a radiation challenge. The studies were performed using surface markers to discriminate between different PBMC subtypes.

Results

The parameter F res , the residual damage signal in PBMC B cells at 20 hrs post challenge, was the strongest predictor of breast cancer with an AUC (Area Under receiver-operator Curve) of 0.89 [95% Confidence Interval: 0.84-0.93] and a BC status prediction accuracy of 0.80. To illustrate the combined use of a phenotypic predictor with standard BC predictors, we combined F res in B cells with age at blood draw, and found that the combination resulted in significantly greater BC predictive power (AUC of 0.97 [95% CI: 0.94-0.99]), an increase of 13 percentage points over age alone.

Conclusions

If replicated in larger studies, these results suggest that inclusion of a fingerstick-based phenotypic DRC blood test has the potential to markedly improve BC risk prediction.