SciELO - Scientific Electronic Library Online

 
vol.4 número3Vascular signs of Kaiser score on contrast-enhanced breast MRI improve prediction of malignancy in mass and non-mass breast lesionsQuantification of an intrathoracic organoaxial gastric volvulus secondary to a hiatal hernia diagnosed by multidetector computed tomography: a case report índice de autoresíndice de materiabúsqueda de artículos
Home Pagelista alfabética de revistas  

Servicios Personalizados

Revista

Articulo

Indicadores

Links relacionados

  • No hay artículos similaresSimilares en SciELO

Compartir


Journal of the Mexican Federation of Radiology and Imaging

versión On-line ISSN 2696-8444versión impresa ISSN 2938-1215

J. Mex. Fed. Radiol. Imaging vol.4 no.3 Ciudad de México jul./sep. 2025  Epub 25-Nov-2025

https://doi.org/10.24875/jmexfri.m25000108 

Brief research article

Comparison of the diagnostic performance of Quantra artificial intelligence software with an experienced radiologist in the mammographic breast density assessment in women with and without breast implants

Beatriz E. Gonzalez-Ulloa1  * 
http://orcid.org/0009-0000-0042-0345

Claudia B. Corona-Gonzalez1 
http://orcid.org/0009-0002-5647-825X

Rosa L. Molina-Gutierrez1 
http://orcid.org/0009-0005-0469-098X

1Breast Imaging Department, Centro de Diagnostico Especializado por Imagen, Zapopan, Jalisco, Mexico


ABSTRACT

Mammographic sensitivity decreases when mammographic breast density (MBD) is assessed in women with dense breasts and/or breast implants. This study compared the diagnostic performance of Quantra artificial intelligence (AI) software with an experienced radio logist with 32 years of experience interpreting breast images as the gold standard in MBD assessment of dense categories (c+d) in women with and without breast implants. In this prospective cohort study, an experienced radiologist and AI Quantra (v 2.2.2) assessed 2D mammograms and tomosyntheses of women over 35 years of age with and without breast implants in dense categories (c+d) based on the Breast Imaging Reporting and Data System (BI-RADS) 5th Edition. Sensitivity, specificity, positive predictive value, negative predictive value, and accuracy were recorded. AI Quantra sensitivity was low (30.6%, 95% CI 18.2-45.4) in dense categories (c+d) in women with breast implants (n = 130). In contrast, sensitivity was high (95.2%, 95% CI 92.1-97.3) in women without breast implants (n = 548). Accuracy was 73.1% (95% CI 64.6-80.5%) and 81.0% (95% CI 77.5-84.2), respectively. The diagnostic performance of the current version of Quantra AI in assessing MBD in dense categories (c+d) was unacceptably low in women with breast implants.

Keywords: Mammographic breast density; Artificial intelligence; Experienced radiologist; BI-RADS; Quantra

INTRODUCTION

The diagnostic performance of artificial intelligence (AI) assessing mammographic breast density (MBD) is comparable to that of radiologists, and synergies may exist between the two1-3. The Food and Drug Admini stration (FDA) approved AI Quantra v.2.2.2 for MBD assessment. It quantifies the densest area based on the Breast Imaging Reporting and Data System (BI-RADS) 5th Edition4. AI software for MBD assessment has potential benefits and risks, as radiologists may be distracted, leading to more errors in image diagnosis5-7. Therefore, an automated AI method such as Quantra software could have greater reproducibility and accuracy in classifying MBD. However, Quantra AI was not developed for MBD assessment of women with breast implants8.

Intra- and interobserver agreement between radio logists and Quantra AI has been reported in women without implants3,5, and when women with and without implants are compared9. In a previous report, we compared the diagnostic performance of AI Quantra and an experienced radiologist in MBD assessment without differentiating women with and without implants5.

Previous studies have shown better diagnostic per formance of Quantra AI in two categories (non-dense and dense)10,11. Mammographic sensitivity decreases in women with dense breasts and implants12,13. The dense (c+d) category has a higher risk of cancer, and additional examinations must be performed. This study compared the diagnostic performance of Quantra AI software with that of an experienced radiologist as the gold standard in MBD assessment of dense categories (c+d) in women with and without breast implants.

MATERIAL AND METHODS

This prospective cohort study was conducted from May 2 to June 30, 2022, in the Breast Imaging Department of the Centro de Diagnóstico Especializado por Imagen in Zapopan, Jalisco, Mexico. An experienced radiologist with training in breast imaging and current certification by the Mexican Council of Radiology and Imaging participated in the study. Consent was obtained from the radiologist who participated in the study.

Study development and variables

Screening or diagnostic mammograms of women aged 35 years and older with and without breast implants were analyzed from a previously published study9 corres ponding to phase 1. The dense MBD category (c+d) was based on the American College of Radiology BI-RADS 5th Edition4. Sex and years of experience as a radiologist performing breast imaging examinations were recorded.

Digital mammography and digital breast tomosynthesis

Images were acquired using Selenia Dimensions equipment (Hologic, Bedford, MA, USA) with automatic acquisition parameters. Images were stored and reviewed in PACS (SecureView, Diagnostic Workstation, Bedford, MA, USA). Conventional projections, two craniocaudal (CC) and two mediolateral oblique (MLO) images of both breasts, were obtained. Images with implant displacements were evaluated in women with breast implants. MBD was classified according to the 5th Edition of BI-RADS based on the densest area of fibroglandular tissue in the dense breast (c+d), category c, heterogeneously dense, and category d, extremely dense.

Quantra AI software

The mammography images were analyzed with Quantra AI version 2.2.2 (Hologic Inc., Bedford, MA, USA). AI Quantra analyzes MBD in images with implant displacements. The assessment is based on the distribution and texture of the fibroglandular tissue pattern, with an estimate of breast composition by selecting the densest category according to BI-RADS 5th Edition.

Statistical analysis

Sensitivity, specificity, positive predictive values, negative predictive values, and accuracy were calculated to evaluate the diagnostic performance of Quantra AI compared to an experienced radiologist as the gold standard. The statistical analysis was performed with SPSS v.25 (IBM Corp., Armonk, NY, USA).

RESULTS

The radiologist with 32 years of experience reads approximately 90 mammograms per week and spends 50 hours performing various breast examinations and procedures (including mammography, ultrasound, MRI, biopsies, and breast marking). A total of 678 mammograms were analyzed, 130 mammograms with breast implants and 548 mammograms without breast implants.

Table 1 shows the diagnostic performance of AI Quantra compared to an experienced radiologist in assessing MBD in women with dense breasts (c+d) and breast implants. The sensitivity of AI Quantra in assessing dense categories (c+d) in women with breast implants (n = 130) was low (30.6%, 95% CI 18.2-45.4). Specificity was high (98.8%, 95% CI, 93.3-99.9) while accuracy was 73.1% (95% CI, 64.6-80.5).

Table 1 Diagnostic performance of AI Quantra compared to an experienced radiologist as the gold standard in MBD assessment of dense categoriesa in women with breast implants 

Parameter % 95% CI
Sensitivity 30.6 18.2-45.4
Specificity 98.8 93.3-99.9
Positive predictive value 93.7 67.1-99.1
Negative predictive value 70.2 66.1-73.9
Accuracy 73.1 64.6-80.5

ac+d categories; AI: artificial intelligence; BI-RADS: Breast Imaging Reporting and Data System; MBD: mammographic breast density; CI: confidence interval.

Figure 1 shows a mammogram with concordance between Quantra AI and the radiologist in classifying dense (c+d) MBD categories in a woman with breast implants. In contrast, Figure 2 shows that Quantra AI underestimates or overestimates dense MBD categories compared to the radiologist in a patient with breast implants.

AI: artificial intelligence; BI-RADS: Breast Imaging Reporting and Data System; MBD: mammography breast density; HR: human reader; MLOID: mediolateral oblique implant displacement.

Figure 1 Mammogram of a woman with breast implants. A and B: the MLOID views of the right breast show concordance between Quantra AI and an experienced radiologist (HR) in the classification of dense (c+d) MBD categories using BI-RADS 5th Edition: category c, heterogeneously dense; and category d, extremely dense. 

AI: artificial intelligence; BI-RADS: Breast Imaging Reporting and Data System; HR: human reader; MBD: mammography breast density; MLOID: mediolateral oblique implant displacement.

Figure 2 Mammogram of a woman with breast implants. A, B, and C: the MLOID views of the right breast show no concordance between Quantra AI and an experienced radiologist (HR) in the classification of dense (c+d) MBD categories using BI-RADS 5th Edition: category c, heterogeneously dense; and category d, extremely dense. 

Table 2 shows the diagnostic performance of Quantra AI compared to an experienced radiologist as the gold standard in MBD assessment of dense categories (c+d) in women with dense breasts without breast implants. Sensitivity was high (95.2%, 95% CI 92.1-97.3), while specificity was low (62.6%, 95% CI 56.1-68.8). Accuracy was 81.0% (95% CI, 77.5-84.2).

Table 2 Diagnostic performance of AI Quantra compared to an experienced radiologist as the gold standard in MBD assessment of dense categoriesa in women without breast implants 

Parameter % 95% CI
Sensitivity 95.2 92.1-97.3
Specificity 62.6 56.1-68.8
Positive predictive value 76.8 73.7-79.6
Negative predictive value 90.8 85.7-94.3
Accuracy 81.0 77.5-84.2

ac+d categories; AI: artificial intelligence; BI-RADS: Breast Imaging Reporting and Data System; MBD: mammographic breast density; CI: confidence interval.

Figure 3 shows the mammogram of a woman without breast implants, with concordance between Quantra AI and the radiologist in classifying the dense (c+d) MBD categories. In contrast, Figure 4 shows that the Quantra AI underestimates or overestimates the dense MBD categories compared to the radiologist in a patient without breast implants.

AI: artificial intelligence; BI-RADS: Breast Imaging Reporting and Data System; MBD: mammography breast density; HR: human reader; MLO: mediolateral oblique.

Figure 3 Mammogram of a woman without breast implants. A and B: the MLO views of the right breast show concordance between Quantra AI and an experienced radiologist (HR) in the classification of dense (c+d) MBD categories using BI-RADS 5th Edition: category c, heterogeneously dense; and category d, extremely dense. 

AI: artificial intelligence; BI-RADS: Breast Imaging Reporting and Data System; HR: human reader; MBD: mammography breast density; MLO: mediolateral oblique.

Figure 4 Mammogram of a woman without breast implants. A, B, and C: the MLO views of the right breast show no concordance between Quantra AI and an experienced radiologist (HR) in the classification of dense (c+d) MBD categories using BI-RADS 5th Edition: category c, heterogeneously dense; and category d, extremely dense. 

DISCUSSION

Our study showed unacceptably low sensitivity in the diagnostic performance of the current version of Quantra AI in MBD assessment in dense categories (c+d) in women with breast implants. In contrast, its sensitivity in assessing dense MBD categories (c+d) in women without breast implants was high. This report is the first comparing Quantra AI and an experienced radiologist in MBD assessment of women with dense breasts with and without breast implants.

Quantra AI has not been sufficiently tested for the evaluation of MBD in women with implants, and there are no reports evaluating its diagnostic performance. In our previously published study9, we examined 678 women, 130 with breast implants and 548 without breast implants. Quantra AI classified dense categories in 114 (87.7%) of 130 women with breast implants and four radiologists in 81 (62.3%), whereas in women without breast implants, Quantra AI classified dense categories in 384 (70.1%) of 548 and radiologists in 310 (56.6%) of 548 mammograms; the concordance between Quantra AI and four radiologists was better in women without breast implants. On the other hand, the interobserver agreement between four radiologists and Quantra AI in dense categories was slight to fair in women with breast implants. In contrast, it was moderate in women without breast implants. These results suggest that the interobserver agreement between the radiologists and Quantra AI was unacceptable in dense MBD categories in women with breast implants. This study showed comparable results in the diagnostic performance of Quantra AI with that of an experienced radiologist as the gold standard in MBD assessment of dense categories (c+d) in women with breast implants. The sensitivity of Quantra AI was unacceptably low (30.6%). This result means that Quantra AI does not detect dense breasts in 7 out of 10 women with breast implants. We therefore confirmed the manufacturer's recommendation that Quantra AI can process images with breast implants, although it was not designed for this purpose and may inaccurately report MBD in women with breast implants.

There are few reports on the diagnostic performance of AI Quantra in MBD assessment1,10,11. Epko et al.11 compared the previous version of AI Quantra (v2.0) with a majority radiologist-generated report as the gold standard for MBD assessment. Sensitivity was 91.3% and specificity was 83.6% for the two MBD categories (a+b vs. c+d). Although the authors did not specify whether the women had implants or not, the diagnostic performance of AI Quantra was high, especially in the two MBD categories. They concluded that the diagnostic performance of AI Quantra reproduced the BI-RADS classification for two MBD categories very well. In our study, using the current AI Quantra version (v2.2.2) as a comparison to an experienced radiologist, we found high sensitivity (95.2%) for dense breasts in women without breast implants, with a specificity of 62.6%. As Quantra AI version was a different version, it showed a higher sensitivity with the new version of the software. There is no doubt about the added value that AI can bring to diagnostic imaging, especially in the assessment of MBD.

The strengths of this study are its prospective design and sample size. However, the limitations of the study were that it was a single-center study, only one experienced radiologist participated, and a single mammography unit recorded all mammograms. On the other hand, Quantra AI was the only software evaluated at our center.

CONCLUSION

The diagnostic performance of the current version of Quantra AI in MBD assessment in dense categories (c+d) had unacceptably low sensitivity in our study of women with breast implants. In contrast, the sensitivity of Quantra AI in assessing dense MBD categories (c+d) in women without breast implants was high. Therefore, it is important to have an AI tool with better diagnostic performance in women with breast implants. We hope a new version of Quantra AI software will be available for use in women with implants, as the number of women with implants is increasing.

Acknowledgments

The authors thank Professor Ana M. Contreras-Navarro for her guidance in preparing and writing this scientific paper.

Funding

This research received no external funding.

Conflicts of interest

The authors declare no conflicts of interest.

Ethical considerations

Protection of humans and animals. The authors declare that the procedures followed complied with the ethical standards of the responsible human experimentation committee and adhered to the World Medical Association and the Declaration of Helsinki. The procedures were approved by the institutional Ethics Committee.

Confidentiality, informed consent, and ethical approval. Consent was obtained from the radiologist who participated in the study.

Declaration on the use of artificial intelligence. The authors declare that no generative artificial intelligence was used in the writing of this manuscript.

REFERENCES

1. Richard-Davis G, Whittemore B, Disher A, Rice VM, Lenin RB, Dollins C, et al. Evaluation of quantra hologic volumetric computerized breast density software in comparison with manual interpretation in a diverse population. Breast Cancer (Auckl). 2018;12:1178223418759296. doi:10.1177/1178223418759296. [ Links ]

2. Taylor CR, Monga N, Johnson C, Hawley JR, Patel M. artificial intelligence applications in breast imaging: current status and future directions. Diagnostics (Basel). 2023;13(12):2041. doi:10.3390/diagnostics13122041. [ Links ]

3. Ciatto S, Bernardi D, Calabrese M, Durando M, Gentilini MA, Mariscotti G, et al. A first evaluation of breast radiological density assessment by QUANTRA software as compared to visual classification. Breast. 2012;21(4):503-506. doi:10.1016/j.breast.2012.01.005. [ Links ]

4. American College of Radiology. ACR BI-RADS Atlas: Breast Imaging Reporting and Data System. 5th ed. Reston, VA: American College of Radiology; 2013. [ Links ]

5. Gonzalez-Ulloa B, Corona-Gonzalez C, Molina-Gutierrez R. Diagnostic performance of an experienced radiologist and Quantra artificial intelligence software in the assessment of mammographic breast density. J Mex Fed Radiol Imaging. 2025;4(1):37-43. doi:10.24875/JMEXFRI.M25000094. [ Links ]

6. Ornelas-Cortinas G, Luna-Marroquin AK. Diagnostic errors in radiology: where are we? J Mex Fed Radiol Imaging. 2024;3(4):205-207. doi: 10.24875/JMEXFRI.M24000085. [ Links ]

7. Dratsch T, Chen X, Rezazade Mehrizi M, Kloeckner R, Mähringer-Kunz A, Püsken M, et al. Automation bias in mammography: the impact of artificial intelligence BI-RADS suggestions on reader performance. Radiology. 2023;307(4):e222176. doi:10.1148/radiol.222176. [ Links ]

8. Hologic Inc. Understanding Quantra 2.2 user guide for Cenova 3.0.1. English Man 05503-302 rev 002. Bedford, MA: Hologic Inc.; 2019 [Internet]. Available from: https://www.hologic.com. [ Links ]

9. Gonzalez-Ulloa B, Corona-Gonzalez C, Molina-Gutierrez R. Comparison of mammography breast density assessment by radiologists and Quantra artificial intelligence in women with and without breast implants: intra and interobserver agreement. J Mex Fed Radiol Imaging. 2025;4(2):102-111. doi:10.24875/JMEXFRI.M25000103. [ Links ]

10. Gonzalez-Ulloa B, Corona-Gonzalez C, Molina-Gutierrez R. Mammography breast density assessment with Quantra artificial intelligence software: intra and interobserver agreement with radiologists. J Mex Fed Radiol Imaging. 2024;3(4):221-230. doi:10.24875/JMEXFRI.M24000088. [ Links ]

11. Ekpo EU, McEntee MF, Rickard M, Brennan PC, Kunduri J, Demchig D, et al. Quantra™ should be considered a tool for two-grade scale mammographic breast density classification. Br J Radiol. 2016;89(1060): 20151057. doi:10.1259/bjr.20151057. [ Links ]

12. Miglioretti DL, Rutter CM, Geller BM, Cutter G, Barlow WE, Rosenberg R, et al. Effect of breast augmentation on the accuracy of mammography and cancer characteristics. JAMA. 2004;291(4):442-450. doi:10.1001/ jama.291.4.442. [ Links ]

13. Handel N. The effect of silicone implants on the diagnosis, prognosis, and treatment of breast cancer. Plast Reconstr Surg. 2007;120(7 Suppl 1): 81S-93S. doi:10.1097/01.prs.0000286578.94102.2b. [ Links ]

Received: May 04, 2025; Accepted: June 09, 2025

* Corresponding author: Beatriz E. Gonzalez-Ulloa. E-mail: betyglez@yahoo.com

Creative Commons License Federación Mexicana de Radiología e Imagen, A.C. Published by Permanyer. This is an open ccess article under the CC BY-NC-ND license