Abstract
Objective
We assessed multiple readers’ positive predictive values (PPVs) for ACR BI-RADS 3, 4a, 4b, 4c and 5 masses on ultrasound (US) pre- and post-proposed guidelines.
Methods
This retrospective, IRB-approved study included four American and four non-American readers who assigned BI-RADS categories for US images of 374 biopsy-proved masses. Readers were offered guidelines and re-classified the masses. We assessed readers’ abilities to achieve ACR benchmarks BI-RADS categories pre- and post-guidelines.
Results
PPVs increased with BI-RADS category. The PPVs pre- and post-guidelines were 6.0% and 4.4% for category 3, 27.3% and 30.5% for category 4a, 49.9% and 51.5% for category 4b, 69.0% and 67.4% for category 4c, and 79.3% and 80.1% for category 5. Readers achieved the PPV benchmark for category 4c, but not for categories 3, 4a, 4b and 5, with no significant improvement after guidelines. Regular BI-RADS 4 subcategory users missed benchmarks by less than non-regular users.
Conclusion
Pre- and post-guidelines, readers’ PPVs increased with BI-RADS categories, ACR PPV benchmarks were achieved in category 4c, missed in other categories, especially in the critical 4a subcategory, where the PPV was too high. BI-RADS 4 subcategory users performed better than non-users.
Key points
• Readers failed to achieve benchmarks for BI-RADS 4 subcategories, especially 4a.
• USA and Brazilian readers performed similarly in ACR BI-RADS 4 subcategorization.
• Proposed guidelines did not improve overall, USA or Brazilian reader performance.
• Regularly BI-RADS 4 subcategory users performed better than did non-users.
• US features distinguished between benign and malignant, not BI-RADS 4 subcategories.
Similar content being viewed by others
References
American College of Radiology (2013) BI-RADS®—Ultrasound. version 2. In: Breast Imaging Reporting and Data System (BI-RADS) atlas, 5th edn. American College of Radiology, Reston
Berg WA, Blume JD, Cormack JB et al (2008) Combined screening with ultrasound and mammography vs. mammography alone in women at elevated risk of breast cancer. JAMA 299:2151–2163
Berg WA, Zhang Z, Lehrer D et al (2012) Detection of breast cancer with addition of annual screening ultrasound or a single screening MRI to mammography in women with elevated breast cancer risk. JAMA 307:1394–1404
Tagliafico AS, Calabrese M, Mariscotti G et al (2016) Adjunct screening with tomosynthesis or ultrasound in women with mammography-negative dense breasts: interim report of a prospective comparative trial. JCO 34:1882–1888
Berg WA (2016) Current Status of Supplemental Screening in Dense Breasts. JCO 34:1840–1843
Itoh A, Ueno E, Tohno E et al (2006) Breast disease: clinical application of US elastography for diagnosis. Radiology 239:341–350
Berg WA, Cosgrove DO, Dore CJ et al (2012) Shear-wave elastography improves the specificity of breast US: the BE1 multinational study of 939 masses. Radiology 262:435–449
Forsberg F, Piccoli CW, Merton DA, Palazzo JJ, Hall AL (2007) Breast lesions: imaging with contrast-enhanced subharmonic US--initial experience. Radiology 244:718–726
Oraevsky AA et al (2001) Laser optoacoustic imaging of breast cancer in vivo. Biomedical Optoacoustics II. In: Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series :4256, p 6–15.
Heijblom M et al (2015) Photoacoustic image patterns of breast carcinoma and comparisons with Magnetic Resonance Imaging and vascular stained histopathology. Sci Rep 5:1–15
Stavros AT, Thickman D, Rapp CL, Dennis MA, Parker SH, Sisney GA (1995) Solid breast nodules: use of sonography to distinguish between benign and malignant lesions. Radiology 196:123–134
Stavros AT (2004) Ultrasound of solid breast nodules: distinguishing benign from malignant. In: Stavros AT (ed) Breast Ultrasound. Williams &Wilkins, Philadelphia, pp 445–527
Jales RM, Sarian LO, Torresan R, Marussi EF, Álvares BR, Derchain S (2013) Simple rules for ultrasonographic subcategorization of BI-RADS®-US 4 breast masses. Eur J Radiol 82:1231–1235
Lee HJ, Kim EK, Kim MJ et al (2008) Observer variability of Breast Imaging Reporting and Data System (BI-RADS) for breast ultrasound. Eur J Radiol 65:293–298
Wanaporn B, Ornsiri A (2011) Accuracy of subcategories A, B, C in BI-RADS 4 lesions by combined mammography and breast ultrasound findings. Afr J Med Med Sci 2(3):728–733
Lazarus E, Mainiero MB, Schepps B, Koelliker SL, Livingston LS (2006) BI-RADS Lexicon for US and mammography: Interobserver variability and positive predictive value. Radiology 239:385–391
Yoon JH, Kim MJ, Moon HJ, Kwak JY, Kim EK (2011) Subcategorization of ultrasonongraphic BI-RADS category 4: positive predictive value and clinical factors affecting it. Ultrasound Med Biol 37:693–699
Kim EK, Ko KH, Oh KK et al (2008) Clinical application of the BI-RADS final assessment to breast sonography in conjunction with mammography. AJR Am J Roentgenol 190:1209–1215
Berg WA, Blume JD, Cormack JB, Mendelson EB (2012) Training the ACRIN 6666 Investigators and effects of feedback on breast ultrasound interpretive performance and agreement in BI-RADS ultrasound feature analysis. AJR Am J Roentgenol 199:224–235
Gong X, Xu Q, Xu Z et al (2011) Real time elastography for the differentiation of benign and malignant breast lesions: a meta-analysis. Breast Cancer Res Treat 130:11–18
Liu B, Zheng Y, Huang G et al (2016) Breast lesions; Quantitative diagnosis using ultrasound shear wave elastography – a systematic review and meta-analysis. Ultrasound Med Biol 42:835–847
Jørgensen KJ, Gøtzsche P (2009) Overdiagnosis in publicly organised mammography screening programmes: systematic review of incidence trends. BMJ 339:b2587
Raftery J, Chorozoglou M (2011) Possible net harms of breast cancer screening: updated modeling of Forrest report. BMJ 343:d7627
Welch HG, Frankel BA (2011) Likelihood that a woman with screen-detected breast cancer has had her ‘life saved’ by that screening. Arch Intern Med 171:2043–2046
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Guarantor
The scientific guarantor of this publication is A. Thomas Stavros, MD, FACR.
Conflict of interest
The authors of this manuscript declare no relationships with any companies whose products or services may be related to the subject matter of the article.
Funding
The authors state that this work has not received any funding.
Statistics and biometry
Jonathan Duggins and Sandy Ferber of Array Biostatistics, Inc provided statistical advice for this manuscript.
Informed consent
Written informed consent was waived by the Institutional Review Board.
Ethical approval
Institutional Review Board approval was obtained.
Methodology
• retrospective
• cobservational
• multicenter study
Rights and permissions
About this article
Cite this article
Stavros, A.T., Freitas, A.G., deMello, G.G.N. et al. Ultrasound positive predictive values by BI-RADS categories 3–5 for solid masses: An independent reader study. Eur Radiol 27, 4307–4315 (2017). https://doi.org/10.1007/s00330-017-4835-7
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00330-017-4835-7