Abstract
Purpose
To evaluate inter-observer agreement of MRI features and classification of cystic renal masses among radiologist and radiology trainees.
Methods
Four readers (two radiologists and two radiology trainees) retrospectively reviewed 100 cystic renal lesions on gadolinium enhanced MRI and assigned each a Bosniak classification (1, 2, 2F, 3, and 4). Lesions were also assessed on their individual features including size, presence of nodules, septations, and enhancement. Readers ranked their level of confidence regarding Bosniak classifications. Inter-observer variability of lesion classification and features was evaluated between raters at both radiologist and radiology trainee levels as well as the level of agreement of all four readers using weighted Kappa and intraclass correlation coefficient (ICC).
Results
One hundred cystic renal lesions were evaluated. There was moderate and substantial classification agreement between trainees and radiologists (ICC 0.59 and 0.63, respectively). There was substantial classification agreement among all four readers (0.66) with the lowest level of agreement for Bosniak 2F lesions (ICC 0.14). There was moderate-substantial agreement for the presence of nodular component, septations, and enhancement. Staff demonstrated highest agreement when assessing for nodular components (0.73). Agreement for the presence of enhancement was lowest (0.37 and 0.42 for radiologists and trainees, respectively). Reported confidence was higher among radiologists compared with trainees.
Conclusion
There is substantial overall inter-observer agreement in the MRI classification of cystic renal lesions. Confidence increases as rater experience increases.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Kissane JM (1976) The morphology of renal cystic disease. Perspect Nephrol Hypertens 4:31–63
Hartman DS, Davis CJ Jr, Johns T, et al. (1986) Cystic renal cell carcinoma. Urology 28(2):145–153
Bosniak MA (1986) The current radiological approach to renal cysts. Radiology 158:1–10
Bosniak MA (1997) Diagnosis and management of patients with complicated cystic lesions of the kidney. AJR 169:819–821
Benjaminov O, Atri M, O’Malley M, et al. (2006) Enhancing component on CT to predict malignancy in cystic renal masses and interobserver agreement of different CT features. AJR 186:665–672
Siegel CL, McFarland EG, Brink JA, et al. (1997) CT of cystic renal masses: analysis of diagnostic performance and interobserver variation. AJR 169:813–818
Israel GM, Hindman N, Bosniak MA (2004) Evaluation of cystic renal masses: comparison of CT and MR imaging by using the Bosniak classification system. Radiology 231:365–371
Koga S, Nishikido M, Inuzuka S, et al. (2000) An evaluation of Bosniak’s radiological classification of cystic renal masses. BJU Int 86:607–609
Curry NS, Cochran ST, Bissada NK (2000) Cystic renal masses: accurate Bosniak classification requires adequate renal CT. AJR 175:339–342
Aronson S, Frazier H, Baluch JD, Hartman DS, et al. (1991) Cystic renal masses: usefulness of the Bosniak classification. Urol Radiol 13:83–90
Israel GM, Bosniak MA (2003) Follow-up CT of moderately complex cystic lesions of the kidney (Bosniak category IIF). AJR 181:627–633
Gulani V, Saroja A, Hero H (2008) Apparent wall thickening of cystic renal lesions on MRI. J Magn Reson Imaging 28:103–110
Acknowledgments
The authors would like to acknowledge Dr. Rebecca Thornhill for her assistance with project statistics.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Seppala, N., Kielar, A., Dabreo, D. et al. Inter-rater agreement in the characterization of cystic renal lesions on contrast-enhanced MRI. Abdom Imaging 39, 1267–1273 (2014). https://doi.org/10.1007/s00261-014-0162-5
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00261-014-0162-5