Skip to main content

Advertisement

Log in

Validation of self-reported post-treatment mammography surveillance among breast cancer survivors by electronic medical record extraction method

  • Epidemiology
  • Published:
Breast Cancer Research and Treatment Aims and scope Submit manuscript

Abstract

Little is known about validity of self-reported mammography surveillance among breast cancer survivors. Most studies have focused on accuracy among healthy, average-risk populations and none have assessed validity by electronic medical record (EMR) extraction method. To assess validity of survivor-reported mammography post-active treatment care, we surveyed all survivors diagnosed 2004–2009 in an academic hospital cancer registry (n = 1441). We used electronic query and manual review to extract EMR data. Concordance, sensitivity, specificity, positive predictive value, and report-to-records ratio were calculated by comparing survivors’ self-reports to data from each extraction method. We also assessed average difference in months between mammography dates by source and correlates of concordance. Agreement between the two EMR extraction methods was high (concordance 0.90; kappa 0.70), with electronic query identifying more mammograms. Sensitivity was excellent (0.99) regardless of extraction method; concordance and positive predictive value were good; however, specificity was poor (manual review 0.20, electronic query 0.31). Report-to-records ratios were both over 1 suggesting over-reporting. We observed slight forward telescoping for survivors reporting mammograms 7–12 months prior to survey date. Higher educational attainment and less time since mammogram receipt were associated with greater concordance. Accuracy of survivors’ self-reported mammograms was generally high with slight forward telescoping among those recalling their mammograms between 7 and 12 months prior to the survey date. Results are encouraging for clinicians and practitioners relying on survivor reports for surveillance care delivery and as a screening tool for inclusion in interventions promoting adherence to surveillance guidelines.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1

Similar content being viewed by others

Abbreviations

EMR:

Electronic medical record

RA:

Research assistant

CI:

Confidence interval

References

  1. Surveillance, Epidemiology, and End Results Program, National Cancer Institute. (2014) SEER Stat Fact Sheets: Breast Cancer. National Cancer Institute. http://seer.cancer.gov/statfacts/html/breast.html. Accessed 29 Dec 2014

  2. Khatcheressian JL, Hurley P, Bantug E, Esserman LJ, Grunfeld E, Halberg F, Hantel A, Henry NL, Muss HB, Smith TJ, Vogel VG, Wolff AC, Somerfield MR, Davidson NE (2013) Breast cancer follow-up and management after primary treatment: American Society of Clinical Oncology clinical practice guideline update. J Clin Oncol 31:961–965

    Article  CAS  PubMed  Google Scholar 

  3. Khatcheressian JL, Wolff AC, Smith TJ, Grunfeld E, Muss HB, Vogel VG, Halberg F, Somerfield MR, Davidson NE (2006) American Society of Clinical Oncology 2006 update of the breast cancer follow-up and management guidelines in the adjuvant setting. J Clin Oncol 24:5091–5097

    Article  PubMed  Google Scholar 

  4. Bevers TB, Anderson BO, Bonaccio E, Buys S, Daly MB, Dempsey PJ, Farrar WB, Fleming I, Garber JE, Harris RE, Heerdt AS, Helvie M, Huff JG, Khakpour N, Khan SA, Krontiras H, Lyman G, Rafferty E, Shaw S, Smith ML, Tsangaris TN, Williams C, Yankeelov T (2009) NCCN clinical practice guidelines in oncology: breast cancer screening and diagnosis. J Natl Compr Cancer Netw 7:1060–1096

    Google Scholar 

  5. Smith TJ, Davidson NE, Schapira DV, Grunfeld E, Muss HB, Vogel VG III, Somerfield MR (1999) American Society of Clinical Oncology 1998 update of recommended breast cancer surveillance guidelines. J Clin Oncol 17:1080–1082

    CAS  PubMed  Google Scholar 

  6. Carcaise-Edinboro P, Bradley CJ, Dahman B (2010) Surveillance mammography for Medicaid/Medicare breast cancer patients. J Cancer Surviv 4:59–66

    Article  PubMed Central  PubMed  Google Scholar 

  7. Doubeni CA, Field TS, Ulcickas YM, Rolnick SJ, Quessenberry CP, Fouayzi H, Gurwitz JH, Wei F (2006) Patterns and predictors of mammography utilization among breast cancer survivors. Cancer 106:2482–2488

    Article  PubMed  Google Scholar 

  8. Field TS, Doubeni C, Fox MP, Buist DS, Wei F, Geiger AM, Quinn VP, Lash TL, Prout MN, Yood MU, Frost FJ, Silliman RA (2008) Under utilization of surveillance mammography among older breast cancer survivors. J Gen Intern Med 23:158–163

    Article  PubMed Central  PubMed  Google Scholar 

  9. Elston Lafata J, Simpkins J, Schultz L, Chase GA, Johnson CC, Yood MU, Lamerato L, Nathanson D, Cooper G (2005) Routine surveillance care after cancer treatment with curative intent. Med Care 43:592–599

    Article  PubMed  Google Scholar 

  10. Geller BM, Kerlikowske K, Carney PA, Abraham LA, Yankaskas BC, Taplin SH, Ballard-Barbash R, Dignan MB, Rosenberg R, Urban N, Barlow WE (2003) Mammography surveillance following breast cancer. Breast Cancer Res Treat 81:107–115

    Article  PubMed  Google Scholar 

  11. Breslau ES, Jeffery DD, Davis WW, Moser RP, McNeel TS, Hawley S (2010) Cancer screening practices among racially and ethnically diverse breast cancer survivors: results from the 2001 and 2003 California health interview survey. J Cancer Surviv 4:1–14

    Article  PubMed  Google Scholar 

  12. Duffy CM, Clark MA, Allsworth JE (2006) Health maintenance and screening in breast cancer survivors in the United States. Cancer Detect Prev 30:52–57

    Article  PubMed  Google Scholar 

  13. Katz ML, Donohue KA, Alfano CM, Day JM, Herndon JE, Paskett ED (2009) Cancer surveillance behaviors and psychosocial factors among long-term survivors of breast cancer. Cancer and Leukemia Group B 79804. Cancer 115:480–488

    Article  PubMed Central  PubMed  Google Scholar 

  14. Vernon SW, Tiro JA, Meissner HI (2008) Behavioral research in cancer screening. In: Miller SM, Bowen DJ, Croyle RT, Rowland JH (eds) Handbook of cancer control and behavioral science: a resource for researchers, practitioners, and policymakers. American Psychological Association, Washington, DC, pp 255–278

    Google Scholar 

  15. Vernon SW, Briss PA, Tiro JA, Warnecke RB (2004) Some methodologic lessons learned from cancer screening research. Cancer 101:1131–1145

    Article  PubMed  Google Scholar 

  16. Rauscher GH, Johnson TP, Cho YI, Walk JA (2008) Accuracy of self-reported cancer-screening histories: a meta-analysis. Cancer Epidemiol Biomark Prev 17:748–757

    Article  Google Scholar 

  17. Howard M, Agarwal G, Lytwyn A (2009) Accuracy of self-reports of Pap and mammography screening compared to medical record: a meta-analysis. Cancer Causes Control 20:1–13

    Article  PubMed  Google Scholar 

  18. Norman SA, Localio AR, Zhou L, Bernstein L, Coates RJ, Flagg EW, Marchbanks PA, Malone KE, Weiss LK, Lee NC, Nadel MR (2003) Validation of self-reported screening mammography histories among women with and without breast cancer. Am J Epidemiol 158:264–271

    Article  PubMed  Google Scholar 

  19. Armstrong K, Long JA, Shea JA (2004) Measuring adherence to mammography screening recommendations among low-income women. Prev Med 38:754–760

    Article  PubMed  Google Scholar 

  20. Tang PC, Ralston M, Arrigotti MF, Qureshi L, Graham J (2007) Comparison of methodologies for calculating quality measures based on administrative data versus clinical data from an electronic health record system: implications for performance measures. J Am Med Inform Assoc 14:10–15

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  21. Hsiao CJ, Burt CW, Rechtsteiner E, Hing E, Woodwell DA, and Sisk JE. (2008) Preliminary estimates of electronic medical record use by office-based physicians: United States, 2008. http://www.cdc.gov/nchs/products/pubs/pubd/hestats/hestats.htm

  22. Blumenthal D (2009) Stimulating the adoption of health information technology. N Engl J Med 360:1477–1479

    Article  CAS  PubMed  Google Scholar 

  23. Blumenthal D (2011) Implementation of the federal health information technology initiative. N Engl J Med 365:2426–2431

    Article  CAS  PubMed  Google Scholar 

  24. Carpentier MY, Tiro JA, Savas LS, Bartholomew LK, Melhado TV, Coan SP, Argenbright KE, Vernon SW (2013) Are cancer registries a viable tool for cancer survivor outreach? A feasibility study. J Cancer Surviv 7:155–163

    Article  PubMed Central  PubMed  Google Scholar 

  25. Tisnado DM, Adams JL, Liu H, Damberg CL, Chen WP, Hu FA, Carlisle DM, Mangione CM, Kahn KL (2006) What is the concordance between the medical record and patient self-report as data sources for ambulatory care? Med Care 44:132–140

    Article  PubMed  Google Scholar 

  26. Zapka JG, Bigelow C, Hurley T, Ford LD, Egelhofer J, Cloud WM, Sachsse E (1996) Mammography use among sociodemographically diverse women: the accuracy of self-report. Am J Public Health 86:1016–1021

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  27. Hollowell K, Olmsted CL, Richardson AS, Pittman HK, Bellin L, Tafra L, Verbanac KM (2010) American Society of Clinical Oncology-recommended surveillance and physician specialty among long-term breast cancer survivors. Cancer 116:2090–2098

    PubMed  Google Scholar 

  28. Cheung WY, Neville BA, Cameron DB, Cook EF, Earle CC (2009) Comparisons of patient and physician expectations for cancer survivorship care. J Clin Oncol 27:2489–2495

    Article  PubMed  Google Scholar 

  29. Johnson TP, O’Rourke DP, Burris JE, Warnecke RB (2005) An investigation of the effects of social desirability on the validity of self-reports of cancer screening behaviors. Med Care 43:565–573

    Article  PubMed  Google Scholar 

  30. Snyder CF, Frick KD, Kantsiper ME, Peairs KS, Herbert RJ, Blackford AL, Wolff AC, Earle CC (2009) Prevention, screening, and surveillance care for breast cancer survivors compared with controls: changes from 1998 to 2002. J Clin Oncol 27:1054–1061

    Article  PubMed  Google Scholar 

Download references

Acknowledgments

This study was funded by the Moncrief Cancer Institute. The content is solely the responsibility of the authors and does not necessarily represent the official view of the Moncrief Cancer Institute.

Conflict of interest

The authors declare that they have no conflicts of interest.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jasmin A. Tiro.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tiro, J.A., Sanders, J.M., Shay, L.A. et al. Validation of self-reported post-treatment mammography surveillance among breast cancer survivors by electronic medical record extraction method. Breast Cancer Res Treat 151, 427–434 (2015). https://doi.org/10.1007/s10549-015-3387-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10549-015-3387-2

Keywords

Navigation