Skip to main content

Advertisement

SpringerLink
Log in

Screening test accuracy studies: how valid are our conclusions? Application to visual inspection methods for cervical screening

  • Published:
Cancer Causes & Control Aims and scope Submit manuscript

Abstract

While the basic concepts associated with screening are simple, studying the value of new tests requires a very strict methodology. This paper summarizes lessons learned regarding appropriate methodologies to assess the value of new screening approaches using visual inspection with acetic acid (VIA), a screening test for cervical pre-cancerous lesions, as an example. In addition to being convenient to, safe for and acceptable by target community members, a screening test should be reliable and have good test characteristics (i.e. be able to discriminate well between early disease and non disease). Test reliability assesses the degree to which repeated measurements of the test yields the same result. To ensure reproducibility of study findings, test reliability should be assessed before any evaluation of test accuracy. The accuracy of a test (specificity and sensitivity) is measured using cross-sectional studies with adequate sample size. Several basic features are necessary to ensure internal validity for such studies: (a) final disease status data should be obtained for all subjects, (b) all tests results must be determined independently of previous results, (c) the reference standard used to determine the disease status should be accurate, (d) the full “spectrum” of the disease should be included in the study. The study results should also have external validity to be applicable to other populations to which the test will be applied. All these consideration are exemplified by 17 very heterogeneous studies published to date assessing VIA test accuracy. The assessment of a new screening test is the first step in researching a new cancer prevention strategy. For this reason, this step should be carefully addressed through rigorous studies.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. BCK Choi (1992) ArticleTitleSensitivity and specificity of a single diagnostic test in the presence of work-up bias. J Clin Epidemiol 45 581–586 Occurrence Handle10.1016/0895-4356(92)90129-B Occurrence Handle1607897

    Article  PubMed  Google Scholar 

  2. ZH Zhou (1998) ArticleTitleCorrection for verification bias in studies of a diagnostic test’s accuracy Stat Meth Med Res 7 337–353 Occurrence Handle10.1191/096228098676485370

    Article  Google Scholar 

  3. DM Hawkins JA Garrett B. Stephenson (2001) ArticleTitleSome issues in resolution of diagnostic tests using an imperfect gold standard Stat Med 20 1987–2001 Occurrence Handle10.1002/sim.819 Occurrence Handle11427955

    Article  PubMed  Google Scholar 

  4. ES Garret WW Eaton S Zeger (2002) ArticleTitleMethods for evaluating the performance of diagnostic tests in the absence of a gold standard: a latent class model approach Stat Med 21 1289–1307 Occurrence Handle10.1002/sim.1105 Occurrence Handle12111879

    Article  PubMed  Google Scholar 

  5. MF Mitchell D Schottenfeld G Tortolero-Luna SB Cantor R Richards-Kortum (1998) ArticleTitleColposcopy for the diagnosis of squamous intraepithelial lesions: a meta-analysis. Obstet Gyneco 91 626–631 Occurrence Handle10.1016/S0029-7844(98)00006-4

    Article  Google Scholar 

  6. I Guggenmoos-Holzmann HC Houwelingen Particlevan (2000) ArticleTitleThe (in)validity of sensitivity and specificity. Stat Med 19 1783–1792 Occurrence Handle10.1002/1097-0258(20000715)19:13<1783::AID-SIM497>3.0.CO;2-B Occurrence Handle10861778

    Article  PubMed  Google Scholar 

  7. H Brenner O Gefeller (1997) ArticleTitleVariation of sensitivity, specificity, likelihood ratios and predictive values with disease prevalence Stat Med 16 981–991 Occurrence Handle10.1002/(SICI)1097-0258(19970515)16:9<981::AID-SIM510>3.3.CO;2-E Occurrence Handle9160493

    Article  PubMed  Google Scholar 

  8. PC Prorok (1992) ArticleTitleEpidemiologic approach for cervical cancer screening Problems in designs and analysis of trials. J Pediatr Haematol Oncol 14 117–128

    Google Scholar 

  9. L. Gaffikin S. Ahmed YO Chen et al. (2003) ArticleTitleRisk factors as the basis for triage in low-resource cervical cancer screening programs Int J Gynaecol Obstet 80 41–47 Occurrence Handle10.1016/S0020-7292(02)00373-9 Occurrence Handle12527459

    Article  PubMed  Google Scholar 

  10. W Leinsenring MS Pepe GA Longton (1997) ArticleTitleMarginal regression modeling framework for evaluating medical diagnosis tests Stat Med 16 1263–1281 Occurrence Handle10.1002/(SICI)1097-0258(19970615)16:11<1263::AID-SIM550>3.0.CO;2-M Occurrence Handle9194271

    Article  PubMed  Google Scholar 

  11. DC Slawson JH Bennett JM Herman (1992) ArticleTitleAre Papanicolaou smears enough? Acetic acid washes of the cervix as adjunctive therapy: a HARNET study. Harrisburg Area Research Network J Fam Pract 35 271–277 Occurrence Handle1517723

    PubMed  Google Scholar 

  12. S Cecchini R Bonardi A Mazzotta et al. (1993) ArticleTitleTesting cervicography and cervicoscopy as screening tests for cervical cancer Tumori 79 22–25 Occurrence Handle8497916

    PubMed  Google Scholar 

  13. E Megevand L Denny K. Dehaeck et al. (1996) ArticleTitleAcetic acid visualization of the cervix: an alternative to cytologic screening Obstet Gynecol 88 383–386 Occurrence Handle10.1016/0029-7844(96)00189-5 Occurrence Handle8752244

    Article  PubMed  Google Scholar 

  14. M Londhe SS George L. Seshadri (1997) ArticleTitleDetection of CIN by naked eye visualization after application of acetic acid Ind J Cancer 34 88–91

    Google Scholar 

  15. R Sankaranarayanan R Wesley T. Somanathan et al. (1998) ArticleTitleVisual inspection of the uterine cervix after the application of acetic acid in the detection of cervical carcinoma and its precursors Cancer 83 2150–2156 Occurrence Handle10.1002/(SICI)1097-0142(19981115)83:10<2150::AID-CNCR13>3.0.CO;2-0 Occurrence Handle9827719

    Article  PubMed  Google Scholar 

  16. JHPIEGO Cervical Cancer Project. University of Zimbabwe (1999) Visual inspection with acetic acid for cervical-cancer screening: test qualities in a primary-care setting. Lancet 353: 869–873

    Google Scholar 

  17. R Sankaranarayanan B Shyamalakumary R. Wesley et al. (1999) ArticleTitleVisual inspection with acetic acid in the early detection of cervical cancer and precursors. Int J Cancer 80 161–163 Occurrence Handle10.1002/(SICI)1097-0215(19990105)80:1<161::AID-IJC28>3.0.CO;2-8 Occurrence Handle9935247

    Article  PubMed  Google Scholar 

  18. L Denny L Kuhn A. Pollack et al. (2000) ArticleTitleEvaluation of alternative methods of cervical cancer screening for resource-poor settings Cancer 89 826–833 Occurrence Handle10.1002/1097-0142(20000815)89:4<826::AID-CNCR15>3.0.CO;2-5 Occurrence Handle10951346

    Article  PubMed  Google Scholar 

  19. HS Cronjé BF Cooreman E. Beyer et al. (2001) ArticleTitleScreening for cervical neoplasia in a developing country utilizing cytology, cervicography and the acetic acid test. Int J Gynecol Obstet 72 151–157 Occurrence Handle10.1016/S0020-7292(00)00382-9

    Article  Google Scholar 

  20. JL Belinson RG Pretorius WH Zhang et al. (2001) ArticleTitleCervical cancer screening by simple visual inspection after acetic acid Obstet. Gynecol 98 441–444 Occurrence Handle10.1016/S0029-7844(01)01454-5 Occurrence Handle11530126

    Article  PubMed  Google Scholar 

  21. V Singh A Sehgal A. Parashari et al. (2001) ArticleTitleEarly detection of cervical cancer through acetic acid application – an aided visual inspection Singapore Med J 42 351–354 Occurrence Handle11764051

    PubMed  Google Scholar 

  22. L Denny L Kuhn A. Pollack et al. (2002) ArticleTitleDirect visual inspection for cervical cancer screening: an analysis of factors influencing test performance Cancer 94 1699–1707 Occurrence Handle10.1002/cncr.10381 Occurrence Handle11920531

    Article  PubMed  Google Scholar 

  23. ER Rodriguez-Reyes RM Cerda-Flores JM. Quinonez-Perez et al. (2002) ArticleTitleAcetic acid test: a promising screening test for early detection of cervical cancer Anal Quant Cyto Histo 4 134–136

    Google Scholar 

  24. HS Cronjé GP Parham BF. Cooreman et al. (2003) ArticleTitleA comparison of four screening methods for cervical neoplasia in a developing country Am J Obstet Gynecol 188 395–400 Occurrence Handle10.1067/mob.2003.153 Occurrence Handle12592246

    Article  PubMed  Google Scholar 

  25. CA Ngelangel GM Limson CP Cordero et al. (2003) ArticleTitleAcetic-acid guided visual inspection vs. cytology-based screening for cervical cancer in the Philippines Int J Gyneco Obstet 83 141–150 Occurrence Handle10.1016/S0020-7292(03)00265-0

    Article  Google Scholar 

  26. R Tayyeb NP Khawaja N Malik (2003) ArticleTitleComparison of visual inspection of cervix and Pap smear for cervical cancer screening J Col Physicians Surg Pak 13 201–203

    Google Scholar 

  27. Sankaranarayanan R, Basu P, Wesley RS, et al.(in press) Accuracy of visual screening for cervical neoplasia: results from an IARC multicentre study in India and Africa. Int J Cancer.

Download references

Author information

Authors and Affiliations

  1. Screening Group, International Agency for Research on Cancer (IARC/WHO), 69372, Lyon, France

    Cédric Mahé

  2. JHPIEGO corporation, Baltimore, MD, USA

    Lynne Gaffikin

  3. Evaluation and Research Technologies for Health Inc, Baltimore, MD, USA

    Lynne Gaffikin

Authors
  1. Cédric Mahé
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Lynne Gaffikin
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Cédric Mahé.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Mahé, C., Gaffikin, L. Screening test accuracy studies: how valid are our conclusions? Application to visual inspection methods for cervical screening. Cancer Causes Control 16, 657–666 (2005). https://doi.org/10.1007/s10552-005-0296-4

Download citation

  • Received:

  • Accepted:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10552-005-0296-4

Keywords

Search

Navigation