Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

The p16/ki-67 assay is a safe, effective and rapid approach to triage women with mild cervical lesions

  • Maria Magkana ,

    Roles Conceptualization, Formal analysis, Investigation, Methodology, Visualization, Writing – original draft, Writing – review & editing

    mmagkana@hotmail.com

    Affiliations School of Medicine, National and Kapodistrian University of Athens, Athens, Greece, Department of Cytology, "Alexandra" General Hospital, Athens, Greece

  • Panagiota Mentzelopoulou,

    Roles Project administration, Resources

    Affiliation Department of Cytology, "Alexandra" General Hospital, Athens, Greece

  • Ekaterini Magkana,

    Roles Project administration, Resources

    Affiliation Department of Cytology, "Alexandra" General Hospital, Athens, Greece

  • Andreas Pampanos,

    Roles Project administration, Resources

    Affiliation Department of Genetics, "Alexandra" General Hospital, Athens, Greece

  • Georgios Daskalakis,

    Roles Validation, Visualization

    Affiliation 1st Department of Obstetrics and Gynecology, "Alexandra" Hospital, National and Kapodistrian University of Athens, Athens, Greece

  • Ekaterini Domali,

    Roles Validation, Visualization

    Affiliation 1st Department of Obstetrics and Gynecology, "Alexandra" Hospital, National and Kapodistrian University of Athens, Athens, Greece

  • Alexandros Rodolakis,

    Roles Validation, Visualization

    Affiliation 1st Department of Obstetrics and Gynecology, "Alexandra" Hospital, National and Kapodistrian University of Athens, Athens, Greece

  • Kalliopi Pappa

    Roles Conceptualization, Formal analysis, Methodology, Project administration, Supervision, Visualization, Writing – original draft, Writing – review & editing

    Affiliations 1st Department of Obstetrics and Gynecology, "Alexandra" Hospital, National and Kapodistrian University of Athens, Athens, Greece, Cell and Gene Therapy Laboratory, Centre of Basic Research II, Biomedical Research Foundation of the Academy of Athens (BRFAA), Athens, Greece

Abstract

Objective

The aim of this study was to evaluate the diagnostic accuracy and efficiency of p16/ki-67 dual stain in the identification of CIN2+ lesions, in Greek women with ASCUS or LSIL cytology.

Methods

A total of 200 women, 20 to 60 years old, were enrolled in the study. All samples were cytologically evaluated and performed for p16/ki-67 and high-risk HPV (HR-HPV) test. All patients were referred to colposcopy for biopsy and histological evaluation. Three cervical cancer (CC) screening strategies were designed and the total direct medical costs of the procedures during our clinical trial were evaluated, from a healthcare perspective.

Results

HPV 16 as expected was the most common HR-HPV type followed by HPV 31 and HPV 51. The risk for CIN2+ was significantly higher in HPV 16/18 positive cases. p16/ki-67 demonstrated a high sensitivity for CIN2+ identification in both ASCUS and LSIL groups (90.4% and 95%, respectively). HR-HPV test with sensitivity 52.3% and 65.5%, as well as colposcopy with sensitivity 14.3% and 36% respectively in ASCUS and LSIL group, showed inferior results compared to p16/ki-67. The specificity of p16/ki-67 for ASCUS and LSIL was 97.2% and 95.2% respectively, inferior only to colposcopy: 100% and 100%, lacking however statistical significance. HR-HPV test instead, presented the lowest specificity: 76.4% and 71.4% respectively in comparison to the other two methods. From a healthcare perspective, the costs and benefits of the tests implementation for the annual screening and triaging, in three CC screening strategies, were also calculated and discussed.

Conclusions

The results of the study indicate that p16/ki-67 is a safe and rapid assay that could be used to detect CIN2+ among women with mild cervical lesions, presenting both high sensitivity and specificity and could minimize the psychological and economic burden of HPV screening.

Introduction

Cervical cancer (CC) is the fourth most common malignancy in women globally. It has been established as a great disease model for prolepsis, as it has been significantly reduced during the past decades due to the population-based screening programs and vaccination [1]. The main screening tool for CC has been for many years cytology (Pap test), which contributed to the reduction of the disease in women between 35 to 64 years old, by at least 80% [24]. Nowadays, the American Society for Colposcopy and Cervical Pathology has approved three primary CC screening approaches for women between 21 and 65 years old: the cytology, the high-risk human papillomavirus (HR-HPV) DNA testing and the co-testing (cytology plus HPV testing) [57]. According to many studies, the Pap test has limitations, with the most striking being its low sensitivity [5, 8]. In Greece though, cytology remains still the primary screening tool and the cost is fully covered by the National Health Organization System. However, the population compliance is not sufficient, e.g. CC screening coverage in 2018 was 68.8% [9].

Furthermore, besides the screening approach, triage tests are needed to identify among HPV positive women, those that are at a higher risk and should be referred to colposcopy and further diagnostic evaluation. HPV testing is been proven to be a useful triage tool for minor cytological abnormalities, such as atypical squamous cells of undetermined significance (ASCUS) when we screen women over 30 years old [7, 10].

On the other hand, HPV testing as primary screening presents high sensitivity but low specificity, resulting in an increased number of HPV positive patients who should be referred to colposcopy. That type of management increases the burden in colposcopy clinics and the risk of overtreatment. Thus, an optimal triage strategy which combines both high sensitivity and specificity, is needed to distinct the majority of women at low risk of developing cervical cancer and identify those at a higher risk, who should be referred to colposcopy for further management or treatment [11, 12]. Therefore, some sufficient biomarkers have been proposed such as HPV E6/E7 mRNA test and p16INK4a protein [11, 1316].

The aim of this study was to evaluate the diagnostic ability of p16/ki-67 dual stain in a homogenous Greek population, in order to identify the optimal management strategy of HR-HPV positive women with ASCUS or low-grade squamous intraepithelial lesion (LSIL) cytology as part of an organized cervical cancer screening setting.

Materials and methods

Study population

The present study was conducted in the 1st Department of Obstetrics and Gynecology, "Alexandra" Hospital, National and Kapodistrian University of Athens, in Greece. A total of 200 Greek women aged from 20 to 60 years old with ASCUS/ LSIL cytology, HR-HPV positive and with histological findings CIN≥ 1 (cervical intraepithelial neoplasia), were selected as a subpopulation of a larger study. These women attended the clinic from March 2018 through April 2019 for their routine cytology-based cervical cancer screening and after being thoroughly informed participated in the study. Liquid-based cytology (LBC) samples were collected and after HPV testing and p16/ki-67 dual stain were performed, women were referred to colposcopy for evaluation and cervical biopsies. Three cases were excluded as invalid cytology and one as invalid p16/ki-67 due to low cell count.

The exclusion criteria of the current study were HR-HPV negativity or biopsy result of CIN0, treatment for CIN, prior hysterectomy and pregnancy. Written informed consent, medical history and demographic information were obtained from all the 196 enrolled subjects (Table 1). Medical history involved previous cytology tests, HPV vaccination and other vaginal infections. Demographic variables included: age, sexual and reproductive behavior and smoking status. The study was approved by the Ethics Committee of “Alexandra” Hospital.

thumbnail
Table 1. Demographic variables and health status of our population.

https://doi.org/10.1371/journal.pone.0253045.t001

Cytology—Procedure

Liquid-based cytology samples were stored in PreservCyt solution (Thinprep, Hologic, U.S.A) vials according to the manufacturer’s instructions. A first slide was prepared using Thinprep T2000 processor system (Hologic, U.S.A) for cytological evaluation in accordance to the 2014 Bethesda system [17]. For this study we enrolled cases which presented ASCUS and LSIL cytology. A second slide was used for the p16/ki-67 dual stain (DS) assay. From each Thinprep vial, HPV testing was processed by two methods: Cobas® HPV test and CLART® HPV3 genotyping assay.

HPV testing

Cobas® HPV test.

Qualitative in vitro HPV genotyping analysis was performed using Cobas® HPV test (Roche Molecular Systems, Inc., Branchburg, NJ) which provides individual results for HPV 16 and HPV 18 genotypes and pooled results for the rest 12 HR-HPV types: 31, 33, 35, 39, 45, 51, 52, 56, 58, 59, 66 and 68 in a single analysis. Briefly, target DNA primers amplify a sequence of approximately 200 nucleotides within the L1 region of the HPV genome of the sample with the use of polymerase chain reaction (PCR) to detect the 14 high-risk HPV types [18]. The whole process was performed in the Cobas® 4800 fully automated System.

CLART ® HPV3 assay.

HPV genotyping of the 12 HR-HPV types, that were not evaluated separately with Cobas technology, was performed with the CLART ® HPV3 kit (Genomica S.A.U, Madrid, Spain), an in vitro diagnostic kit that detects 49 HPV genotypes including High Risk (16, 18, 31, 33, 35, 39, 45, 51, 52, 56, 58, 59, 66, 68), Prob. High Risk (26, 53, 73, 82), Low Risk (6, 11, 40, 42, 43, 44, 54, 61, 62, 70, 71, 72, 81, 83, 84, 85, 89) and genotypes of undetermined risk (for research only): 34, 64, 67, 69, 74, 86, 87, 97, 101, 102, 103, 106, 150, 151. Detection is based on CLART® technology which includes PCR amplification of a 450bp fragment within the L1 viral region using type-specific probes. The visualization of the amplified products is performed in a low-density microarray platform and interpreted in an automatic Genomica’s reader (CAR® or Clinical array reader) [19]. For the purposes of the current study, we involved cases positive for the 14 HR-HPV genotypes.

p16/ki-67 dual stain (CINtec® PLUS Cytology kit)

The CINtec® PLUS Cytology Kit is an immunocytochemistry assay for the qualitative detection of p16INK4a and ki-67 proteins in cervical cytology preparations. The proteins are detected using a ready-to-use cocktail of primary monoclonal antibodies: human p16INK4a protein (clone E6H4) and primary recombinant rabbit antibody directed against human ki-67 protein (clone 274–11 AC3) [20]. The slides for p16/ki-67 dual stain were performed using CINtec® PLUS kit (Roche mtm laboratories AG, Mannheim, Germany) on an automated slide-stainer platform: Ventana BenchMark XT Slide Stainer.

All slides were evaluated by two experienced cytopathologists unaware of histology and HPV testing results. A case was interpreted as positive if one or more cervical epithelial cells were dual stained for both p16INK4a (brown cytoplasmic stain) and ki-67 (red nuclear stain) regardless of their morphologic appearance. Negativity was established when no synchronous p16/ki-67 dual staining in the same cell was observed, in accordance to the manufacturer’s criteria and instructions [21]. In Fig 1A and 1B below, examples of p16/ki-67 dual stained cells in cases of ASCUS and LSIL cytology are presented. A case was excluded or scored as invalid if no p16 INK4a and/or ki-67staining was visible or if there were less than 5,000 squamous cells in the slide [21].

p16/ki-67 dual-stained examples (×40 magnification) in cases of (A) atypical squamous cells of undetermined significance (ASCUS), (B) low-grade squamous intraepithelial lesion (LSIL) cytology. Positive p16/ki-67 dual-stained cells with a brown cytoplasmic stain for p16INK4a overexpression and a dark red nuclear stain for ki-67 expression within the same cell (red arrow); unaffected cervical epithelial cells without p16/ki-67 staining (black arrow).

Colposcopy and histology

The population enrolled in our study, underwent colposcopic evaluation of the cervix and the colposcopic findings were reported according to the ASCCP Terminology for Colposcopic Practice [22]. If no visible lesion was found, the colposcopic impression was classified as ‘Negative’, whereas positivity was then reported as ‘LSIL’ (low-grade abnormalities) or ‘HSIL’ (high-grade abnormalities). Biopsy from visible cervical lesions was performed by qualified, trained physicians. Histopathologic review of the cervical biopsies was performed from specialized pathologists blinded to all laboratory results. Cervical histopathological diagnoses included CIN≥ 1 (CIN1, CIN2, CIN3, or cancer).

Screening strategies and costs data

We designed and evaluated three different CC screening strategies based on the current algorithms used: Cytology (LBC), HPV test with 16/18 genotyping, Co-testing (Cytology & HPV test with 16/18 genotyping) with the addition of p16/ki-67 dual stain as a triage strategy.

The costs of the lab-tests for screening (Cytology, HPV test with 16/18 genotyping, p16/ki-67 dual stain) and the diagnostic methods (Colposcopy, Cervical biopsy and office visit to specialist) presented in Table 2 below were evaluated from a healthcare perspective, in Public Healthcare System or Private Practice. In Public Healthcare System, cost inputs were obtained in 2019, from the official price list of the National Organization for the Provision of Health Services (EOPYY) in Greece. In the Private sector, costs were based on 2019 price lists of two different Private Hospitals in Greece (Private Practice 1&2) and the average costs were evaluated. In Public Healthcare System, the cost of p16/ki-67 dual stain would be covered by the healthcare system when used in practice. Therefore, its cost was assumed to be the same as the Private Practice’s price.

thumbnail
Table 2. Costs of the lab-tests and diagnostic methods for HPV screening.

https://doi.org/10.1371/journal.pone.0253045.t002

In each CC screening strategy we included the direct medical costs of the procedures per screened woman from a healthcare perspective. Specifically, direct medical costs consist of screening tests used (Cytology, HPV test with 16/18 genotyping, p16/ki-67) and diagnostic methods (Colposcopy and Cervical biopsy) plus office visit (physician’s time for patient’s evaluation). The costs for the annual follow-up screening tests as well as any treatment needed for CIN were not included.

First strategy: Cytology as primary screening test (Fig 2).

thumbnail
Fig 2. First strategy: Cytology as primary screening test.

Triage with a) HPV test with 16/18 genotyping and b) p16/ki-67 dual stain. Cytology, LBC; Costs in Euros (€), direct medical costs (screening tests, colposcopy with biopsy and office visit) per woman screened; costs for annual follow-ups and treatments for CIN were not included. *Colposcopy with biopsy.

https://doi.org/10.1371/journal.pone.0253045.g002

Women with Normal cytology return to Routine Screening.

Women with Cytology ≥ ASCUS:

  1. a) Triage with HPV 16/18 genotyping.
  2. Women with HR-HPV test (-) return to Routine Screening, those with HPV16/18(+) are referred to colposcopy, whereas women with HR-HPV test (+) & HPV16/18(-) repeat cytology in one year.
  3. b) Triage with p16/ki-67 dual stain.
  4. Women with p16/ki-67(+) results are referred to colposcopy while those with p16/ki-67(-) repeat cytology in one year.

Second strategy: HPV test as primary screening test (Fig 3).

thumbnail
Fig 3. Second strategy: HPV test as primary screening test with 16/18 genotyping.

Triage with a) Cytology b) p16/ki-67dual stain. Cytology, LBC; Costs in Euros (€), direct medical costs (screening tests, colposcopy with biopsy and office visit) per woman screened; costs for annual follow-ups and treatments for CIN were not included. *Colposcopy with biopsy.

https://doi.org/10.1371/journal.pone.0253045.g003

Women with HR-HPV test (-) return to Routine Screening.

Women with HR-HPV test (+):

  1. a) Triage with cytology.
  2. Women with HR-HPV test (+) & HPV16/18(-) with cytology < ASCUS, repeat cytology in one year.
  3. Women with an HR-HPV test (+) and cytology ≥ ASCUS are referred to colposcopy.
  4. b) Triage with p16/ki-67.
  5. Women with p16/ki-67(+) are referred to colposcopy, while those with p16/ki-67(-) are re-tested with HPV 16/18 genotyping in one year.

Third strategy: Co-testing (Cytology & HPV test with 16/18 genotyping) as primary screening (Fig 4).

thumbnail
Fig 4. Third strategy: Co-testing as primary screening.

Triage with p16/ki-67 dual stain. Cytology, LBC; Costs in Euros (€), direct medical costs (screening tests, colposcopy with biopsy and office visit) per woman screened; costs for annual follow-ups and treatments for CIN were not included. *Colposcopy with biopsy.

https://doi.org/10.1371/journal.pone.0253045.g004

Women with Cytology <ASCUS and HR-HPV test (-) return to Routine Screening.

Women with Cytology ≥ ASCUS and HR-HPV test (+) are triaged with p16/ki-67 dual stain. When p16/ki-67(+) the patients are referred to colposcopy and those with p16/ki-67(-) repeat co-testing in one year.

Statistical analysis

Data were expressed as mean ± SD for continuous variables and as percentages for categorical data. The Kolmogorov—Smirnov test was utilized for normality analysis of the parameters. To evaluate the risk of CIN2+ lesions, according to HPV genotype, the Chi-square test (χ2) and Odds Ratio (O.R.) with 95% Confidence Interval (CI) were calculated. Diagnostic accuracies of HR-HPV test, Colposcopy and p16/ki-67 method for the detection of CIN2+ were evaluated using Sensitivity, Specificity, Positive Predictive Value (PPV) and Negative Predictive Value (NPV). Comparison between them was performed using the Paired Samples t-test. A Receiver Operating Curve (ROC) analysis was conducted to compare the prognostic abilities of HR-HPV test and p16/ki-67 for the detection of CIN2+ calculating the respective areas under the curve (AUC) with 95% CI, using the maximum likelihood estimation method, which has the advantage of being free of assumption about the Gaussian distribution of underlying variables. All tests were two-sided and statistical significance was set at p < 0.05. All statistical analyses were conducted using SPSS vr 21.00 (IBM Corporation, Somers, NY, USA).

Results

A total of 200 liquid-based cytology samples with CIN ≥ 1 on histological evaluation and HR-HPV (+) were analyzed. Among those, 93 cases had ASCUS cytology, 103 had LSIL and 4 cases were excluded as invalid due to low cellularity. The mean age of all 196 finally enrolled women was 37.5 years old, with participants < 30 years old (27%) and ≥ 30 years old (73%). Only a small percent (12.8%) of the women were HPV vaccinated, the majority (90.8%) had a pap test performed during the previous years and 26.0% had other vaginal infections. Most women (91.8%) had over 2 sexual partners during their lifetime and approximately half the population was nulliparous. Smoking habits of our population were equally distributed (Table 1).

All patients were selected to be HR-HPV positive and the HR-HPV test results were classified as HPV 16/18 (+) or HPV 16/18 (-) when no HPV 16 or HPV 18 was detected. In our population, 80/196 (40.8%) cases were HPV 16/18 positive and 116/196 (59.2%) had some other of the 12 HR-HPV types. In cases of multiple infections, patients were classified according to the highest risk type for its constituents. For example, if a case distributed both HPV 16 (+) and HPV 31 (+), it was then classified into the HPV 16/18 (+) group. The percentages of HR-HPV genotypes in our study are presented in Fig 5.

thumbnail
Fig 5. HR-HPV genotypes distribution in the study population.

The bars represent a single or multiple type infection, whilst in multiple types the case is classified according to the highest risk type for its constituents.

https://doi.org/10.1371/journal.pone.0253045.g005

HPV 16 was the most frequent high-risk type in 66 out of 196 cases (33.7%) followed by HPV 31 (17.3%) and HPV 51 (13.8%). The HPV 56, HPV 58 and HPV 66 distributed similar percentages (11.2%–11.7%), followed by HPV 18 (8.7%). The HPV 52 and HPV 59 presented a percentage of 7.7% and the rest HR-HPV types: 33, 35, 39, 45, 68 presented lower frequencies.

In order to evaluate the risk of CIN2+ according to HPV genotype, patients were sorted into fourteen groups depending on HR-HPV genotype’s positivity as shown in Table 3. Among patients with HPV16 (+) or HPV18 (+), either with single or multiple infections, the odds ratio for CIN2+ lesions were 3.2 (95% CI 1.74–6.00) and 5.2 (95% CI 1.62–16.53) respectively. These results are statistically significant higher compared with the odds ratio of the rest 12 HR-HPV genotypes.

thumbnail
Table 3. Odds ratio for CIN2+ histological diagnosis for each HR-HPV genotype.

https://doi.org/10.1371/journal.pone.0253045.t003

Among the 93 ASCUS samples presented in Table 4, 28 were HPV 16/18 positive with 11/28 (39.3%) CIN2+ and 17/28 (60.7%) CIN1. All ASCUS cases were additionally tested for p16/ki-67 dual staining and 21 cases were p16/ki-67 positive of which 19 (90.5%) were histological CIN2+.

thumbnail
Table 4. Correlation of HPV 16/18, p16/ki-67, colposcopy and combination of HPV 16/18/ p16/ki-67 with biopsy results in our population study.

https://doi.org/10.1371/journal.pone.0253045.t004

The performance of the combination of the two assays in identifying CIN2+ cases in ASCUS group was 2/55 (3.6%) when HPV16/18(-)/ p16/ki-67(-), 8/10 (80%) when HPV 16/18(-)/p16/ki-67(+), 0/17 (0%) when HPV 16/18(+)/p16/ki-67(-) and 11/11 (100%) when HPV 16/18(+)/p16/ki-67(+) as shown in Table 4. Further, we compared the colposcopy impression with the pathology report in the ASCUS group and we found that 3 out of 17 (17.6%) CIN2+ cases were evaluated as “Negative”, 15/73 (20.5%) CIN2+ cases as “LSIL” and 3/3 (100%) CIN2+ cases as “HSIL”.

Regarding the LSIL cytology group as shown in Table 4, a total of 52 out of 103 cases were HPV 16/18 positive, of which 40/52 (76.9%) were histologically diagnosed as CIN2+. Concerning the p16/ki-67 method, 60/103 were p16/ki-67 positive of which 58/60 (96.7%) were CIN2+. The performance of the combination of the two assays in identifying CIN2+ cases in the LSIL group as shown in Table 4, was 0/28 (0%) when HPV 16/18(-)/p16/ki-67(-), in 21/23 (91.3%) when HPV 16/18(-)/p16/ki-67(+), 3/15 (20%) when HPV 16/18(+)/p16/ki-67(-) and 37/37 (100%) when HPV 16/18(+)/p16/ki-67(+). Similarly, we compared the colposcopy impression with the pathology report in the LSIL group and we found that 1 out of 7 (14.3%) CIN2+ cases was evaluated as “Negative”, 38/74 (51.4%) as “LSIL” and 22/22 (100%) as “HSIL”.

The diagnostic accuracy of each test for the detection of CIN2+ is presented in Table 5. Dual stain (p16/ki-67) demonstrated superior sensitivity for both cytology groups (ASCUS and LSIL), 90.4% (95% CI 68–98) and 95% (95% CI 85–99) respectively compared to HR-HPV test and Colposcopy. Particularly, the HR-HPV test’s sensitivity was 52.3% (95% CI 30–74) and 65.5% (95% CI 52–77) for the ASCUS and LSIL cytology groups respectively and the Colposcopy’s sensitivity was 14.3% (95% CI 4–37) and 36% (95% CI 24–49) respectively. The p16/ki-67 specificity was 97.2% (95% CI 89–99) and 95.2% (95% CI 83–99) for the ASCUS and LSIL groups, respectively inferior only to colposcopy which showed a specificity of 100% (95% CI 94–100) and 100% (95% CI 89–100), lacking however statistical significance. The HR-HPV test presented the lowest values: 76.4% (95% CI 65–85) and 71.4% (95% CI 55–84) for the ASCUS and LSIL respectively.

thumbnail
Table 5. Diagnostic ability of HR-HPV test, colposcopy & p16/ki-67 for the detection of CIN2+.

https://doi.org/10.1371/journal.pone.0253045.t005

The p16/ki-67 Positive Predictive value (PPV) and Negative Predictive Value (NPV), in the ASCUS group were: 90.4% (95% CI 68–98) and 97.2% (95% CI 89–99) as indicated in Table 5. Compared to Colposcopy, the latter with a PPV: 100% (95% CI 31–100) showed a better score but presented lower NPV: 80% (95% CI 70–87). HR-HPV test presented the lowest PPV: 39.2% (95% CI 22–60) and NPV: 84.6% (95% CI 73–92). Similarly, in the LSIL group, p16/ki-67 showed a PPV of 96.6% (95% CI 87–99) and a NPV of 93% (95% CI 80–98). The colposcopy showed higher PPV:100% (95% CI 81–100) but lower NPV:52% (95% CI 41–63). The HR-HPV test presented the lowest PPV 76.9% (95% CI 63–87) and NPV 58.8% (95% CI 44–72) in comparison to the other two methods.

The ROC curve analysis of the two methods, HR-HPV test and p16/ki-67, is shown in Fig 6. For the ASCUS group the areas under the curve (AUC) for the HR-HPV test and p16/ki-67 were 0.644 (95% CI 0.503–0.784) and 0.938 (95% CI 0.862–1.000) and for the LSIL group, the AUC of HR-HPV test and p16/ki-67 were 0.685 (95% CI 0.580–0.790) and 0.952 (95% CI 0.903–1.000) respectively.

thumbnail
Fig 6. Evaluation of the two methods, HR-HPV test and p16/ki-67 by ROC curve analysis.

https://doi.org/10.1371/journal.pone.0253045.g006

In order to evaluate the costs of the three different proposed CC screening strategies (Figs 24) we estimated, from a healthcare perspective, either in Public Healthcare System or in Private Practice, the total direct medical costs of the procedures during our clinical trial. The total direct medical costs (screening tests and diagnostic methods plus physician’s time during office visit) for our population were calculated as the number of cases in each of the three different screening strategies multiplied by the direct medical costs per case (Table 6). The calculations presented in Table 6 were conducted using the data of the costs in Table 2 and the resource use from the clinical data of our population in Table 4.

thumbnail
Table 6. Total direct medical costs, from a healthcare perspective, of the three screening strategies.

https://doi.org/10.1371/journal.pone.0253045.t006

Regarding the 1st Cytology screening strategy (Fig 2), when triaging with a) HPV test plus 16/18 genotyping the total direct medical costs in our study population would be €21.389,92 in Public Healthcare System and €83.020,00 in Private Practice, whereas with b) p16/ki-67 dual stain triage the costs would be €17.508,66 and €68.022,50 respectively. Concerning the 2nd HPV test screening strategy approach (Fig 3), we calculated that by using a) cytology triage, the direct medical costs for Public Healthcare System and Private Practice would be €25.883,76 and €105.350,00 respectively, while with the b) p16/ki-67 triage test, the total direct costs were estimated as €30.577,94 and €83.702,50. Finally, the total direct medical costs for the 3rd Co-testing (Cytology & HPV test with 16/18 genotyping) screening strategy and triaging with p16/ki-67 dual stain (Fig 4) were €33.188,66 for the Public Healthcare System and €94.972,50 for the Private Practice.

Discussion

In the present study, we evaluated the clinical performance of p16/ki-67 in comparison to the existing strategy, i.e. HPV testing with colposcopy referrals in a group of Greek population with ASCUS and LSIL cytology. These methods are already applied in the primary screening in most organized health care systems worldwide [5, 7].

Although HPV DNA test appears to be highly sensitive in multiple studies for the detection of precancerous lesions, it lacks specificity. This leads to the detection of a large number of HPV positive women, who are referred to unnecessary colposcopies since HPV DNA test cannot discriminate an active/persistent infection from a transient one [23].

The p16INK4a protein is a cyclin-dependent kinase (CDK) inhibitor that plays an important role in cell cycle regulation. The over expression of E7 oncoprotein, in persistent HR-HPV infections, leads to p16INK4a upregulation which might serve as a biomarker for the detection of cervical precancerous lesions [24, 25]. ki-67 is another marker which is strictly associated with cell proliferation and is expressed normally during cell mitosis [26]. The co-expression of p16 INK4a and ki-67 in the same cell, does not physically exist in normal cells and this co-expression is considered a valuable marker for cell-cycle deregulation and cell transformation due to HPV infection [27]. Therefore, a positive p16/ki-67 result could indicate a higher-grade dysplasia on the cervix and provide information about CIN2+ lesions [28, 29].

In our study, besides p16/ki-67, we classified HPV positive patients into two categories, as HPV 16/18 (+) and HPV 16/18 (-) according to algorithms for primary HPV screening [30]. In concordance with the well documented bibliography facts, our results show that HPV 16/18 are the most prevalent types for developing CIN2 or higher lesions, in comparison to the other HR-HPV types [3133].

We also identified the distribution of the 14 HR- HPV types in our Greek population. Briefly, our results are fully consistent with previous studies in Greece, where HPV 16 is the most prevalent type followed by HPV 31 and HPV 51 [3436]. This observation shows that the distribution of HR-HPV genotypes kept the same pattern despite the population habit alterations and mixed-race interaction due to refugee’s immigration in the country over these years.

In order to evaluate the accuracy of the methods, we compared the p16/ki-67 dual stain with the HPV testing and colposcopy, which are currently proposed by the screening guidelines. In our study, the results showed that p16/ki-67 method had both high sensitivity and specificity as triage test, both in the two cytology groups (ASCUS/LSIL), improving the diagnosis of CIN2+ lesions.

Among women with ASCUS and LSIL, sensitivities of p16/ki-67 dual stain were 90.4% and 95.0% respectively, higher than that of the HR-HPV test (52.3% and 65.5%). Previous studies have shown that p16/ki-67 can be a reliable tool for risk stratification of HPV positive women with mild cervical lesions, reporting high sensitivity values similar to that of HPV test [27, 3740].

In both ASCUS and LSIL cases, p16/ki-67 showed higher specificity for CIN2+ diagnosis, 97.2% and 95.2% respectively, while no statistical significance was identified when compared to the HPV test (76.4% and 71.4%). Previous studies have shown that p16/ki-67 had higher specificity compared to HPV testing [28, 3740]. Our data indicated that p16/ki-67 in both cytology groups, had higher PPV: (90.4% / 96.6%) and NPV: (97.2% / 93%), statistically significant compared to HPV test (PPV: 39.2%/ 76.9%, NPV: 84.6% / 58.8%) in accordance to previous studies [27, 3740].

In our National Health Care System, colposcopy is widely used to detect cervical lesions and biopsy under colposcopy guidance, confirms or excludes CIN2+ lesions. We retrospectively collected colposcopy reports of the population we studied in our Department of Obstetrics & Gynecology which is a referral Department for gynecological cancer. We compared these reports to the histological findings, in order to evaluate the prognostic accuracy of colposcopy.

We observed that in ASCUS and LSIL cases, 38.1% and 65.7% respectively of the histologically confirmed CIN2+ were underestimated by colposcopy and defined as “Negative” or “LSIL”. Whereas, the p16/ki-67 depicted more CIN2+ cases among the two groups (ASCUS: 90.5%, LSIL: 96.7%) and showed clearly higher sensitivity (ASCUS: 90.4%, LSIL: 95%) than Colposcopy (ASCUS: 14.3%, LSIL: 36%) (p> 0.005). On the other hand, there was no statistical significance in specificity between p16/ki-67 and colposcopy impression (95–100%).

There are many factors that could explain this observation such as, training and experience of the clinicians involved, inadequate colposcopy due to lack of objective criteria to classify the lesions macroscopically and co-existing pathologies which tamper with the appearance of the normal mucosa.

Furthermore, we presented the ROC curve to show the diagnostic performance of p16/ki-67 and HPV test. The AUC of p16/ki-67 was greater in both cytology groups (0.938/0.952) compared to the HPV test (0.644/0.685). These results are comparable to those of a recent study were AUC of p16/ki-67 dual stain was (0.778), also significantly higher than that of HPV test (0.503) [41].

Additionally, in both cytology groups, we evaluated the combination of the two methods, HR-HPV test with 16/18 genotyping and p16/ki-67, in order to identify how many cases of CIN2+ will be missed. In the LSIL cases, when HPV16/18 and p16/ki-67 were both positive or negative, no women were misdiagnosed. In case of conflicting results between HPV16/18 and p16/ki-67, taking into consideration the p16/ki-67 positivity alone, we were able to diagnose 91.3% of women with CIN2+ that would otherwise escape diagnosis and only 8.7% were missed. On the other hand, we observed that if only HPV 16/18 was positive we could detect only 20% of CIN2+ and the rest were missed.

Looking into the ASCUS cases, when both HPV16/18 and p16/ki-67 were negative, 3.6% of women with CIN2+ were missed, whereas when HPV 16/18 (+)/p16/ki-67 (+) all CIN2+ were diagnosed. In case of conflicting results between the two tests, when only p16/ki-67 was positive, 80% of women with CIN2+ were accurately diagnosed. Finally, in HPV 16/18 (+)/p16/ki-67(-) cases, no CIN2+ were missed.

Our study showed that p16/ki-67 presented both high sensitivity and specificity values, with only a few CIN2+ being missed. Thus, it appears to be an excellent triage tool for accurate stratification of women with mild cervical lesions. Our results are in line with other articles where the effectiveness of the screening strategies may be improved by the addition of p16/ki-67 dual stain in the triage [42, 43].

Regarding the analysis of the total direct medical costs of the three different CC screening scenarios, from a healthcare perspective, in our clinical trial, in the 1st strategy, Cytology primary screening, the utilization of p16/ki-67 as an optional triage tool has reduced the costs by €3.881,26 in the Public Healthcare System and by €14.997,50 in Private Practice compared to HPV test triage. Additionally, a cost reduction of €21.647,50 in Private Practice was reported in the HPV test-based screening scenario by adapting dual stain in the triage, whereas an elevation of €4.694,18 was shown in the Public Healthcare System in comparison to cytology triage. Finally, the costs for the Co-testing screening strategy were proved to be the highest among all screening scenarios.

It seems that the model Cytology as primary screening strategy and triage with p16/ki-67 dual stain may not only have high clinical and diagnostic impact, avoiding over-diagnosis and over-treatment, but also budgetary impact lowering annual costs for screening and seems to be the most realistic and safe scenario for CC screening.

As for the limitations of our study, the number of cases was small, as well as the fact that the follow-up of the women enrolled was not evaluated and is yet to be accomplished. Further evaluation of the follow-up is necessary to examine the application of the p16/ki-67 biomarker in triaging women with mild cervical lesions, as shown in many previous scientific studies. The role of p16/ki-67 negativity in combination with HR-HPV positivity remains to be fully interpreted and understood.

Summarizing our results, p16/ki-67 dual stain presented both higher sensitivity and specificity, providing good clinical outcomes, while lowering the annual direct medical costs of CC screening. Cytology in combination with p16/ki-67 dual stain is a powerful, safe and affordable tool to triage women with mild cervical lesions, especially in low- and middle-income countries where accurate but also budgetary adaptations of health care services are required.

Acknowledgments

The authors would like to thank Gerou Spyridon, Spyrakis Georgios and the staff of Analysis Medical S.A, Greece for performing the COBAS assays of our clinical samples.

References

  1. 1. Ferlay J, Soerjomataram I, Dikshit R, Eser S, Mathers C, Rebelo M, et al. Cancer incidence and mortality worldwide: sources, methods and major patterns in GLOBOCAN 2012. Int J Cancer. 2015; 136(5): E359–86. pmid:25220842
  2. 2. Franceschi S. The IARC commitment to cancer prevention: the example of papillomavirus and cervical cancer. Recent Results Cancer Res. 2005; 166:277–97. pmid:15648196
  3. 3. International Agency for Research on Cancer. IARC Handbooks of Cancer Prevention: Cervix Cancer Screening. Vol. 10. Lyon, France: IARC Press; 2005.
  4. 4. Elfström KM, Arnheim-Dahlström L, von Karsa L, Dillner J. Cervical cancer screening in Europe: Quality assurance and organisation of programmes. Eur J Cancer. 2015;51(8):950–68. pmid:25817010
  5. 5. Saslow D, Solomon D, Lawson HW, Killackey M, Kulasingam SL, Cain J, et al. American Cancer Society, American Society for Colposcopy and Cervical Pathology, and American Society for Clinical Pathology screening guidelines for the prevention and early detection of cervical cancer. CA Cancer J Clin. 2012; 62(3):147–72. pmid:22422631
  6. 6. von Karsa L, Arbyn M, De Vuyst H, Dillner J, Dillner L, Franceschi S, et al. European guidelines for quality assurance in cervical cancer screening. Summary of the supplements on HPV screening and vaccination. Papillomavirus Research. 2015;1:22–31. Available from: https://doi.org/10.1016/j.pvr.2015.06.006
  7. 7. Practice Bulletin No. 140: management of abnormal cervical cancer screening test results and cervical cancer precursors. Obstet Gynecol. 2013; 122(6):1338–67. pmid:24264713
  8. 8. Safaeian M, Solomon D, Castle PE. Cervical cancer prevention—cervical screening: science in evolution. Obstet Gynecol Clin North Am. 2007; 34(4):739–60, ix. pmid:18061867
  9. 9. ICO/IARC Information Centre on HPV and Cancer: Greece. Human Papillomavirus and Related Cancers, Fact Sheet 2018. https://hpvcentre.net/statistics/reports/GRC_FS.pdf?t=1586602338630
  10. 10. Wright TC, Stoler MH, Behrens CM, Sharma A, Zhang G, Wright TL. Primary cervical cancer screening with human papillomavirus: end of study results from the ATHENA study using HPV as the first-line screening test. Gynecol Oncol. 2015; 136(2):189–97. pmid:25579108
  11. 11. Ebisch RM, Siebers AG, Bosgraaf RP, Massuger LF, Bekkers RL, Melchers WJ. Triage of high-risk HPV positive women in cervical cancer screening. Expert Rev Anticancer Ther. 2016; 16(10):1073–85. pmid:27598683
  12. 12. Massad LS, Einstein MH, Huh WK, Katki HA, Kinney WK, Schiffman M, et al. 2012 updated consensus guidelines for the management of abnormal cervical cancer screening tests and cancer precursors. Obstet Gynecol. 2013; 121(4):829–46. pmid:23635684
  13. 13. Bergeron C, Ronco G, Reuschenbach M, Wentzensen N, Arbyn M, Stoler M, et al. The clinical impact of using p16(INK4a) immunochemistry in cervical histopathology and cytology: an update of recent developments. Int J Cancer. 2015;136(12):2741–51. pmid:24740700
  14. 14. Wentzensen N, Fetterman B, Castle PE, Schiffman M, Wood SN, Stiemerling E, et al. p16/Ki-67 Dual Stain Cytology for Detection of Cervical Precancer in HPV-Positive Women. J Natl Cancer Inst. 2015; 107(12): djv257. pmid:26376685
  15. 15. Cattani P, Zannoni GF, Ricci C, D’Onghia S, Trivellizzi IN, Di Franco A, et al. Clinical performance of human papillomavirus E6 and E7 mRNA testing for high-grade lesions of the cervix. J Clin Microbiol. 2009; 47(12):3895–901. pmid:19828739
  16. 16. Castle PE, Dockter J, Giachetti C, Garcia FA, McCormick MK, Mitchell AL, et al. A cross-sectional study of a prototype carcinogenic human papillomavirus E6/E7 messenger RNA assay for detection of cervical precancer and cancer. Clin Cancer Res. 2007;13(9):2599–605. pmid:17473189
  17. 17. Nayar R, Wilbur D. The Bethesda System for Reporting Cervical Cytology. 3rd ed. Cham: Springer International Publishing; 2015.
  18. 18. Cobas® HPV Test [package insert]. Branchburg, NJ: Roche Molecular Systems Inc; 2016.
  19. 19. Clart® HPV3 [package insert]. Madrid, Spain: Genomica SAU; 2018.
  20. 20. CINtec® PLUS Cytology Kit [package insert]. Mannheim, Germany: Roche mtm laboratories AG; 2016.
  21. 21. CINtec® PLUS Cytology Kit [interpretation guide]. Mannheim, Germany: Roche mtm laboratories AG; 2016.
  22. 22. Wentzensen N, Massad LS, Mayeaux EJ Jr, Khan MJ, Waxman AG, Einstein MH, et al. Evidence-Based Consensus Recommendations for Colposcopy Practice for Cervical Cancer Prevention in the United States. J Low Genit Tract Dis. 2017; 21(4):216–222. pmid:28953109
  23. 23. Yu LL, Guo HQ, Lei XQ, Qin Y, Wu ZN, Kang LN, et al. p16/Ki-67 co-expression associates high risk human papillomavirus persistence and cervical histopathology: a 3-year cohort study in China. Oncotarget. 2016; 7(40):64810–9. pmid:27588487
  24. 24. Kalof AN, Cooper K. p16INK4a immunoexpression: surrogate marker of high-risk HPV and high-grade cervical intraepithelial neoplasia. Adv Anat Pathol. 2006; 13(4):190–4. pmid:16858153
  25. 25. Trunk MJ, Dallenbach-Hellweg G, Ridder R, Petry KU, Ikenberg H, Schneider V, et al. Morphologic characteristics of p16INK4a-positive cells in cervical cytology samples. Acta Cytol. 2004; 48(6):771–82. pmid:15581161
  26. 26. Kruse AJ, Baak JP, de Bruin PC, Jiwa M, Snijders WP, Boodt PJ, et al. Ki-67 immunoquantitation in cervical intraepithelial neoplasia (CIN): a sensitive marker for grading. J Pathol. 2001; 193(1):48–54. pmid:11169515
  27. 27. Petry KU, Schmidt D, Scherbring S, Luyten A, Reinecke-Lüthge A, Bergeron C, et al. Triaging Pap cytology negative, HPV positive cervical cancer screening results with p16/Ki-67 Dual-stained cytology. Gynecol Oncol. 2011; 121(3):505–9. pmid:21420158
  28. 28. Schmidt D, Bergeron C, Denton KJ, Ridder R, Caraceni D, Ghiringhello B, et al. p16/ki-67 dual-stain cytology in the triage of ASCUS and LSIL papanicolaou cytology: results from the European equivocal or mildly abnormal Papanicolaou cytology study. Cancer Cytopathol. 2011; 119(3):158–66. pmid:21442767
  29. 29. Bergeron C, Ikenberg H, Sideri M, Denton K, Bogers J, Schmidt D, et al. Prospective evaluation of p16/Ki-67 dual-stained cytology for managing women with abnormal Papanicolaou cytology: PALMS study results. Cancer Cytopathol. 2015; 123(6):373–81. pmid:25891096
  30. 30. Wentzensen N, Schiffman M, Palmer T, Arbyn M. Triage of HPV positive women in cervical cancer screening. J Clin Virol. 2016; 76 Suppl 1: S49–S55. pmid:26643050
  31. 31. Agorastos T, Chatzistamatiou K, Katsamagkas T, Koliopoulos G, Daponte A, Constantinidis T, et al. Primary screening for cervical cancer based on high-risk human papillomavirus (HPV) detection and HPV 16 and HPV 18 genotyping, in comparison to cytology. PLoS One. 2015; 10(3): e0119755. pmid:25793281
  32. 32. McKenna M, McMenamin M, McDowell A. HPV16 and HPV18 genotyping triage in young women with borderline cytology or mild dyskaryosis: effect of age on genotype-specific risk of high-grade CIN. Cytopathology. 2016; 27(4):261–8. pmid:26873051
  33. 33. Khan MJ, Castle PE, Lorincz AT, Wacholder S, Sherman M, Scott DR, et al. The elevated 10-year risk of cervical precancer and cancer in women with human papillomavirus (HPV) type 16 or 18 and the possible utility of type-specific HPV testing in clinical practice. J Natl Cancer Inst. 2005; 97(14):1072–9. pmid:16030305
  34. 34. Argyri E, Tsimplaki E, Papatheodorou D, Daskalopoulou D, Panotopoulou E. Recent Trends in HPV Infection and Type Distribution in Greece. Anticancer Res. 2018; 38(5):3079–84. pmid:29715143
  35. 35. Argyri E, Papaspyridakos S, Tsimplaki E, Michala L, Myriokefalitaki E, Papassideri I, et al. A cross sectional study of HPV type prevalence according to age and cytology. BMC Infect Dis. 2013; 13:53. pmid:23363541
  36. 36. Agorastos T, Lambropoulos AF, Sotiriadis A, Mikos T, Togaridou E, Emmanouilides CJ. Prevalence and distribution of high-risk human papillomavirus in Greece. Eur J Cancer Prev. 2009; 18(6):504–9. pmid:19741545
  37. 37. Wentzensen N, Schwartz L, Zuna RE, Smith K, Mathews C, Gold MA, et al. Performance of p16/Ki-67 immunostaining to detect cervical cancer precursors in a colposcopy referral population. Clin Cancer Res. 2012; 18(15):4154–62. pmid:22675168
  38. 38. Yu LL, Chen W, Lei XQ, Qin Y, Wu ZN, Pan QJ, et al. Evaluation of p16/Ki-67 dual staining in detection of cervical precancer and cancers: a multicenter study in China. Oncotarget. 2016; 7(16):21181–9. pmid:27029033
  39. 39. Tay TKY, Lim KL, Hilmy MH, Thike AA, Goh ST, Song LH, et al. Comparison of the sensitivity and specificity of p16/Ki-67 dual staining and HPV DNA testing of abnormal cervical cytology in the detection of histology proven cervical intraepithelial neoplasia grade 2 and above (CIN 2+). Malays J Pathol. 2017; 39(3):257–65. pmid:29279588
  40. 40. Possati-Resende JC, Fregnani JH, Kerr LM, Mauad EC, Longatto-Filho A, Scapulatempo-Neto C. The Accuracy of p16/Ki-67 and HPV Test in the Detection of CIN2/3 in Women Diagnosed with ASC-US or LSIL. PLoS One. 2015; 10(7):e0134445. pmid:26230097
  41. 41. Zhang R, Ge X, You K, Guo Y, Guo H, Wang Y, et al. p16/Ki67 dual staining improves the detection specificity of high-grade cervical lesions. J Obstet Gynaecol Res. 2018; 44(11):2077–84. pmid:30094887
  42. 42. Petry KU, Barth C, Wasem J, Neumann A. A model to evaluate the costs and clinical effectiveness of human papilloma virus screening compared with annual papanicolaou cytology in Germany. Eur J Obstet Gynecol Reprod Biol. 2017; 212:132–9. pmid:28363186
  43. 43. Termrungruanglert W, Khemapech N, Tantitamit T, Havanond P. Cost effectiveness analysis of HPV primary screening and dual stain cytology triage compared with cervical cytology. J Gynecol Oncol. 2019; 30(2): e17. pmid:30740950