Skip to main content

Developing and validating a risk algorithm to diagnose Neisseria gonorrhoeae and Chlamydia trachomatis in symptomatic Rwandan women

Abstract

Background

Algorithms that bridge the gap between syndromic sexually transmitted infection (STI) management and treatment based in realistic diagnostic options and local epidemiology are urgently needed across Africa. Our objective was to develop and validate a risk algorithm for Neisseria gonorrhoeae (NG) and Chlamydia trachomatis (CT) diagnosis among symptomatic Rwandan women and to compare risk algorithm performance to the current Rwandan National Criteria for NG/CT diagnosis.

Methods

The risk algorithm was derived in a cohort (n = 468) comprised of symptomatic women in Kigali who sought free screening and treatment for sexually transmitted infections and vaginal dysbioses at our research site. We used logistic regression to derive a risk algorithm for prediction of NG/CT infection. Ten-fold cross-validation internally validated the risk algorithm. We applied the risk algorithm to an external validation cohort also comprised of symptomatic Rwandan women (n = 305). Measures of calibration, discrimination, and screening performance of our risk algorithm compared to the current Rwandan National Criteria are presented.

Results

The prevalence of NG/CT in the derivation cohort was 34.6%. The risk algorithm included: age < =25, having no/primary education, not having full-time employment, using condoms only sometimes, not reporting genital itching, testing negative for vaginal candida, and testing positive for bacterial vaginosis. The model was well calibrated (Hosmer-Lemeshow p = 0.831). Higher risk scores were significantly associated with increased prevalence of NG/CT infection (p < 0.001). Using a cut-point score of > = 5, the risk algorithm had a sensitivity of 81%, specificity of 54%, positive predictive value (PPV) of 48%, and negative predictive value (NPV) of 85%. Internal and external validation showed similar predictive ability of the risk algorithm, which outperformed the Rwandan National Criteria. Applying the Rwandan National Criteria cutoff of > = 2 (the current cutoff) to our derivation cohort had a sensitivity of 26%, specificity of 89%, PPV of 55%, and NPV of 69%.

Conclusions

These data support use of a locally relevant, evidence-based risk algorithm to significantly reduce the number of untreated NG/CT cases in symptomatic Rwandan women. The risk algorithm could be a cost-effective way to target treatment to those at highest NG/CT risk. The algorithm could also aid in sexually transmitted infection risk and prevention communication between providers and clients.

Peer Review reports

Introduction

The World Health Organization (WHO) estimates that Neisseria gonorrhoeae (NG) and Chlamydia trachomatis (CT) prevalence has increased more than other curable sexually transmitted infections (STIs) in Africa [1]. Infection with NG or CT has been shown to increase risk of HIV transmission [2,3,4,5] and, in women, to increase risk of pelvic inflammatory disease, infertility, and preterm birth [6].

Syndromic STI management systems [7,8,9,10,11,12,13,14] remain the standard of care across much of Africa due to the high cost of culture-based and molecular diagnostics. While STI symptoms may be useful in identifying STIs in men, they are less easily interpreted in women who often experience non-STI genital conditions that produce discharge [15]. A particular challenge with syndromic management of women is distinguishing causes of endocervical infection (NG/CT) from vaginal infection or dysbiosis (Trichomonas vaginalis (TV), bacterial vaginosis (BV), and vaginal Candida albicans (VCA)).

Per the 2019 Rwandan National Criteria [16], management of men presenting with urethral discharge is presumptive treatment for NG/CT. Management of women presenting with vaginal discharge requires report of at least two of the following three risk factors to be treated for NG/CT cervicitis: age < 21, single, and > =2 sexual partners. Though WHO calls for development of locally relevant algorithms to improve STI diagnosis [17], the 2019 Rwanda criteria for women are not based on the local NG/CT prevalence or correlates of NG/CT.

We recruited symptomatic men and women in Kigali between January 2016 and August 2019 using radio announcements and referrals for free point-of-care STI screening and treatment at the Center for Family Health Research (CFHR) site in Kigali, Rwanda. We found very high NG and CT prevalence in men (among 1013 tests, 74% were NG positive, 20% CT positive, and 19% were negative) (Wall et al., under review). These data support that syndromic treatment of NG/CT in men according to the 2019 Rwandan National Criteria [16] may perform relatively well. In contrast, while we also found high NG and CT prevalence in women, the clinical picture was more complex (among 579 tests, 26% were NG positive, 17% CT positive, 21% BV positive, 21% VCA positive, 13% TV positive, 30% negative) (Wall et al., under review).

Here, our objective is to develop and validate a risk algorithm for diagnosis of NG/CT among symptomatic women in Rwanda and to compare the performance of this algorithm with the 2019 Rwandan National Criteria [16].

Methods

Ethics

This program was approved as non-research by the Rwandan National Ethics Committee and the US Centers for Disease Control (CDC) that funded service provision through PEPFAR. This program also met non-research criteria of the Emory Institutional Review Board. STI diagnosis and treatment were provided anonymously as free public health services. All methods were carried out in accordance with relevant guidelines and regulations.

Derivation cohort

Women were recruited between January 2016 and August 2019 in Kigali, the capital of Rwanda. Radio announcements encouraged men and women with genital discharge, discomfort, or ulcer to seek free STI screening and treatment services at our CFHR site from trained staff. Clients were asked to refer sex partners and any known symptomatic person. Pharmacists were asked to refer people seeking treatment for STI-suggestive symptoms to the CFHR site. We limited the derivation cohort to symptomatic women, defined as reporting vaginal discharge, to be comparable with the Rwandan National criteria. Some women returned for additional care, confirmation of treatment effectiveness, or other reasons. The final risk algorithm derivation cohort was composed of women’s first visits only.

External validation cohort

Between January to March 2020, symptomatic women were again recruited for free STI screening and treatment at our CFHR site using the same recruitment strategies described above. However instead of trained site staff, STI diagnoses were made by eight government clinic providers who were trained by our staff during a didactic training session (with pre/post-training assessment) on STI etiologies, treatments, and use of the Rwandan National Criteria for diagnosis among symptomatic patients. After government providers made diagnoses, patients underwent gold standard STI diagnosis and treatment as described below. The final external validation cohort was composed of women’s first visits only.

Survey, genital exam, and laboratory measures

In both the derivation and external validation cohort, demographic, risk factor, and symptom data were collected via standardized surveys. Survey questions were identified through literature review and based on our previous work describing STIs in Rwanda [18,19,20,21]. Surveys were administered by nurses who entered participant responses into MS Access. Genital exams were performed by trained physicians and nurses. We conducted laboratory testing of patient samples including phlebotomy for rapid HIV and rapid plasma reagin (RPR) serologies; microscopy of vaginal swab wet mount preparations to diagnose TV, BV and VCA; and endocervical swabs for GeneXpert (Cepheid, Sunnyvale USA) testing for NG and CT. Given concerns about emergence of antibiotic resistance of NG in Rwanda and elsewhere in Africa [12, 22] and the dated information from Rwanda (last published study in 2000) [23] we requested patients treated for NG return for retesting 2–3 weeks after treatment. National guidelines (2015) for first-line NG treatment specified ciprofloxacin with ceftriaxone used in cases of resistance, and doxycycline for CT. This changed in the 2019 Guidelines to ceftriaxone as first-line treatment for NG.

Data analyses

Analyses are conducted with Statistical Analysis Software version 9.4 (Cary, NC).

Outcome of interest

Our outcome of interest was NG and/or CT infection diagnosed on GeneXpert in women presenting with vaginal discharge. We recognize and discuss below the difference between a positive nucleic acid test and a confirmed infection. We focus on symptomatic women and combined NG and CT to be comparable with the Rwandan National Criteria for diagnosis of NG/CT.

Baseline characteristics and associations with NG or CT infection

Demographic, behavioral, and symptom data are described for the derivation and validation cohorts. Counts and percentages (categorical variables) and means and standard deviations (continuous variables) are presented. The data were described overall and by NG/CT infection status. Chi-square (or Fisher’s exact) or t-tests evaluated whether differences in the distribution of baseline data by NG/CT infection status was due to chance.

Derivation and calibration of the risk algorithm

Bivariate and multivariable logistic regression models identified variables associated with the outcome of interest. Variables were included in multivariable models if they were associated (p < 0.05) with the outcome in bivariate analyses, survived backward elimination, and were considered feasible measures in a Rwandan government clinic setting (for example, phlebotomy and microscopy are available in most health centers while physical exams are not). Variable multi-collinearity was assessed. Crude and adjusted prevalence odds ratios, 95% confidence intervals, and p-values were calculated. Score values for individual variables in the final model were obtained by dividing each variable’s estimated model coefficient by the lowest coefficient among all variables and rounding to the nearest integer. To assess model calibration, we used the Hosmer-Lemeshow Goodness-of-Fit test using the LACKFIT option in SAS.

Internal validation of the risk algorithm

We used standard 10-fold cross validation methods [24] for internal validation. Briefly, variables significantly (p < 0.05) associated with the outcome in bivariate analysis were included in initial multivariate models excluding a random 1/10th of the data. The final model was derived by backwards elimination and a model coefficient-weighted score was created from the variables retained in the final model. The scores derived were then tested in the remaining 1/10th of the data. This process was repeated ten times such that each 1/10th was withheld and then tested in turn. Then the same process was applied to ten 90% training sets and 10% test sets.

Discrimination of the risk algorithm and the Rwandan National Criteria

The area under the receiver operating curve (AUC) was calculated using standard methods [25] for the risk algorithm applied to the derivation cohort, after 10-fold cross validation (average AUC of the 10 different models is presented), and applied to the external validation cohort. The AUC was also calculated after applying the Rwandan National Criteria to the derivation cohort. Receiver operating curves were graphed and compared for the risk algorithm versus the Rwandan National Criteria, both as applied to the derivation cohort. Measures of sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) of the risk algorithm were calculated using score cut-offs defined as the median score.

Distribution of NG/CT prevalence and population by score categories

The prevalence of NG/CT within risk score categories were calculated in the derivation cohort comparing the risk algorithm with the Rwandan National Criteria. The population distribution of the derivation cohort falling within each risk score category was also calculated.

Results

Baseline characteristics and associations with NG or CT infection

Most (82%) women were symptomatic. Among the n = 468 symptomatic women in the derivation cohort, the prevalence of NG/CT infection was 35% (Table 1). Most women reported only one or no partner in the last month (83%) and most (64%) reported never using condoms during vaginal sex in the last 3 months. Roughly one-fifth of women were BV positive and one-fifth were candida positive. Roughly half had endocervical inflammation or discharge on physical exam. Overall, the derivation and external validation cohorts were similar. Among the n = 305 women in the external validation cohort, the prevalence of NG/CT was 28% (Supplemental Table 1). Some differences include the prevalence of BV (21% derivation versus 40% validation cohort), and endocervical inflammation or discharge on physical exam (53% derivation versus 36% validation cohort).

Table 1 Baseline characteristics and associations with NG or CT infection in symptomatic women, Kigali (N = 468): derivation cohort

Risk algorithm components, calibration, and discrimination

As shown in Table 2, the risk algorithm included being 25 or younger (2 points), having no/primary education (1 point), not having full-time employment (1 point), sometimes using condoms (2 points), not reporting genital itching (2 points), not having candida (2 points), and having BV (1 point). The Hosmer-Lemeshow Goodness-of-Fit test indicated good calibration (p-value = 0.831). The risk algorithm had reasonable discrimination in the derivation cohort (AUC = 0.75, 95%CI: 0.70–0.79, p < 0.001). We also had reasonable discrimination in the 10-fold cross validation (AUC = 0.71, 95%CI: 0.55–0.86, p < 0.01, Table 3) and the external validation cohort (AUC = 0.63, 95%CI: 0.56–0.70, p < 0.01).

Table 2 Risk score algorithm comprised of factors associated with NG or CT infection in symptomatic women, Kigali (N = 468)
Table 3 Results of 10-fold cross validation or a risk score algorithm comprised of factors associated with NG or CT infection in symptomatic women, Kigali (N = 468)

Discrimination of the risk algorithm compared to the Rwandan National Guideline Criteria

Sensitivity, specificity, PPV, and NPV for the risk algorithm and the Rwandan National Criteria are shown in Table 4. The risk algorithm in the derivation cohort had 81% sensitivity, 54% specificity, 48% PPV, and 85% NPV for a score cutoff of > = 5. As shown in Table 4, the risk algorithm performed similarly in the external validation cohort. In comparison, the Rwandan National Criteria was substantially less sensitive than the risk algorithm. Applying the Rwandan National Criteria cutoff of > = 2 (the cutoff level in 2019 Guidelines) to our derivation cohort had a sensitivity of 26%, specificity of 89%, PPV of 55%, and NPV of 69%. These findings are reflected in the receiver operating curve shown in Fig. 1. The Rwandan National Criteria had lower discrimination compared to the risk algorithm.

Table 4 Risk algorithm performance to identify NG or CT infection in symptomatic women compared with Rwandan National Criteria
Fig. 1
figure 1

Receiver operating curves companing the risk algorithm and Rwandan National Criteria (derivation cohort, n = 468 women)

Distribution of NG/CT prevalence and population by score category comparing the risk algorithm to the Rwandan National Criteria

For both the risk algorithm and the Rwandan National Criteria, higher scores were significantly associated with increased prevalence of NG/CT infection (p < 0.001) (Fig. 2a and b). Applying the risk algorithm (Fig. 2a), most of the population had risk algorithm scores of 4 (15% of the population), 5 (19%), or 6 (14%). The prevalence of NG/CT within these risk algorithm categories were 21, 30, and 53%, respectively. Applying the Rwandan National Criteria (Fig. 2b), most of the population had risk scores of 0 (42% of the population) or 1 (42%). The prevalence of NG/CT within these risk algorithm categories was 20 and 40%, respectively.

Fig. 2
figure 2

Prevalence of CT/NG and population distribution within exact risk score categories comparing the risk algorithm (panel a) and the 2019 Rwandan National Guidelines Criteria (panel b) applied to the derivation cohort (n = 468 women)

Discussion

In this study, we developed and validated a simple risk algorithm comprised of demographic, symptoms, and laboratory data and based on up-to-date epidemiological data from Kigali, Rwanda. This risk algorithm outperformed the current Rwandan National Criteria. Importantly, the current Rwandan National Criteria cutoff score of > = 2 would have missed identifying many women who were NG/CT positive in our derivation cohort – the proportion of NG/CT cases not diagnosed (i.e., the proportion of false negatives) was 19% using the risk algorithm (cutoff > = 5) compared to 74% using Rwandan National Criteria (cutoff > = 2). These findings exemplify the WHO recommendation that locally relevant data should inform approaches to diagnosis and treatment [17].

The advent of GeneXpert diagnostics for NG and CT has greatly enhanced STI management. A recent study in Rwanda found that providing GeneXpert tests for NG/CT as well as point-of-care tests for BV and TV in symptomatic, high-risk women significantly reduced overtreatment [26]. However, at $18/test for GeneXpert reagents and reliance on an expensive machine that is not widely available, this technology remains unaffordable in much of Africa. Algorithms that bridge the gap between syndromic management and treatment based in realistic diagnostic options and local epidemiology are urgently needed.

Women commonly experience genital symptoms that are due to non-STIs like VCA or BV, which has been a challenge with syndromic diagnosis of STIs in women. In our model, testing negative for VCA or positive for BV on microscopic examination of vaginal swab wet preparations was associated with NG/CT infection. While microscopy is generally available in health centers, laboratory technicians may need to be (re) trained to diagnose TV, BV, or VCA on vaginal swab wet mount preparations. Microscopy could also potentially have a role in NG diagnosis. Gram-stained endocervical (or urethral) discharge, which is feasible in government health facilities, could be further explored. In our laboratory, 12/13 GeneXpert NG positive and 2/41 GeneXpert NG negative endocervical swabs from women were positive for NG on Gram stain. Of urethral discharge samples from men, 64/93 GeneXpert NG positive and 2/68 GeneXpert NG negative samples were positive for NG on Gram stain (unpublished data). The sensitivity of Gram stain is suboptimal and false positives may result when other Gram-negative coccobacilli including Moraxella osloensis, Moraxella phenylpyruvica, Kingella denitrificans, and Acinetobacter species are present. This is particularly true when microscopists have not been trained to distinguish intra from extra-cellular diplococci. That said, the cost is low and, with adequate quality control of microscopy, GeneXpert could, for example, be a backup for microscopy negative clients with an otherwise suggestive profile.

We did not include physical exam findings in our risk algorithm since physical exams are not routinely conducted in Rwandan government health facilities where trained clinicians and equipment for speculum exams may not be available. However, in our previous publication of data from this program (Wall et al., under review), we reported that distinguishing vaginal from endocervical discharges via physical exam may improve diagnostic performance. Visual examination of ulcer may also improve STI diagnosis [27]. We previously reported that most RPR+ patients did not report ulcers, which may be internal in women and difficult to see. Conversely, most men and women with ulcers were not RPR+. While physical exams are likely infeasible for all symptomatic patients in government clinic outpatient departments, genital exams for men are more feasible and targeted genital exams for women may be possible and useful.

We learned some relevant lessons when training the eight government healthcare providers who made diagnoses in the external validation cohort. Following didactic training, knowledge of the Rwandan National Criteria for syndromes substantially increased from 60 to 88% (p < 0.0001) and correct treatment for STI etiologies increased from 44 to 80% (p < 0.0001) (unpublished data). However, after providers were trained, overtreatment of NG/CT was more common using National Guidelines, with 59% of prescriptions being unnecessary. The cost-effectiveness of implementing an evidence-based risk algorithm along with improved provider trainings to identify and treat STI should be explored.

One important provider training topic is antibiotic resistance in NG. Initially, patients diagnosed with NG by GeneXpert at the CFHR site were treated with ciprofloxacin (first line using 2015 National Guidelines with ceftriaxone for cases of resistance) or ceftriaxone (first line in 2019 Guidelines) and asked to return in 2–3 weeks for re-testing. We found that NG positivity after treatment was significantly higher among those who received ciprofloxacin versus ceftriaxone (86% vs 15% measured 1–16 days after initial treatment). While some positive repeat tests may be due to persistence of nucleic acids detectable by GeneXpert for 2 weeks [28, 29] or re-infection, these results strongly suggest resistance to ciprofloxacin. As a result of our preliminary findings of resistance to ciprofloxacin, the 2019 National Guidelines changed the first line NG treatment to ceftriaxone (Wall et al., under review).

Another important training topic is partner notification to diagnose new cases and reduce reinfection in index cases. In the subset of the NG patients above, the proportion who were NG positive 17–30 days after Ceftriaxone treatment was 30% and this increased to 68% at > 30 days after Ceftriaxone treatment. Although without negative intervening tests we cannot be certain, the increase over time does suggest high rates of reinfection by an untreated partner. Partner notification involves identifying exposed sex partner(s) of index cases with STI, notifying them about their exposure, and offering testing, counselling and treatment [30]. Our program relied on patient referrals of sexual partners as described in National Guidelines. Other strategies include providing a referral slip for the index to give to partner(s) to seek treatment at a facility or asking the index case for contact information for their partners to allow clinic staff to communicate results directly by telephone or by mail [31]. A systematic review found that provider referral strategies may be more effective than patient referral in some populations [32].

Our program and data have some limitations. Data from an external validation cohort from another urban center would have improved the assessment of risk algorithm validity. Our findings are generalizable to symptomatic women who comprise most women seeking care at health facilities. However, many NG/CT cases are asymptomatic [33, 34], GeneXpert screening of high-risk populations may be warranted where feasible and affordable. Additionally, our findings are generalizable to urban women, who experience a larger proportion of STIs in Rwanda compared to rural women. We did not have the facilities to diagnose some etiologies of inflammation (e.g., M. genitalium) or ulcer (e.g., chancroid, lymphogranuloma venereum).

Conclusions

Syndromic management guidelines in Rwanda can be improved with consideration of demographic, symptoms, and simple laboratory measures shown to be predictive of STI and non-STI dysbioses. Our data support use of a locally relevant, evidence-based risk algorithm to greatly reduce the number of untreated NG/CT cases in symptomatic Rwandan women. Our risk algorithm combined with provider training could be a cost-effective way to improve upon syndromic STI management and treatment in the Rwandan capital.

Availability of data and materials

The datasets analysed during the current study are available from the corresponding author on reasonable request.

Abbreviations

AUC:

Area under the receiver operating curve

BV:

Bacterial vaginosis

CT:

Chlamydia trachomatis

NPV:

Negative predictive value

NG :

Neisseria gonorrhoeae

PPV:

Positive predictive value

RPR:

Rapid plasma reagin

STI:

Sexually transmitted infection

TV:

Trichomonas vaginalis

VCA:

Vaginal Candida albicans

WHO:

World Health Organization

References

  1. Rowley J, Vander Hoorn S, Korenromp E, Low N, Unemo M, Abu-Raddad LJ, et al. Chlamydia, gonorrhoea, trichomoniasis and syphilis: global prevalence and incidence estimates, 2016. Bull World Health Organ. 2019;97(8):548–62P. https://doi.org/10.2471/BLT.18.228486 PubMed PMID: 31384073. Epub 2019/06/06.

    Article  PubMed  PubMed Central  Google Scholar 

  2. Phiri S, Zadrozny S, Weiss HA, Martinson F, Nyirenda N, Chen CY, et al. Etiology of genital ulcer disease and association with HIV infection in Malawi. Sex Transm Dis. 2013;40(12):923–8. https://doi.org/10.1097/OLQ.0000000000000051 PubMed PMID: 24220352. Epub 2013/11/14.

    Article  PubMed  Google Scholar 

  3. Takuva S, Mugurungi O, Mutsvangwa J, Machiha A, Mupambo AC, Maseko V, et al. Etiology and antimicrobial susceptibility of pathogens responsible for urethral discharge among men in Harare. Zimbabwe Sex Transm Dis. 2014;41(12):713–7. https://doi.org/10.1097/OLQ.0000000000000204 PubMed PMID: 25581806. Epub 2015/01/13.

    Article  CAS  PubMed  Google Scholar 

  4. Sylverken AA, Owusu-Dabo E, Yar DD, Salifu SP, Awua-Boateng NY, Amuasi JH, et al. Bacterial etiology of sexually transmitted infections at a STI clinic in Ghana; use of multiplex real time PCR. Ghana Med J. 2016;50(3):142–8 Epub 2016/10/19. PubMed PMID: 27752188; PMCID: PMC5044789.

    PubMed  PubMed Central  Google Scholar 

  5. Chirenje ZM, Dhibi N, Handsfield HH, Gonese E, Tippett Barr B, Gwanzura L, et al. The Etiology of Vaginal Discharge Syndrome in Zimbabwe: Results from the Zimbabwe STI Etiology Study. Sex Transm Dis. 2018;45(6):422–8. https://doi.org/10.1097/OLQ.0000000000000771 PubMed PMID: 29465674; PMCID: PMC6879447. Epub 2018/02/22.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Holmes KKSP, Stamm WE, Piot P, Wasserheit JN, Corey L, et al. Sexually transmitted diseases. 4th ed. New York: McGraw-Hill Medical; 2008.

    Google Scholar 

  7. Morikawa E, Mudau M, Olivier D, de Vos L, Joseph Davey D, Price C, et al. Acceptability and Feasibility of Integrating Point-of-Care Diagnostic Testing of Sexually Transmitted Infections into a South African Antenatal Care Program for HIV-Infected Pregnant Women. Infect Dis Obstet Gynecol. 2018;2018:3946862. https://doi.org/10.1155/2018/3946862 PubMed PMID: 29861622; PMCID: PMC5971359. Epub 2018/06/05.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  8. Garrett NJ, Osman F, Maharaj B, Naicker N, Gibbs A, Norman E, et al. Beyond syndromic management: Opportunities for diagnosis-based treatment of sexually transmitted infections in low- and middle-income countries. PLoS One. 2018;13(4):e0196209. https://doi.org/10.1371/journal.pone.0196209 PubMed PMID: 29689080; PMCID: PMC5918163. Epub 2018/04/25.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  9. Francis SC, Ao TT, Vanobberghen FM, Chilongani J, Hashim R, Andreasen A, et al. Epidemiology of curable sexually transmitted infections among women at increased risk for HIV in northwestern Tanzania: inadequacy of syndromic management. PLoS One. 2014;9(7):e101221. https://doi.org/10.1371/journal.pone.0101221 PubMed PMID: 25025338; PMCID: PMC4099080. Epub 2014/07/16.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  10. Guimaraes H, Castro R, Tavora Tavira L. da LEF. Assessing therapeutic management of vaginal and urethral symptoms in an anonymous HIV testing Centre in Luanda, Angola. J Infect Dev Ctries. 2013;7(10):720–5. https://doi.org/10.3855/jidc.2752 PubMed PMID: 24129624. Epub 2013/10/17.

    Article  PubMed  Google Scholar 

  11. Marx G, John-Stewart G, Bosire R, Wamalwa D, Otieno P, Farquhar C. Diagnosis of sexually transmitted infections and bacterial vaginosis among HIV-1-infected pregnant women in Nairobi. Int J STD AIDS. 2010;21(8):549–52. https://doi.org/10.1258/ijsa.2010.010005 PubMed PMID: 20975086; PMCID: PMC3050991. Epub 2010/10/27.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  12. Black V, Magooa P, Radebe F, Myers M, Pillay C, Lewis DA. The detection of urethritis pathogens among patients with the male urethritis syndrome, genital ulcer syndrome and HIV voluntary counselling and testing clients: should South Africa's syndromic management approach be revised? Sex Transm Infect. 2008;84(4):254–8. https://doi.org/10.1136/sti.2007.028464 PubMed PMID: 18192290. Epub 2008/01/15.

    Article  CAS  PubMed  Google Scholar 

  13. Frohlich JA, Abdool Karim Q, Mashego MM, Sturm AW, Abdool Karim SS. Opportunities for treating sexually transmitted infections and reducing HIV risk in rural South Africa. J Adv Nurs. 2007;60(4):377–83. https://doi.org/10.1111/j.1365-2648.2007.04405.x PubMed PMID: 17822425. Epub 2007/09/08.

    Article  CAS  PubMed  Google Scholar 

  14. Tann CJ, Mpairwe H, Morison L, Nassimu K, Hughes P, Omara M, et al. Lack of effectiveness of syndromic management in targeting vaginal infections in pregnancy in Entebbe, Uganda. Sex Transm Infect. 2006;82(4):285–9. https://doi.org/10.1136/sti.2005.014845 Epub 2006/08/01. PubMed PMID: 16877576; PMCID: PMC2564710.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  15. CDC. CDC Fact Sheet: 10 Ways STDs Impact Women Differently from Men 2011. Available from: https://www.cdc.gov/std/health-disparities/stds-women-042011.pdf.

    Google Scholar 

  16. Ministry of Health, Rwanda. Ro. National guidelines for and management of viral hepatitis B, C and sexually transmitted infections. 2019.

    Google Scholar 

  17. WHO. Sexually transmitted infections: implementing the Global STI Strategy 2017 [cited 2021 Jan 12]. Available from: https://apps.who.int/iris/bitstream/handle/10665/258740/WHO-RHR-17.18-eng.pdf?sequence=1.

    Google Scholar 

  18. Allen S, Serufilira A, Bogaerts J, Van de Perre P, Nsengumuremyi F, Lindan C, et al. Confidential HIV testing and condom promotion in Africa. Impact on HIV and gonorrhea rates. JAMA. 1992;268(23):3338–43. Epub 1992/12/16. PubMed PMID: 1453526. https://doi.org/10.1001/jama.1992.03490230068030.

    Article  CAS  PubMed  Google Scholar 

  19. Ingabire R, Parker R, Nyombayire J, Ko JE, Mukamuyango J, Bizimana J, et al. Female sex workers in Kigali, Rwanda: a key population at risk of HIV, sexually transmitted infections, and unplanned pregnancy. Int J STD AIDS. 2019;30(6):557–68. https://doi.org/10.1177/0956462418817050 PubMed PMID: 30727831; PMCID: PMC6512058. Epub 2019/02/08.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Karita E, Nsanzimana S, Ndagije F, Wall KM, Mukamuyango J, Mugwaneza P, et al. Implementation and Operational Research: Evolution of Couples' Voluntary Counseling and Testing for HIV in Rwanda: From Research to Public Health Practice. J Acquir Immune Defic Syndr (1999). 2016;73(3):e51–e8. https://doi.org/10.1097/qai.0000000000001138 PubMed PMID: 27741033; PMCID: PMC5367509. Epub 2016/10/16.

    Article  Google Scholar 

  21. Twahirwa Rwema JO, Lyons CE, Herbst S, Liestman B, Nyombayire J, Ketende S, et al. HIV infection and engagement in HIV care cascade among men who have sex with men and transgender women in Kigali, Rwanda: a cross-sectional study. J Int AIDS Soc. 2020;23(Suppl 6):e25604. https://doi.org/10.1002/jia2.25604 PubMed PMID: 33000912; PMCID: PMC7527755. Epub 2020/10/02.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Ndowa FJ, Francis JM, Machiha A, Faye-Kette H, Fonkoua MC. Gonococcal antimicrobial resistance: perspectives from the African region. Sex Transm Infect. 2013;89(Suppl 4):iv11–5. https://doi.org/10.1136/sextrans-2012-050907 PubMed PMID: 24243873. Epub 2013/11/28.

    Article  PubMed  Google Scholar 

  23. Van Dyck E, Karita E, Abdellati S, Dirk VH, Ngabonziza M, Lafort Y, et al. Antimicrobial susceptibilities of Neisseria gonorrhoeae in Kigali, Rwanda, and trends of resistance between 1986 and 2000. Sex Transm Dis. 2001;28(9):539–45. https://doi.org/10.1097/00007435-200109000-00012 PubMed PMID: 11518873. Epub 2001/08/24.

    Article  PubMed  Google Scholar 

  24. Jung Y, Hu J. A K-fold averaging cross-validation procedure. J Nonparametr Stat. 2015;27(2):167–79. https://doi.org/10.1080/10485252.2015.1010532 PubMed PMID: 27630515. Epub 2015/02/26.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Steyerberg EW, Vickers AJ, Cook NR, Gerds T, Gonen M, Obuchowski N, et al. Assessing the performance of prediction models: a framework for traditional and novel measures. Epidemiology. 2010;21(1):128–38. https://doi.org/10.1097/EDE.0b013e3181c30fb2 PubMed PMID: 20010215; PMCID: PMC3575184. Epub 2009/12/17.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Verwijs MC, Agaba SK, Sumanyi J-C, Umulisa MM, Mwambarangwe L, Musengamana V, et al. Targeted point-of-care testing compared with syndromic management of urogenital infections in women (WISH): a cross-sectional screening and diagnostic accuracy study. Lancet Infect Dis. 2019;19(6):658–69. https://doi.org/10.1016/S1473-3099(18)30724-2.

    Article  PubMed  Google Scholar 

  27. Behets FM, Brathwaite AR, Hylton-Kong T, Chen CY, Hoffman I, Weiss JB, et al. Genital ulcers: etiology, clinical diagnosis, and associated human immunodeficiency virus infection in Kingston. Jamaica Clin Infect Dis. 1999;28(5):1086–90. https://doi.org/10.1086/514751 PubMed PMID: 10452639. Epub 1999/08/19.

    Article  CAS  PubMed  Google Scholar 

  28. Centers for Disease C, Prevention. Recommendations for the laboratory-based detection of Chlamydia trachomatis and Neisseria gonorrhoeae--2014. MMWR Recomm Rep. 2014;63(RR-02):1–19 Epub 2014/03/14. PubMed PMID: 24622331; PMCID: PMC4047970.

    Google Scholar 

  29. CDC. Gonococcal Infections 2015 [cited 2019 September 26]. Available from: https://www.cdc.gov/std/tg2015/gonorrhea.htm.

    Google Scholar 

  30. Wynn A, Moucheraud C, Moshashane N, Offorjebe OA, Ramogola-Masire D, Klausner JD, et al. Using partner notification to address curable sexually transmitted infections in a high HIV prevalence context: a qualitative study about partner notification in Botswana. BMC Public Health. 2019;19(Suppl 1):606. https://doi.org/10.1186/s12889-019-6813-2 PubMed PMID: 31138228; PMCID: PMC6538557. Epub 2019/05/30.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Pellowski J, Mathews C, Kalichman MO, Dewing S, Lurie MN, Kalichman SC. Advancing Partner Notification Through Electronic Communication Technology: A Review of Acceptability and Utilization Research. J Health Commun. 2016;21(6):629–37. https://doi.org/10.1080/10810730.2015.1128020 PubMed PMID: 27144318; PMCID: PMC4948177. Epub 2016/05/05.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Mathews C, Coetzee N. Partner notification. BMJ Clin Evid. 2009;2009 Epub 2009/01/01. PubMed PMID: 21733200; PMCID: PMC2907794.

  33. Johnson LF, Dorrington RE, Bradshaw D, Coetzee DJ. The effect of syndromic management interventions on the prevalence of sexually transmitted infections in South Africa. Sex Reprod Healthc. 2011;2(1):13–20. https://doi.org/10.1016/j.srhc.2010.08.006 PubMed PMID: 21147454. Epub 2010/12/15.

    Article  PubMed  Google Scholar 

  34. Garrett N, Mitchev N, Osman F, Naidoo J, Dorward J, Singh R, et al. Diagnostic accuracy of the Xpert CT/NG and OSOM Trichomonas Rapid assays for point-of-care STI testing among young women in South Africa: a cross-sectional study. BMJ Open. 2019;9(2):e026888. https://doi.org/10.1136/bmjopen-2018-026888 PubMed PMID: 30782948; PMCID: PMC6367982. Epub 2019/02/21.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

This work was funded by the International AIDS Vaccine Initiative (IAVI) with the generous support of USAID; a full list of IAVI donors is available at www.iavi.org. This work was partially funded by CDC, the National Institutes of Health (NIAID R01 AI51231), the AIDS International Training and Research Program Fogarty International Center (D43 TW001042); and the Emory Center for AIDS Research (P30 AI050409). The contents of this manuscript are the responsibility of the authors and do not necessarily reflect the views of USAID, CDC or the US Government.

Author information

Authors and Affiliations

Authors

Contributions

KMW contributed to the analysis and interpretation of data, drafted the article and revised it critically for important intellectual content, and gave final approval of the version to be published. JN, RI, JB, JM, AM, MAU, AT, EK contributed to the conception and design of the study, revised the article critically for important intellectual content, and gave final approval of the version to be published. RP, MP contributed to the analysis and interpretation of data, revised the article critically for important intellectual content, and gave final approval of the version to be published. SA contributed to the study design and conception, contributed to the analysis and interpretation of data, revised the article critically for important intellectual content, and gave final approval of the version to be published.

Corresponding author

Correspondence to Kristin M. Wall.

Ethics declarations

Ethics approval and consent to participate

This study program was approved as non-research by the Rwandan National Ethics Committee and the US Centers for Disease Control (CDC) that funded service provision through PEPFAR. This program also met non-research criteria of the Emory Institutional Review Board. STI diagnosis and treatment were provided anonymously as free public health services. All methods were carried out in accordance with relevant guidelines and regulations. Waivers of written informed consent were obtained from the Emory Institutional Review Board and the Rwandan National Ethics Committee.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1: Table S1.

Baseline characteristics and associations with CT or NG infection in symptomatic women, Kigali (N = 305): external validation cohort.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wall, K.M., Nyombayire, J., Parker, R. et al. Developing and validating a risk algorithm to diagnose Neisseria gonorrhoeae and Chlamydia trachomatis in symptomatic Rwandan women. BMC Infect Dis 21, 392 (2021). https://doi.org/10.1186/s12879-021-06073-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12879-021-06073-z

Keywords