Skip to main content

SYSTEMATIC REVIEW article

Front. Med., 03 January 2022
Sec. Infectious Diseases: Pathogenesis and Therapy
Volume 8 - 2021 | https://doi.org/10.3389/fmed.2021.806605

The Diagnostic Accuracy of Syndromic Management for Genital Ulcer Disease: A Systematic Review and Meta-Analysis

Andre J. W. Loh1 Ee Lynn Ting1 Teodora E. Wi2 Philippe Mayaud3 Eric P. F. Chow1,4,5 Nancy Santesso6 Jane Falconer7 Richard Ofori-Asenso8,9 Jason J. Ong1,3,4*
  • 1Central Clinical School, Monash University, Melbourne, VIC, Australia
  • 2Global HIV, Hepatitis and STI Programmes, World Health Organization, Geneva, Switzerland
  • 3Faculty of Infectious and Tropical Diseases, London School of Hygiene and Tropical Medicine, London, United Kingdom
  • 4Melbourne Sexual Health Centre, Alfred Health, Carlton, VIC, Australia
  • 5Centre for Epidemiology and Biostatistics, Melbourne School of Population and Global Health, The University of Melbourne, Melbourne, VIC, Australia
  • 6Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, ON, Canada
  • 7Library & Archives Service, London School of Hygiene & Tropical Medicine, London, United Kingdom
  • 8Monash Outcomes Research and Health Economics, Department of Epidemiology and Preventive Medicine, Monash University, Melbourne, VIC, Australia
  • 9Real World Data Enabling Platform, Roche Products Ltd., Welwyn Garden City, United Kingdom

Objectives: Genital Ulcer Disease (GUD) carries a significant disease burden globally. With limited access to diagnostics, the 2001 World Health Organization (WHO) sexually transmitted illnesses (STI) guidelines proposed a syndromic management algorithm that required a clinical decision to determine the management of GUD. We assessed the diagnostic accuracy of this algorithm.

Methods: We conducted a systematic review (Prospero: CRD42020153294) using eight databases for publications between 1995 and January 2021 that reported primary data on the diagnostic accuracy of clinical diagnosis to identify aetiological agents of GUD. Titles and abstracts were independently assessed for eligibility, and data were extracted from full texts for sensitivity/specificity. A hierarchical logistic regression model was used to derive pooled sensitivity and specificity. We used GRADE to evaluate the certainty of evidence.

Results: Of 24,857 articles, 151 full texts were examined and 29 included in the analysis. The majority were from middle-income countries [(14/29 (48%) lower middle, 10/29 (34%) upper middle)]. We pooled studies where molecular testing was using to confirm the aetiology of GUD: 9 studies (12 estimates) for herpes, 4 studies (7 estimates) for syphilis, and 7 studies (10 estimates) for chancroid. The pooled sensitivity and specificity of GUD for the detection of herpes was 43.5% [95% confidence interval (CI): 26.2–62.4], and 88.0% (95% CI: 67.0–96.3), respectively (high certainty evidence); and for syphilis were 52.8% (95% CI: 23.0–80.7), and 72.1% (95% CI: 28.0–94.5) (moderate certainty evidence); and for chancroid were 71.9% (95% CI: 45.9–88.5) and 53.1% (95% CI: 36.6–68.9) (moderate certainty evidence), respectively.

Conclusion: Algorithms requiring a clinical diagnosis to determine and treat the aetiology of GUD have poor sensitivities for syphilis and herpes simplex virus, resulting in significant numbers of missed cases. There is an urgent need to improve access to affordable and efficient diagnostics (e.g., point-of-care tests) to be incorporated into GUD algorithms to better guide appropriate management.

Systematic Review Registration: PROSPERO, identifier: CRD42020153294.

Introduction

Sexually transmitted infections (STIs) are a major global public health problem, with significant economic, health, and social impact. In 2016, an estimated 376 million new STI cases were diagnosed (1). To curb the rising pandemic of STIs, the World Health Organization (WHO) proposed adoption of the Global Health Sector Strategy on STIs in 2016 to rapidly scale up evidence-based interventions and services to end STIs as a public health concern by 2030 (2). One area of focus was tackling the incredibly high incidence of STIs in developing countries. Developing countries bear the largest burden of disease, where STIs can account for 17% of economic losses caused by ill-health (3).

There is often a lack of adequate and affordable laboratory infrastructure for accurate aetiological diagnosis of STIs in these resource-limited countries. Guidelines for managing STIs based on a syndromic algorithm were first promoted by the WHO in 1991 and updated in 2001 to address this barrier (4). The syndromic management of STIs refers to identifying the presence of a distinct group of symptoms, including genital ulcers, urethral discharge, anorectal disease and lower abdominal pain, and recognising them to be part of an “STI syndrome.” Clinicians will treat these syndromes empirically, covering the common or most serious organisms for that particular syndrome. Eighty-three countries have adapted their national STI management guidelines to a similar approach proposed by the WHO STI clinical guidelines, suggesting its popularity (5).

Of the STI syndromes, genital ulcer disease (GUD) carries one of the most significant disease burdens. In 2016 alone, 187 million people globally, or 5% of the world's population, had at least one episode of herpes simplex virus (HSV)-related GUD (6). On top of its high global incidence, GUD can have profound and long-lasting health impacts. Women acquiring primary HSV in the third trimester of pregnancy may result in congenital herpes, leading to neurocognitive problems, developmental delays, or infant death. Syphilis, another cause of GUD, can equally cause profound and long-lasting health impacts, especially for pregnant women and infants. Untreated pregnant women with syphilis have up to 70% chance of transmitting the disease to their foetus, and 40% of these pregnancies result in perinatal death (7). There is also an association between ulcerative STIs and the acquisition of HIV (8). While we have molecular-based tests that allow quick and convenient aetiological diagnosis of GUD to guide appropriate treatment in high-income countries, they are often not widely available in low- to middle-income countries. When available, point of care testing (POCT) is preferable as obtaining a diagnosis and targeted treatment on the same day can prevent further transmission during the time required before a result is available to tailor treatment of infected individuals (9).

While the 2001 WHO STI management guidelines for all STI syndromes was originally established with a “syndromic management” approach, the specific algorithm targeting GUD includes elements of both a syndromic approach (determined solely by the presence of an ulcer) and clinical diagnosis (clinical evaluation to determine the likely aetiology of the ulcer) before appropriate treatment is administered. The presence of vesicles or small ulcers with a history of recurrent vesicles would indicate necessary treatment for HSV, while the absence of the above would be an indication to treat for syphilis and chancroid.

A previous review published in 2000 evaluated the diagnostic accuracy of STI syndromic management (including five studies for GUD) (10). Since then, the underlying aetiology of GUD has changed [e.g., disappearance of chancroid as an important cause of GUD for many parts of the world (11) and the rise of HSV as the dominant aetiology (12)], and more accurate diagnostics using molecular assays are now available. Therefore, this systematic review aimed to update the evidence for the diagnostic accuracy of the currently used 2001 WHO guideline for the management of GUD. These findings were used to update the WHO guidelines for the management of symptomatic STIs (13).

Methods

The systematic review was conducted with the guidance of the Cochrane Handbook 5.1 (14). Eight databases (OvidSP Embase, OvidSP Global Heath, OvidSP Northern Light Life Sciences Conference Abstracts, Ebsco CINAHL Plus, Ebsco Africa-Wide Information, Clarivate Analytics Web of Science Core Collection, and BIREME/PAHO/WHO Virtual Health Library LILACS) were searched for papers published from 1995 until 11th January 2021. The systematic review was registered in PROSPERO (CRD42020153294).

Study Eligibility Criteria

We included studies with primary data (1) comparing clinical diagnosis of aetiological causes of GUD against laboratory-confirmed causes of GUD and (2) diagnostic accuracy of the GUD syndromic approach in detecting STIs. We included randomised controlled trials and observational studies. Studies were excluded if they contained no original data, included duplicated results from another study, were solely evaluating the diagnostic accuracy of laboratory aetiological diagnosis methods of GUD without comparison to clinical diagnosis methods or were studies restricting the study population to STI syndromes other than GUD.

Search Method and Data Extraction

The search was constructed using three concepts: (1) syndromic management; (2) genital ulcer disease; and (3) diagnostic accuracy. More details of the search strategy are presented in the Appendix. All citations identified by our searches were imported into EndNote X9 software. Once duplicates were identified and removed, two independent reviewers (ET, AL) screened the titles and abstracts, then the full-text of potentially relevant papers; discrepancies in screening were resolved by a third reviewer (JO). Relevant data were extracted from deduplicated full publications.

Statistical Analysis

To ensure consistency of a reference diagnostic, we pooled studies if they used a molecular assay to confirm the aetiology of GUD. We used hierarchical (multilevel) models using binomial data structures, i.e., hierarchical logistic regression model using STATA version 16 (StataCorp. 2019. Stata Statistical Software: Release 16. College Station, TX: StataCorp LLC). We reported the pooled sensitivity, specificity, positive and negative likelihood ratios, and diagnostic odds ratio. The positive likelihood ratio expresses how many times more likely people with the condition receive a positive test result than those who do not have the condition. In contrast, the negative likelihood ratio expresses how likely it is that people with the condition will receive a negative test result than those who do not have the condition. The inverse of the negative likelihood ratio (1/LR–) can be compared with the positive likelihood ratio to indicate whether the positive or negative test result has a greater impact on the odds of disease.

We also present the summary receiver operating characteristic (SROC) curve from the hierarchical summary receiver operating characteristic (HROC) model (15), the prediction region (i.e., for the forecast of the true sensitivity and specificity in a future study). Plotting the summary operating point and its confidence region allowed us to graphically display the trade-off between sensitivity and specificity. Forest plots were used to show within-study estimates and confidence intervals for sensitivity and specificity separately. We only included papers where true positives, false positives, true negatives, and false negatives could be calculated in the meta-analyses. Heterogeneity across estimates was assessed using the I2 statistic, and publication bias was evaluated using Deek's asymmetry test. To explain the effects of heterogeneity, univariable and multivariable meta-regression was conducted using the following variables: country income level, year of publication and recruitment site. Included studies were evaluated using the QUADAS-2 checklist (rather than Johanna Briggs Institute checklists as per PROSPERO research plan) as QUADAS-2 is the recommended checklist for diagnostics when using the GRADE approach (16). We assessed the certainty of the evidence using the GRADE (17, 18). We report our review following the preferred reporting items for systematic reviews and meta-analyses (PRISMA) guidelines (19).

Given that the positive and negative predictive value will depend on a pathogen's background prevalence, we present Supplementary Tables to show the effect of the pooled sensitivity and specificity on the number of missed and overtreated cases over a range of background prevalence.

Role of the Funding Source

The WHO funded the study and helped with the study design, analysis, interpretation of data, writing of the report, and the decision to submit the paper for publication.

Results

We found most countries adapted the 2001 WHO algorithm for GUD into their local contexts rather than following it strictly. In the absence of data that specifically evaluated the WHO algorithm, we included studies reporting the association between the accuracy of a clinical diagnosis (e.g., clinicians may use the presence of vesicular lesions as more suggestive of HSV) compared with laboratory-based STI diagnosis. Figure 1 presents the PRISMA flowchart. Of 24,857 articles, 151 full texts were examined, and 29 included in the analysis: 17 studies examined the accuracy of a clinical diagnosis, and 12 studies examined the accuracy of the presence of GUD compared with laboratory-based STI diagnosis. Table 1 summarises the characteristics of included studies. Most studies were published before 2010, from middle-income countries, and patients were recruited primarily from sexual health clinics.

FIGURE 1
www.frontiersin.org

Figure 1. PRISMA flowchart.

TABLE 1
www.frontiersin.org

Table 1. Summary of included studies.

Diagnostic Accuracy of Clinical Diagnosis of GUD for Detection of STIs

Any STI

Only one study provided two estimates (Supplementary Table 1).

Herpes

To arrive at a presumptive diagnosis of herpes based on clinical evaluation among individuals with GUD, 15/29 studies provided 20 estimates, and 9 studies provided 12 estimates for the meta-analysis (Supplementary Table 2). The pooled sensitivity for detecting herpes through clinical diagnosis was 43.5% (95% CI: 26.2-62.4, I2 = 86.7), and pooled specificity was 88.0% (95% CI: 67.0–96.3, I2 = 95.8) (Figure 2). The diagnostic odds ratio was 5.63 (95% CI: 3.04–10.43). The positive likelihood ratio was 3.62 (95% CI: 1.74–7.54), and the negative likelihood ratio was 0.64 (95% CI: 0.53–0.78). The inverse negative likelihood ratio was 1.56 (95% CI: 1.28–1.90). The number of missed and overtreated cases over different background prevalence is in Supplementary Table 3. The summary receiver operating curve is in Supplementary Figure 1.

FIGURE 2
www.frontiersin.org

Figure 2. Forest plot of the sensitivity and specificity of clinical diagnosis to detect herpes simplex virus in genital ulcer disease.

Syphilis

To arrive at a presumptive diagnosis of syphilis based on clinical evaluation, 15/29 studies provided 22 estimates, and 8 studies provided 11 estimates for the meta-analysis (Supplementary Table 4). The pooled sensitivity for detecting syphilis through clinical diagnosis was 72.8% (95% CI: 51.4–87.1, I2 = 93.3), with the pooled specificity being 76.4% (95% CI: 45.4–92.6, I2 = 98.7) (Figure 3). The diagnostic odds ratio is 8.65 (95% CI: 3.20–23.38). The positive likelihood ratio is 3.08 (95% CI: 1.27–7.46), and negative likelihood ratio is 0.36 (95% CI: 0.21–0.60). The inverse of the negative likelihood ratio is 2.81 (95% CI: 1.68–4.69). The number of missed and overtreated cases over different background prevalence is in Supplementary Table 5. The summary receiver operating curve is in Supplementary Figure 2.

FIGURE 3
www.frontiersin.org

Figure 3. Forest plot of the sensitivity and specificity of clinical diagnosis to detect syphilis in genital ulcer disease.

Chancroid

To arrive at a presumptive diagnosis of Haemophilus ducreyi based on clinical evaluation, 13/29 studies provided 18 estimates, and 7 studies provided 10 estimates for pooling (Supplementary Table 6). The pooled sensitivity for detecting chancroid using clinical diagnosis was 71.9% (95% CI: 45.9–88.5, I2 = 89.9%), and pooled specificity was 53.1% (95% CI: 36.6–68.9, I2 = 92.4%) (Figure 4). The diagnostic odds ratio was 2.89 (95% CI: 1.34–6.23). The positive likelihood ratio was 1.53 (95% CI: 1.19–1.97), and the negative likelihood ratio was 0.53 (95% CI: 0.29–0.97). The inverse negative likelihood ratio was 1.89 (95% CI: 1.03–3.45). The number of missed and overtreated cases over different background prevalence is in Supplementary Table 7. The summary receiver operating curve is in Supplementary Figure 3.

FIGURE 4
www.frontiersin.org

Figure 4. Forest plot of the sensitivity and specificity of clinical diagnosis to detect chancroid in genital ulcer disease.

The diagnostic accuracy of using clinical diagnosis to identify herpes translates to 17 missed cases, and eight treated unnecessarily in a population with a 30% prevalence of herpes (Supplementary Table 8). The certainty of the evidence is high because the studies were at low risk of bias (Supplementary Table 9), the statistical testing that was undertaken suggested no evidence of publication bias (Supplementary Figure 4), and although there was high heterogeneity, the confidence intervals around the estimates were not wide.

The test accuracy of using clinical diagnosis to identify syphilis translates to 3 missed cases, and 27 treated unnecessarily in a population with a 5% baseline prevalence of syphilis (Supplementary Table 10). The certainty of the evidence is moderate because there was high heterogeneity leading to wide confidence intervals around the estimates, but the risk of bias of the included studies was low (Supplementary Table 9), and the statistical testing that was undertaken suggested no evidence of publication bias (Supplementary Figure 5).

The test accuracy of using clinical diagnosis to identify chancroid translates to 4 missed cases, and 45 treated unnecessarily in a population with a 5% baseline prevalence of chancroid (Supplementary Table 11). The certainty of the evidence is moderate because there was high heterogeneity leading to wide confidence intervals around the estimates, but the risk of bias of the included studies was low (Supplementary Table 9), and the statistical testing that was undertaken suggested no evidence of publication bias (Supplementary Figure 6).

Meta-regression (Supplementary Tables 15–20) showed that country income level was significantly associated with the sensitivity and specificity of using clinical diagnosis to detect herpes and syphilis, and the publication year for the specificity of using clinical diagnosis to detect herpes and syphilis. The variables (country income level, year of publication, and recruitment site) included in the multivariable meta-regression models collectively explained up to 80% of the between-study variance for sensitivity and specificity across all aetiologies.

Discussion

This systematic review and meta-analysis consolidate the published evidence of the effectiveness of syndromic management of GUD. The current WHO GUD algorithm contains decision points where clinical decisions must be made to offer HSV management or treat syphilis and chancroid (4). Our findings demonstrate that attempts to distinguish major pathogens clinically are unreliable—with low pooled sensitivity and relatively high pooled specificity. This could be attributed to the similarities between the clinical appearances of the various causes of GUD, the presence of mixed infections and atypical presentations (such as atypical clinical ulceration due to long-standing disease) (2022). However, we also observed heterogeneity in the sensitivities and specificities, which might indicate that the accuracy of clinical diagnosis may depend on factors beyond those assessed in our meta-regression, such as clinician skill and experience, or other practise-specific factors. Similarly, the diagnostic accuracy of a pure syndromic approach to GUD, also found poor sensitivities in detecting the aetiological causes of GUD (Supplementary Tables 12–14).

Despite the poor diagnostic accuracy of clinical diagnosis methods and syndromic approaches to GUD management, these approaches still have a place in many settings. This is in light of various shortcomings associated with aetiological laboratory diagnosis methods. First, skilled personnel and quality assured laboratory equipment are needed. For example, multiplex PCR, one of the diagnostic tests for ulcers, is costly, technically sophisticated, time-consuming and rarely accessible in resource-limited settings. Second, as results for aetiological laboratory diagnosis methods are often unavailable the same day, additional patient follow up may be required to discuss results and subsequent treatment. However, this can be challenging when there is often high loss to follow up rates in the management of STIs due to poor awareness and fear of social stigma attached with STIs (23). Finally, there are limitations with currently available laboratory aetiological diagnostic tools. For example, syphilis serology tests may be falsely negative in early syphilitic ulcers (24). Similarly, darkfield microscopy may be relatively insensitive for the detection of syphilis (24), although it is still used in specialist sexual health services today. These missed cases may result in significant morbidity, mortality and onward transmission of the disease.

Therefore, in the absence of access to molecular-based testing and/or results on the same day, having a syndromic management algorithm is preferable to no management for people presenting with GUD (25). A syndromic management algorithm enables healthcare providers to come to a probable diagnosis and provide treatment on the same day without special skills or sophisticated and costly laboratory testing. In several countries, it was found that syndromic management offered adequate treatment for patients with GUD (25, 26). The syndromic management approach has been reported to be cost-saving or cost-effective and thus more easily implemented in settings where funding is an issue. However, most economic evaluations were performed more than 15 years ago in Peru (27), China (28), Taiwan (29) and sub-Saharan Africa (30). There is an urgent need for updated economic evaluations for the syndromic management of GUD.

When using syndromic management of GUD, one must be mindful of its limitations. In a case series of patients with GUD in India, a significant proportion of cases (34%, 24/71) classified and treated HSV using syndromic management were found to be VDRL positive (and would have been left untreated if they had not had lab testing) (31). Another example was from China, where a modified WHO GUD algorithm was used, i.e., patients with either recurrent, vesicular or painful ulcers were considered to have herpes (32). Overall, this led to an overdiagnosis of herpes and underdiagnosis of syphilis as not all painful or recurrent ulcers necessarily indicated an aetiology of herpes, and this excluded the presence of syphilis. This highlights the difficulties in algorithms requiring clinical judgment to distinguish the likely pathogen(s); syphilitic chancres and HSV ulcers can present atypically (33, 34). Overdiagnosis may be an issue in communities where STIs are still heavily associated with societal stigma (35). A wrong diagnosis may put the patient through unnecessary stress and can perpetuate STI-related stigma. There is also a potential for the loss of confidence in the healthcare system amongst patients inappropriately managed, which might discourage them from seeking medical help for future STI-related presentations and allowing undiagnosed STIs to spread throughout the community. Another critical point is that the syndromic approach may not significantly reduce the prevalence of STIs at a population level due to most STIs being asymptomatic. For example, in Kenya and Peru, implementation of the syndromic approach did not lead to significant reductions in the prevalence of STIs (36, 37).

The acceptability of syndromic management is mixed among clinicians [acceptable in Peru (36), Pakistan (38), but not in Namibia (39), and Karachi (40)] and patients [acceptable in Tanzania (41), but not in Rwanda (42)]. A study where standardised simulated patients visited pharmacies in Tanzania reported challenges for adequately managing GUD syndromes (43). Pharmacy staff in The Gambia were willing to offer syndromic management, but none of the simulated patients with GUD would be treated appropriately (44). There are also reports of inadequately following syndromic management guidelines. For example, interviews of healthcare workers from 240 healthcare facilities in six countries in West Africa found suboptimal STI management with effective treatment given to only 14% of patients (45). Although there was a high volume of potential STIs seen in community pharmacies, none of the 85 head pharmacists from South Africa correctly identified the treatment for genital ulcers (46).

Our findings have implications for future algorithms of syndromic management of GUD. As our meta-analysis noted that the clinical diagnosis to distinguish between herpes and syphilis is not sensitive enough, new GUD algorithms should consider offering management for syphilis and herpes for any patient with GUD, particularly in settings where syphilis prevalence is high. The trade-off between overtreatment and not missing cases may be appropriate in settings and populations where missing syphilis cases must be avoided (e.g., pregnant women). It can also be argued that although overtreatment can contribute to antimicrobial resistance development, there is less concern for syphilis or herpes; to date, there has been no documented syphilis resistance to penicillin. Second, strategic use of Point of Care Testing (POCT) within the algorithm can improve diagnostic accuracy. For example, when GUD diagnostic algorithms in Rwanda included an RPR test, overtreatment for syphilis reduced from 72.1 to 7.7% (25). There are also qualitative real-time PCR (qPCR) assays for detecting HSV-1, HSV-2, Varicella zoster virus (VZV), and Treponema pallidum with excellent sensitivities and specificities (47). However, the cost-effectiveness of incorporating PCR into GUD algorithms has not yet been evaluated for use in resource-poor countries. Third, as the aetiology of GUD can change over time [e.g., disappearance of chancroid as an important cause of GUD for many parts of the world (11) and rise of HSV as the dominant aetiology (12)], periodic monitoring of the underlying aetiology of GUD can help provide locally relevant guidance for syndromic management. In addition, the routine treatment for other less common causes of GUD (e.g., lymphogranuloma venereum) may be considered based on local STI prevalence rates.

Our findings should be read in light of several limitations. First, among the included studies in our meta-analysis, most participants were recruited from sexual health clinics, which means the results may not apply to other populations or settings where clinicians may be less skilled in managing GUD. Second, as studies were cross-sectional, we could not assess the temporal association between symptoms and STIs. Third, reference laboratory tests in studies included in the meta-analysis were not similar in their specificities and sensitivities, potentially contributing to the heterogeneity noted in our meta-analyses. For example, while the culture of chancroid is highly specific, its sensitivity is poor (48). HSV specific serologic assays can also have variable sensitivity and specificity, and may not be the temporal cause of GUD (49). Syphilis serology tests without concurrent molecular testing may miss early syphilis. Another factor to consider is how untested pathogens (e.g., lymphogranuloma venereum) could cause anogenital ulceration, even though they are less common. Last, most included studies were published before 2010. If there has been improvements in clinicians' ability to determine the aetiology of GUD through better training, our estimates may be an underestimate of the accuracy of this approach. However, there is evidence of the challenge to determine the aetiology of GUD using a clinical approach, even for highly trained sexual health specialist in a high-income country (50).

Algorithms requiring a clinical diagnosis to determine and treat the aetiology of GUD have poor sensitivities for syphilis and HSV, resulting in significant numbers of missed cases. A pure syndromic approach to GUD can also miss asymptomatic STIs or misdiagnose non-STI related GUD as STIs. These results can inform guideline recommendations by weighing the benefits, harms, costs, acceptability and feasibility of implementing algorithms for GUD. Moving forward, there is an urgent need to improve access to affordable and efficient diagnostics (e.g., POCTs) to be incorporated into GUD algorithms to better guide appropriate management.

Data Availability Statement

The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding author/s.

Author Contributions

JO, TW, PM, and NS designed the research study. JF conducted the search strategy. AL, ET, and JO conducted the screening, data extraction, and wrote the first draft of the paper. JO, AL, ET, RO-A, NS, and EC analysed the data. PM and RO-A interpreted the data. All authors have read and approved the final manuscript.

Funding

The World Health Organization funded the study and helped with the study design, analysis, interpretation of data, writing of the report, and the decision to submit the paper for publication. JO and EC were supported by the Australian National Health and Medical Research Council (NHMRC) Emerging Leadership Investigator Grant (GNT1193955 and GNT1172873).

Conflict of Interest

RO-A is a current employee of Roche Products Ltd., UK. The views expressed in this article are his own and do not represent that of his employers.

The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fmed.2021.806605/full#supplementary-material

References

1. Rowley J, Vander Hoorn S, Korenromp E, Low N, Unemo M, Abu-Raddad LJ, et al. Chlamydia, gonorrhoea, trichomoniasis and syphilis: global prevalence and incidence estimates, 2016. Bull World Health Organ. (2019) 97:548–62. doi: 10.2471/BLT.18.228486

PubMed Abstract | CrossRef Full Text | Google Scholar

2. World Health Organization. Global Health Sector Strategy on Sexually Transmitted Infections 2016–2021. Available online at: http://apps.who.int/iris/bitstream/10665/246296/1/WHO-RHR-16.09-eng.pdf?ua=1 (accessed October 23, 2021).

Google Scholar

3. Mayaud P, Mabey D. Approaches to the control of sexually transmitted infections in developing countries: old problems and modern challenges. Sex Transm Infect. (2004) 80:174–82. doi: 10.1136/sti.2002.004101

PubMed Abstract | CrossRef Full Text | Google Scholar

4. World Health Organization. Guidelines for the Management of Sexually Transmitted Infections. Available online at: https://www.who.int/hiv/topics/vct/sw_toolkit/guidelines_management_sti.pdf?ua=1 (accessed Feb 13, 2021).

Google Scholar

5. World Health Organization. Progress Report of the Implementation of the Global Strategy for Prevention and Control of Sexually Transmitted Infections: 2006–2015: Document for the World Health Assembly. Geneva (2015).

Google Scholar

6. Looker KJ, Johnston C, Welton NJ, James C, Vickerman P, Turner KME, et al. The global and regional burden of genital ulcer disease due to herpes simplex virus: a natural history modelling study. BMJ Glob Health. (2020) 5:e001875. doi: 10.1136/bmjgh-2019-001875

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Krüger C, Malleyeck I. Congenital syphilis: still a serious, under-diagnosed threat for children in resource-poor countries. World J Pediatr. (2010) 6:125–31. doi: 10.1007/s12519-010-0028-z

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Cohen MS, Council OD, Chen JS. Sexually transmitted infections and HIV in the era of antiretroviral treatment and prevention: the biologic basis for epidemiologic synergy. J Int AIDS Soc. (2019) 22(Suppl. 6):e25355. doi: 10.1002/jia2.25355

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Gaydos C, Hardick J. Point of care diagnostics for sexually transmitted infections: perspectives and advances. Expert Rev Anti Infect Ther. (2014) 12:657–72. doi: 10.1586/14787210.2014.880651

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Pettifor A, Walsh J, Wilkins V, Raghunathan P. How effective is syndromic management of STDs?: a review of current studies. Sex Transm Dis. (2000) 27:371–85. doi: 10.1097/00007435-200008000-00002

PubMed Abstract | CrossRef Full Text | Google Scholar

11. González-Beiras C, Marks M, Chen CY, Roberts S, Mitjà O. Epidemiology of Haemophilus ducreyi infections. Emerg Infect Dis. (2016) 22:1–8. doi: 10.3201/eid2201.150425

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Paz-Bailey G, Ramaswamy M, Hawkes SJ, Geretti AM. Herpes simplex virus type 2: epidemiology and management options in developing countries. Sex Transm Infect. (2007) 83:16–22. doi: 10.1136/sti.2006.020966

PubMed Abstract | CrossRef Full Text | Google Scholar

13. World Health Organization. Guidelines for the Management of Symptomatic Sexually Transmitted Infections 2021 Geneva. Available online at: https://www.ncbi.nlm.nih.gov/pubmed/34370424 (accessed October 23, 2021).

14. Cochrane Handbook for Systematic Reviews of Interventions version 5.1. Available online at: https://training.cochrane.org/handbook (accessed April 5, 2019).

15. Rutter CM, Gatsonis CA. A hierarchical regression approach to meta-analysis of diagnostic test accuracy evaluations. Stat Med. (2001) 20:2865–84. doi: 10.1002/sim.942

PubMed Abstract | CrossRef Full Text | Google Scholar

16. University of Bristol. QUADAS-2. Available online at: https://www.bristol.ac.uk/population-health-sciences/projects/quadas/quadas-2/ (accessed May 25, 2021).

17. Schunemann HJ, Mustafa RA, Brozek J, Steingart KR, Leeflang M, Murad MH, et al. GRADE guidelines: 21 part 1. Study design, risk of bias, and indirectness in rating the certainty across a body of evidence for test accuracy. J Clin Epidemiol. (2020) 122:129–41. doi: 10.1016/j.jclinepi.2019.12.020

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Schunemann HJ, Mustafa RA, Brozek J, Steingart KR, Leeflang M, Murad MH, et al. GRADE guidelines: 21 part 2. Test accuracy: inconsistency, imprecision, publication bias, and other domains for rating the certainty of evidence and presenting it in evidence profiles and summary of findings tables. J Clin Epidemiol. (2020) 122:142–52. doi: 10.1016/j.jclinepi.2019.12.021

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ. (2009) 339:b2535. doi: 10.1136/bmj.b2535

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Beyrer C, Jitwatcharanan K, Natpratan C, Kaewvichit R, Nelson KE, Chen C-Y, et al. Molecular methods for the diagnosis of genital ulcer disease in a sexually transmitted disease clinic population in northern Thailand: predominance of herpes simplex virus infection. J Infect Dis. (1998) 178:243–6. doi: 10.1086/515603

PubMed Abstract | CrossRef Full Text | Google Scholar

21. DiCarlo RP, David H DH. The clinical diagnosis of genital ulcer disease in men. Clin Infect Dis. (1997) 25:292–8. doi: 10.1086/514548

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Sanchez J, Volquez C, Totten PA, Campos PE, Ryan C, Catlin M, et al. The etiology and management of genital ulcers in the Dominican Republic and Peru. Sex Transm Dis. (2002) 29:559–67. doi: 10.1097/00007435-200210000-00001

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Tsadik M, Berhane Y, Worku A, Terefe W. The magnitude of, and factors associated with, loss to follow-up among patients treated for sexually transmitted infections: a multilevel analysis. BMJ Open. (2017) 7:e016864. doi: 10.1136/bmjopen-2017-016864

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Behets F-T, Brathwaite AR, Hylton-Kong T, Chen C-Y, Hoffman I, Weiss J, et al. Genital ulcers: etiology, clinical diagnosis, and associated human immunodeficiency virus infection in Kingston, Jamaica. Clin Infect Dis. (1999) 28:1086–90. doi: 10.1086/514751

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Bogaerts J, Vuylsteke B, Tello WM, Mukantabana V, Akingeneye J, Laga M, et al. Simple algorithms for the management of genital ulcers: evaluation in a primary health care centre in Kigali, Rwanda. Bullet World Health Organiz. (1995) 73:761–7.

PubMed Abstract | Google Scholar

26. Behets FM, Brathwaite AR, Hylton-Kong T, Chen CY, Hoffman I, Weiss JB, et al. Genital ulcers: etiology, clinical diagnosis, and associated human immunodeficiency virus infection in Kingston, Jamaica. Clin Infect Dis. (1999) 28:1086–90.

PubMed Abstract | Google Scholar

27. Adams EJ, Garcia PJ, Garnett GP, Edmunds WJ, Holmes KK. The cost-effectiveness of syndromic management in pharmacies in Lima, Peru. Sex Transm Dis. (2003) 30:379–87. doi: 10.1097/00007435-200305000-00002

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Liu H, Jamison D, Li X, Ma E, Yin Y, Detels R. Is syndromic management better than the current approach for treatment of STDs in China? Evaluation of the cost-effectiveness of syndromic management for male STD patients. Sex Transm Dis. (2003) 30:327–30. doi: 10.1097/00007435-200304000-00010

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Tsai CH, Lee TC, Chang HL, Tang LH, Chiang CC, Chen KT. The cost-effectiveness of syndromic management for male sexually transmitted disease patients with urethral discharge symptoms and genital ulcer disease in Taiwan. Sex Transm Infect. (2008) 84:400–4. doi: 10.1136/sti.2007.028829

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Vickerman P, Ndowa F, Mayaud P. Modelling the cost per ulcer treated of incorporating episodic treatment for HSV-2 into the syndromic algorithm for genital ulcer disease. Sex Transm Infect. (2008) 84:243–8. doi: 10.1136/sti.2007.027136

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Bhavsar C, Patel RM, Marfatia Y. A study of 113 cases of genital ulcerative disease and urethral discharge syndrome with validation of syndromic management of sexually transmitted diseases. Indian J Sex Transm Dis AIDS. (2014) 35:35–9. doi: 10.4103/0253-7184.132426

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Wang Q-Q, Mabey D, Peeling RW, Tan M-L, Jian D-M, Yang P, et al. Validation of syndromic algorithm for the management of genital ulcer diseases in China. Int J STD AIDS. (2002) 13:469–74. doi: 10.1258/09564620260079626

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Ramoni S, Genovese G, Pastena A, Casazza G, Lunghi G, Marzano AV, et al. Clinical and laboratory features of 244 men with primary syphilis: a 5-year single-centre retrospective study. Sex Transm Infect. (2021) 97:479–84. doi: 10.1136/sextrans-2020-054705

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Fast MV, D'Costa LJ, Nsanze H, Piot P, Curran J, Karasira P, et al. The clinical diagnosis of genital ulcer disease in men in the tropics. Sex Transm Dis. (1984) 11:72–6. doi: 10.1097/00007435-198404000-00004

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Hood JE, Friedman AL. Unveiling the hidden epidemic: a review of stigma associated with sexually transmissible infections. Sex Health. (2011) 8:159–70. doi: 10.1071/SH10070

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Garcia PJ, Holmes KK, Carcamo CP, Garnett GP, Hughes JP, Campos PE, et al. Prevention of sexually transmitted infections in urban communities (Peru PREVEN): a multicomponent community-randomised controlled trial. Lancet. (2012) 379:1120–8. doi: 10.1016/S0140-6736(11)61846-1

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Johnson LF, Dorrington RE, Bradshaw D, Coetzee DJ. The effect of syndromic management interventions on the prevalence of sexually transmitted infections in South Africa. Sexual Reprod Healthc. (2011) 2:13–20. doi: 10.1016/j.srhc.2010.08.006

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Khandwalla HE, Luby S, Rahman S. Knowledge, attitudes, and practices regarding sexually transmitted infections among general practitioners and medical specialists in Karachi, Pakistan. Sex Transm Infect. (2000) 76:383–5. doi: 10.1136/sti.76.5.383

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Iipinge SN, Pretorius L. The delivery and quality of sexually transmitted infections treatment by private general practitioners in Windhoek Namibia. Glob J Health Sci. (2012) 4:156–71. doi: 10.5539/gjhs.v4n5p156

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Mahmood MA, Saniotis A. Use of syndromic management algorithm for sexually transmitted infections and reproductive tract infections management in community settings in Karachi. J Pak Med Assoc. (2011) 61:453–7.

PubMed Abstract | Google Scholar

41. Grosskurth H, Mwijarubi E, Todd J, Rwakatare M, Orroth K, Mayaud P, et al. Operational performance of an STD control programme in Mwanza Region, Tanzania. Sex Transm Infect. (2000) 76:426–36. doi: 10.1136/sti.76.6.426

PubMed Abstract | CrossRef Full Text | Google Scholar

42. Steen R, Soliman C, Mujyambwani A, Twagirakristu JB, Bucyana S, Grundmann C, et al. Notes from the field: practical issues in upgrading STD services based on experience from primary healthcare facilities in two Rwandan towns. Sex Transm Infect. (1998) 74(Suppl. 1):S159–65.

PubMed Abstract | Google Scholar

43. Garcia PJ, Gotuzzo E, Hughes JP, Holmes KK. Syndromic management of STDs in pharmacies: evaluation and randomised intervention trial. Sex Transm Infect. (1998) 74(Suppl. 1):S153–8.

PubMed Abstract | Google Scholar

44. Leiva A, Shaw M, Paine K, Manneh K, McAdam K, Mayaud P. Management of sexually transmitted diseases in urban pharmacies in The Gambia. Int J STD AIDS. (2001) 12:444–52. doi: 10.1258/0956462011923471

PubMed Abstract | CrossRef Full Text | Google Scholar

45. Bitera R, Alary M, Masse B, Viens P, Lowndes C, Baganizi E, et al. [Quality of disease management of sexually transmitted diseases: investigation of care in six countries in West Africa]. Sante. (2002) 12:233–9.

46. Ward K, Butler N, Mugabo P, Klausner J, McFarland W, Chen S, et al. Provision of syndromic treatment of sexually transmitted infections by community pharmacists: a potentially underutilized HIV prevention strategy. Sex Transm Dis. (2003) 30:609–13. doi: 10.1097/01.OLQ.0000079521.04451.10

PubMed Abstract | CrossRef Full Text | Google Scholar

47. SpeedX. Plex PCR VHS. Available online at: https://plexpcr.com/products/sexually-transmitted-infections/plexpcr-vhs/ (accessed May 25, 2021).

48. Van Dyck E, Piot P. Laboratory techniques in the investigation of chancroid, lymphogranuloma venereum and donovanosis. Genitourin Med. (1992) 68:130–3. doi: 10.1136/sti.68.2.130

PubMed Abstract | CrossRef Full Text | Google Scholar

49. Koutsky LA, Stevens CE, Holmes KK, Ashley RL, Kiviat NB, Critchlow CW, et al. Underdiagnosis of genital herpes by current clinical and viral-isolation procedures. N Engl J Med. (1992) 326:1533–9. doi: 10.1056/NEJM199206043262305

PubMed Abstract | CrossRef Full Text | Google Scholar

50. Towns JM, Leslie DE, Denham I, Azzato F, Fairley CK, Chen M. Painful and multiple anogenital lesions are common in men with Treponema pallidum PCR-positive primary syphilis without herpes simplex virus coinfection: a cross-sectional clinic-based study. Sex Transm Infect. (2016) 92:110–5. doi: 10.1136/sextrans-2015-052219

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: genital ulcer disease, herpes, syphilis, syndromic algorithm, systematic review and meta-analysis, chancroid

Citation: Loh AJW, Ting EL, Wi TE, Mayaud P, Chow EPF, Santesso N, Falconer J, Ofori-Asenso R and Ong JJ (2022) The Diagnostic Accuracy of Syndromic Management for Genital Ulcer Disease: A Systematic Review and Meta-Analysis. Front. Med. 8:806605. doi: 10.3389/fmed.2021.806605

Received: 01 November 2021; Accepted: 13 December 2021;
Published: 03 January 2022.

Edited by:

Longxiang Su, Peking Union Medical College Hospital (CAMS), China

Reviewed by:

William R. Faber, Amsterdam University Medical Center, Netherlands
Alejandro Piscoya, Saint Ignatius of Loyola University, Peru

Copyright © 2022 Loh, Ting, Wi, Mayaud, Chow, Santesso, Falconer, Ofori-Asenso and Ong. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Jason J. Ong, Jason.ong@monash.edu

These authors have contributed equally to this work and share first authorship

Download