Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Estimating recent HIV incidence among young men who have sex with men: Reinvigorating, validating and implementing Osmond's algorithm for behavioral imputation

  • Frits van Griensven ,

    Contributed equally to this work with: Frits van Griensven, Philip A. Mock

    Roles Conceptualization, Methodology, Writing – original draft

    fritsvg@trcarc.org

    Affiliations Thai Red Cross AIDS Research Center, Bangkok, Thailand, UCSF Department of Epidemiology and Biostatistics, San Francisco, CA, United States of America

  • Philip A. Mock ,

    Contributed equally to this work with: Frits van Griensven, Philip A. Mock

    Roles Conceptualization, Formal analysis, Methodology, Writing – review & editing

    Affiliation Thailand Ministry of Public Health–US Centers for Disease Control and Prevention Collaboration, Nonthaburi, Thailand

  • Patchara Benjarattanaporn,

    Roles Conceptualization, Funding acquisition, Writing – review & editing

    Affiliation UNAIDS, Bangkok, Thailand

  • Nakorn Premsri,

    Roles Funding acquisition, Project administration, Writing – review & editing

    Affiliation Global Fund Principal Recipient Office, Department of Disease Control, Ministry of Public Health, Nonthaburi, Thailand

  • Warunee Thienkrua,

    Roles Investigation, Methodology, Writing – review & editing

    Affiliation Thailand Ministry of Public Health–US Centers for Disease Control and Prevention Collaboration, Nonthaburi, Thailand

  • Keith Sabin,

    Roles Conceptualization, Methodology, Writing – review & editing

    Affiliation UNAIDS, Geneva, Switzerland

  • Anchalee Varangrat,

    Roles Investigation, Project administration, Writing – review & editing

    Affiliation Thailand Ministry of Public Health–US Centers for Disease Control and Prevention Collaboration, Nonthaburi, Thailand

  • Jinkao Zhao,

    Roles Conceptualization, Methodology, Writing – review & editing

    Affiliation Global Fund to Fight AIDS, Tuberculosis and Malaria, Geneva, Switzerland

  • Anupong Chitwarakorn,

    Roles Investigation, Supervision, Writing – review & editing

    Affiliation Thailand Ministry of Public Health–US Centers for Disease Control and Prevention Collaboration, Nonthaburi, Thailand

  • Wolfgang Hladik

    Roles Conceptualization, Methodology, Writing – review & editing

    Affiliation US Centers for Disease Control and Prevention, Atlanta, GA, United States of America

Abstract

HIV incidence information is essential for epidemic monitoring and evaluating preventive interventions. However, reliable HIV incidence data is difficult to obtain, especially among marginalized populations, such as young men who have sex with men (YMSM). Here we evaluate the reliability of an alternative HIV incidence assessment method, behavioral imputation, as compared to serologically estimated HIV incidence. Recent HIV incidence among YMSM (aged 18 to 21 and 18 to 24 years) enrolled in a cohort study in Bangkok from 2006 to 2014 was estimated using two mid-point methods for seroconversion: 1) between age of first anal intercourse and first HIV-positive test (without previous HIV-negative test) (behavioral imputation) and 2) between the date of last negative and first positive HIV test (serological estimation). Serologically estimated HIV incidence was taken as the “gold standard” to evaluate between-method agreement. At baseline, 314 YMSM age 18 to 21 years accumulated 674 person-years (PY) of follow-up since first anal intercourse. Considering that 50 men had prevalent HIV infection, the behaviorally imputed HIV incidence was 7.4 per 100 PY. Of the remaining 264 HIV-negative men, 54 seroconverted for HIV infection during the study, accumulating 724 PY of follow-up and a serologically estimated HIV incidence of 7.5 per 100 PY. At baseline, 712 YMSM age 18 to 24 years (including 18 to 21-year-old men analyzed above) accumulated 2143 PY of follow-up since first anal intercourse. Considering that 151 men had prevalent HIV infection, the behaviorally imputed HIV incidence was 7.0 per 100 PY. Of the remaining 561 HIV-negative men, 125 seroconverted for HIV infection during the study, accumulating 1700 PY of follow-up and a serologically estimated HIV incidence of 7.4 per 100 PY. Behavioral imputation and serological estimation are in good agreement when estimating recent HIV incidence in YMSM.

Introduction

More than thirty years into the HIV epidemic, simple, affordable and reliable methods to estimate recent HIV incidence in populations at risk are not available. Recently, this inadequacy has become particularly salient against the background of increasing HIV prevalence observed in young people, especially in young men who have sex with men (YMSM) [1]. For socio-cultural and legal reasons, collection of repeated cross-sectional and prospective serological specimens at younger ages for HIV incidence monitoring is difficult. As a result, such specimens are rarely available, especially of those younger than 21 years of age. Cohort studies provide the best measures of risk and HIV incidence, while taking in account accrual and loss-to-follow-up. In addition, such studies allow causal inference and risk factor assessment for incident HIV infection. However, cohort studies are costly, labor and participant intensive, logistically difficult to implement and sustain, and require clinical infrastructure and an enabling environment. Since incident HIV infection is a relatively rare event, large sample-sizes are needed, while infection is known to occur more often in those not-enrolled or lost-to-follow-up. Nevertheless, cohort studies are essential in guiding and powering HIV intervention studies and in monitoring the overall course of the HIV epidemic. Because of these difficulties, HIV incidence estimates are usually derived from mathematical models [2, 3], or from laboratory methods using increasing and decreasing HIV immune responses to decide on recency of infection [4]. Similarly, epidemic monitoring usually relies on cross-sectional data, such as HIV and AIDS case reports and behavioral and biological surveillance in key populations. While this information is important, uncertainty remains about recency of infection and time-order of events and often data are not age-disaggregated or those of younger ages are under-represented or ineligible. Methods for estimating HIV incidence from cross-sectional data, HIV prevalence surveys or service data have been proposed, including mathematical model-based approaches utilizing a single prevalence survey in near stable conditions [57]. Or more generally, incorporating historical data on changes in HIV prevalence and AIDS mortality [8], or from two prevalence surveys in the same population at two different time-points [9, 10]. A related approach is to create an artificial cohort from repeated HIV prevalence surveys along with mortality data to estimate HIV incidence while accounting for population dynamics [11]. If mortality data are not available, the use of the incubation time distribution to AIDS and death may be used as a proxy for this information [11, 12]. Another method is to utilize information from linkable repeat HIV testing and counseling attendees to create an open cohort of persons at risk for HIV infection [1315]. Recent enhancements to laboratory testing include antibody avidity evaluation and prior HIV testing history, CD4+ cell counts and HIV RNA viral load levels to account for false-recent HIV- positives [4, 1618]. Some of these alternative methods have been compared for agreement [10, 15]. In daily practice and outside of controlled situations, the predictive value and external validity of available HIV incidence methods have been limited and their use unsuccessful.

During the early 1990s, Osmond and colleagues [19], developed and applied an algorithm for behavioral imputation of person years (PY) of follow-up since first anal intercourse exposure to derive HIV incidence among YMSM prior to enrollment in the San Francisco Young Men’s Health Study (SFYMHS). This method, hereafter called Osmond’s Algorithm (OA), calculated the total number of PY since age at start of anal sexual intercourse and study baseline across all subjects. HIV incidence density was then estimated by dividing the number of HIV-infected YMSM at study entry by this number, times 100. While the behaviorally estimated HIV incidence prior to study entry was equal to its serologically derived equivalent during follow-up (2.6 versus 2.7 per 100 PY), follow-up time was limited (one year) and the number of accumulated PY (n = 192) and new HIV infections small (n = 5) [19]. The non-availability of prospective serological specimens from YMSM is probably one of the main reasons why OA’s reliability has not been further evaluated. Nevertheless, OA was successfully (but of unknown reliability) applied to YMSM in Amsterdam, The Netherlands in 1997 [20], in Bangkok, Thailand from 2003 to 2007 [21], in six cities in China in 2010 [22] and in adjusted fashion to YMSM across the continental United States and Puerto Rico in 2013 [23]. To assess the reliability of OA to estimate recent HIV incidence in YMSM compared to conventional prospective cohort study serology, we applied both methods in parallel against YMSM 18 to 21 and 18 to 24 years old enrolled in the Bangkok men who have sex with men cohort study (BMCS) [2426]. As part of the BMCS, behavioral and serological data were collected simultaneously in the context of high HIV incidence in YMSM between 2006 and 2014, providing a robust number of existing and new HIV infections to evaluate agreement between the two methods.

Materials and methods

Study population and sampling

From April 6, 2006, to Dec 31, 2010, 1977 MSM were screened, 1764 (89.2%) were found eligible, and 1744 (88.2%) were enrolled. Of these latter men, 314 (18.0%) were 18 to 21 and 712 (40.8%) were 18 to 24 years. The goal of the BCMS was to determine prevalence and incidence of HIV infection and associated factors in MSM in preparation for HIV prevention trials. The study was conducted at the Silom Community Clinic, an integrated research and services facility for MSM, located in a Bangkok inner city hospital. Eligible men were 18 years or older, Thai nationals, residents of the greater Bangkok metropolitan area, had male-to-male penetrative anal or oral sex in the past six months, and were available for 4-monthly follow-up visits for a maximum of five years [2426]. Men were recruited from HIV testing and counselling services provided at the Silom Community Clinic, at entertainment venues (e.g., bars, discos, saunas), through the internet, and by word of mouth. The study design has been described previously [2426] and only methods relevant to the current analyses are presented here. The data included in this report for behavioral imputation of HIV incidence were from enrolment among YMSM 18 to 21 and 18 to 24 years. The study protocol of the BMCS was reviewed and approved by an institutional review board of the United States Centers for Disease Control and Prevention and by the Thailand Ministry of Public Health Ethical Review Committee for Research in Human Subjects. Written informed consent was obtained from all study participants.

Estimation of serological and behaviorally imputed HIV incidence

The mid-point between the date of the last negative and first positive HIV test was taken as the estimated date of HIV seroconversion. Serologic HIV incidence was calculated by conventional prospective cohort study methodology using PY of follow-up: (the number of new HIV infections / ((the sum of the number of days elapsed since date of enrollment to the midpoint of the seroconversion interval or to the cut-off date, whichever came first / 365) x 100)). Behaviorally imputed HIV incidence was calculated according to OA by ((the number of prevalent HIV infections at baseline / the cumulative number of PY of follow-up since first anal sexual intercourse exposure prior to study entry) x 100) [19]. The earliest age at start of anal intercourse was set at the sample median of 17 years. Anal intercourse prior to that age unlikely contributed to HIV exposure, i.e., because HIV infection did not have substantial prevalence among MSM in Thailand during the corresponding calendar years [27]. In HIV-infected participants at baseline who reported a positive test date prior to study entry, the number of PY at risk was adjusted accordingly.

Statistical analysis

Since the present study was nested in an observational cohort, it was not a-priori powered to allow comparison between serologically and behaviorally imputed HIV incidence rates in YMSM. Ninety-five percent confidence intervals (CI) for estimated serological incidence were calculated by the exact Poisson method [28]. For estimated behaviorally imputed incidence, the bootstrap method for CI construction was applied, using 10000 replications [29]. Differences between estimated serological and behaviorally imputed HIV incidence was assessed by a rate difference and significance by the 95% CI not including zero. All statistical analyses were performed using Stata v12.1 (Stata, College Station, Texas, USA).

Results

Prior to enrollment, 314 YMSM age 18 to 21 years accumulated 674 PY of follow-up since first anal intercourse exposure. Considering that 50 men had prevalent HIV infection, the behaviorally imputed HIV incidence was 7.4 per 100 PY (95% CI: 5.4, 9.5) (Table 1). Of the remaining 264 HIV-negative YMSM of this age, 54 seroconverted for HIV infection during the study, accumulating 724 PY of follow-up and a serologically estimated HIV incidence of 7.5 per 100 PY (95% CI: 5.6, 9.7) (Table 1). Serologically and behaviorally imputed HIV incidence estimates were similar with an observed rate difference of 0.04 and not statistically significant (95% CI: -2.8, 2.9). Behaviorally imputed HIV incidence did not change after adjustment for self-reported date of HIV-positive testing (n = 3) prior to study entry. Prior to enrollment, 712 YMSM age 18 to 24 years (including men 18 to 21 years analyzed above) accumulated 2143

PY of follow-up since first anal intercourse exposure. Considering that 151 men had prevalent HIV infection, the behaviorally imputed HIV incidence was 7.0 per 100 PY (95% CI: 5.9, 8.2) (Table 1). Of the remaining 561 HIV-negative YMSM of this age, 125 seroconverted for HIV infection during the study, accumulating 1700 PY of follow-up and a serologically estimated HIV incidence of 7.4 per 100 PY (95% CI: 6.1, 8.8) (Table 1). The observed rate difference between the two age groups was 0.31, which was not statistically significant (95% CI: -1.4, 2.0).

thumbnail
Table 1. Serologically determined and behaviorally imputed HIV incidence in young men who have sex with men 18 to 21 and 18 to 24 years in the Bangkok Men who have Sex with Men Cohort Study, 2006–2014.

https://doi.org/10.1371/journal.pone.0204793.t001

Discussion

In this evaluation of serological versus behaviorally imputed estimations of HIV incidence in YMSM, reliability between the two methods was established. Concordance was found among YMSM 18 to 21 years as well as among those of 18 to 24 years old. This suggests that OA may be applied to a wider age-bracket than previously done [20, 21, 23]. Our study generated robust serologically and behaviorally imputed estimates of HIV incidence. It had eight times the number of HIV sero-conversions compared to the SFYMHS, in which behavioral imputation was originally implemented [19]. Except for ascertainment of age at start of anal intercourse, commonly included as part of cross-sectional surveys among MSM, no additional data are required for behavioral imputation. This method may therefore provide a simple, cheap and reliable technique for monitoring recent HIV incidence in YMSM in settings where longitudinal data are not available.

Cross-sectional HIV prevalence to approximate HIV incidence in young populations has been applied previously to women attending antenatal care [30]. Since early mortality was low in this population, the slope of the prevalence curve could be used to estimate HIV incidence in this group [8]. However, no such institutional data are available for YMSM, who are usually marginalized with limited access to routine primary care services, including HIV testing and counseling. Other methods estimating recent HIV incidence use de-tuned laboratory assays [4, 17] to detect sequentially emerging and declining immune-responses following infection. Yet, these methods have limitations as their HIV infection window is uncertain, such as in the BED-Capture Enzyme Immune Assay (BED-CEIA) [17, 18]. Moreover, the BED-CEIA assumes stability and annualizes HIV incidence, which may not reflect reality. Additional limitations of de-tuned assays are misclassification of late-stage infections as recent, problems with “false-positives”, low-antibody titers in persons on anti-retroviral therapy (ART) and HIV-subtype dependent performance. Attempts to supplement assay-based estimates such as the limiting-antigen avidity assay with information on viral load and ART use to address the false positive problem are not perfect [31, 32]. Mathematical model approaches with one or two rounds of HIV prevalence surveys have also been proposed, but these methods assume the epidemic is in steady-state, irrespective of underlying HIV transmission dynamics [9]. There may also be unknown selection biases in sampling from one round to another, migration, or losses due to HIV-related disease and death. Methods requiring mortality or survival rates are further restricted since these are usually unknown, especially in marginalized populations. In addition, current mortality and survival data are questionable with increased access and uptake of ART over time.

The limited availability, if not absence, of HIV incidence data among MSM in lower- and middle-income countries, has become particularly poignant in the context of the ever ongoing HIV epidemic in this population [1, 33, 34]. This is particularly a problem for YMSM since these persons are at the highest risk but under parental jurisdiction, often do not have access to HIV testing and counseling and are often ineligible to consent for participation in surveillance and research. Moreover, if data are available, they are usually not disaggregated by age. As a result, HIV prevention policy and planning mostly relies on information from adults. This is particularly a problem for YMSM, as age of maturity will not protect them from HIV acquisition, especially when they are young. Our study has several limitations. It was conducted among a self-selected group of YMSM volunteers at risk for HIV infection, hence incidence estimates cannot be generalized to the YMSM population at large. Moreover, a key requirement of behavioral imputation is accurate measurement of when HIV risk begins for YMSM, which may be subject to recall bias and socially desirable answering. Here, start of exposure was measured by age instead of date of first anal sex. While start age is a solid risk-indicator, in many surveys there will be early age outliers, which are unlikely to be representative of HIV risk in YMSM. For these cases a minimum start age may be applied, such as the sample median as was done here and elsewhere [19, 21].

Thirty-five years into the HIV epidemic, simple, affordable and reliable methods to estimate recent HIV incidence in MSM are not available. Recently, this deficiency has become increasingly problematic with the expanding HIV prevalence in YMSM [1]. To stop this from happening, the HIV incidence in the youngest needs to be addressed. In this context, behavioral imputation may serve as a reliable, simple and resource friendly tool to monitor the impact of targeted biomedical and behavioral HIV preventive interventions directed at stemming the HIV epidemic among YMSM in Thailand and elsewhere.

Acknowledgments

The authors acknowledge the support of Ms. Qi Cui and Sandra Kuzmanovska of the Global Fund to fight AIDS, TB and Malaria, Geneva, Switzerland. This work would not have been possible without the contribution of the staff of the Silom Community Clinic of the Thailand Ministry of Public Health–U.S. Centers for Disease Control and Prevention Collaboration. Professor Dennis Osmond (Emeritus) of the UCSF Department of Epidemiology and Biostatistics holds the intellectual ownership of the set of rules evaluated here. This algorithm was named after its creator, for which he kindly gave his permission. This work is dedicated to the life and work of Ms. Supaporn Chaikummao, former manager and head nurse of the Silom Community Clinic, Bangkok, Thailand.

References

  1. 1. Beyrer C, Baral SD, van Griensven F, Goodreau SM, Chariyalertsak S, Wirtz AL, et al. Global epidemiology of HIV infection in men who have sex with men. Lancet 2012,380:367–377. pmid:22819660
  2. 2. Brookmeyer R. Measuring the HIV/AIDS epidemic: approaches and challenges. Epidemiol Rev 2010,32:26–37. pmid:20203104
  3. 3. Brown T, Bao L, Raftery AE, Salomon JA, Baggaley RF, Stover J, et al. Modelling HIV epidemics in the antiretroviral era: the UNAIDS Estimation and Projection Package 2009. Sex Transm Infect 2010,86 Suppl 2:ii3–10.
  4. 4. Janssen RS, Satten GA, Stramer SL, Rawal BD, O'Brien TR, Weiblen BJ, et al. New testing strategy to detect early HIV-1 infection for use in incidence estimates and for clinical and prevention purposes. JAMA 1998,280:42–48. pmid:9660362
  5. 5. Gregson S, Donnelly CA, Parker CG, Anderson RM. Demographic approaches to the estimation of incidence of HIV-1 infection among adults from age-specific prevalence data in stable endemic conditions. AIDS 1996,10:1689–1697. pmid:8970690
  6. 6. Saidel T, Sokal D, Rice J, Buzingo T, Hassig S. Validation of a method to estimate age-specific human immunodeficiency virus (HIV) incidence rates in developing countries using population-based seroprevalence data. Am J Epidemiol 1996,144:214–223. pmid:8686690
  7. 7. Rajan SS, Sokal D. A simpler tool for estimation of HIV incidence from cross-sectional, age-specific prevalence data. J Epidemiol Community Health 2011,65:111–115. pmid:20558420
  8. 8. Williams B, Gouws E, Wilkinson D, Karim SA. Estimating HIV incidence rates from age prevalence data in epidemic situations. Stat Med 2001,20:2003–2016. pmid:11427956
  9. 9. Batter V, Matela B, Nsuami M, Manzila T, Kamenga M, Behets F, et al. High HIV-1 incidence in young women masked by stable overall seroprevalence among childbearing women in Kinshasa, Zaire: estimating incidence from serial seroprevalence data. AIDS 1994,8:811–817. pmid:8086141
  10. 10. Cleghorn FR, Jack N, Murphy JR, Edwards J, Mahabir B, Paul R, et al. Direct and indirect estimates of HIV-1 incidence in a high-prevalence population. Am J Epidemiol 1998,147:834–839. pmid:9583713
  11. 11. Hallett TB, Zaba B, Todd J, Lopman B, Mwita W, Biraro S, et al. Estimating incidence from prevalence in generalised HIV epidemics: methods and validation. PLoS Med 2008,5:e80. pmid:18590346
  12. 12. Hallett TB, Stover J, Mishra V, Ghys PD, Gregson S, Boerma T. Estimates of HIV incidence from household-based prevalence surveys. AIDS 2010,24:147–152. pmid:19915447
  13. 13. Ananworanich J, Chitwarakorn A, Wimonsate W, Varangrat A, Chaikummao S, Sriporn A, et al. HIV and syphilis infection among men who have sex with men—Bangkok, Thailand, 2005–2011. MMWR Morbidity and Mortality Weekly Report. 2013,62:518–520. pmid:23803960
  14. 14. Chariyalertsak S, Kosachunhanan N, Saokhieo P, Songsupa R, Wongthanee A, Chariyalertsak C, et al. HIV incidence, risk factors, and motivation for biomedical intervention among gay, bisexual men, and transgender persons in Northern Thailand. PLoS One 2011,6:e24295. pmid:21931673
  15. 15. Kellogg TA, Loeb L, Dilley J, Adler B, Louie BT, McFarland W. Comparison of three methods to measure HIV incidence among persons seeking voluntary, anonymous counseling and testing. J Acquir Immune Defic Syndr 2005,39:112–120. pmid:15851921
  16. 16. Brookmeyer R, Quinn TC. Estimation of current human immunodeficiency virus incidence rates from a cross-sectional survey using early diagnostic tests. Am J Epidemiol 1995,141:166–172. pmid:7817972
  17. 17. Parekh BS, Kennedy MS, Dobbs T, Pau CP, Byers R, Green T, et al. Quantitative detection of increasing HIV type 1 antibodies after seroconversion: a simple assay for detecting recent HIV infection and estimating incidence. AIDS Res Hum Retroviruses 2002,18:295–307. pmid:11860677
  18. 18. McNicholl JM, McDougal JS, Wasinrapee P, Branson BM, Martin M, Tappero JW, et al. Assessment of BED HIV-1 incidence assay in seroconverter cohorts: effect of individuals with long-term infection and importance of stable incidence. PLoS One 2011,6:e14748. pmid:21408214
  19. 19. Osmond DH, Page K, Wiley J, Garrett K, Sheppard HW, Moss AR, et al. HIV infection in homosexual and bisexual men 18 to 29 years of age: the San Francisco Young Men's Health Study. Am J Public Health 1994,84:1933–1937. pmid:7998633
  20. 20. van Griensven G, van den Bergh H, Janssen M, de Wit J, Keet I. HIV infectie riskant seksueel gedrag in een nieuwe cohort jonge homoseksuele mannen te Amsterdam, 1995–1996. Ned T Geneeskd [Dutch] 1997,14:2293–2296.
  21. 21. van Griensven F, Varangrat A, Wimonsate W, Tanpradech S, Kladsawad K, Chemnasiri T, et al. Trends in HIV prevalence, estimated HIV incidence, and risk behavior among men who have sex with men in Bangkok, Thailand, 2003–2007. J Acquir Immune Defic Syndr 2010,53:234–239. pmid:19901844
  22. 22. Zhao J, Ouyang L, Li J, Zhong F, Yan H, Wu M, et al. Estimating HIV incidence using HIV prevalence of younger age group and behavioral data among men who had sex with men in 6 Chinese cities. Chin Prev Med [Chinese] 2010,11:643–644.
  23. 23. Balaji AB, Bowles KE, Le BC, Paz-Bailey G, Oster AM, Group NS. High HIV incidence and prevalence and associated factors among young MSM, 2008. AIDS 2013,27:269–278. pmid:23079807
  24. 24. van Griensven F, Holtz TH, Thienkrua W, Chonwattana W, Wimonsate W, Chaikummao S, et al. Temporal trends in HIV-1 incidence and risk behaviours in men who have sex with men in Bangkok, Thailand, 2006–13: an observational study. Lancet HIV 2015,2:e64–70. pmid:26424462
  25. 25. van Griensven F, Thienkrua W, McNicholl J, Wimonsate W, Chaikummao S, Chonwattana W, et al. Evidence of an explosive epidemic of HIV infection in a cohort of men who have sex with men in Bangkok, Thailand. AIDS 2013,27:825–832. pmid:23169330
  26. 26. Thienkrua W, van Griensven F, Mock PA, Dunne EF, Raengsakulrach B, Wimonsate W, et al. Young Men Who Have Sex with Men at High Risk for HIV, Bangkok MSM Cohort Study, Thailand 2006–2014. AIDS Behav 2018;22:2137–2146. pmid:29138981
  27. 27. van Griensven F, Phanuphak N, Srithanaviboonchai K. Biomedical HIV prevention research and epidemic control in Thailand: two sides of the same coin. Sex Health 2014,11:180–199. pmid:25000363
  28. 28. Armitage P, Berry G, Matthews JNS. Statistical Methods in Medical Research. 4th ed. Oxford: Blackwell Science; 2002.
  29. 29. Efron B, Tibshirani RJ. An Introduction to the Bootstrap. London: Chapaman and Hall; 1993.
  30. 30. Zaba B, Boerma T, White R. Monitoring the AIDS epidemic using HIV prevalence data among young women attending antenatal clinics: prospects and problems. AIDS 2000,14:1633–1645. pmid:10983651
  31. 31. Longosz AF, Mehta SH, Kirk GD, Margolick JB, Brown J, Quinn TC, et al. Incorrect identification of recent HIV infection in adults in the United States using a limiting-antigen avidity assay. AIDS 2014,28:1227–1232. pmid:24513567
  32. 32. Longosz AF, Serwadda D, Nalugoda F, Kigozi G, Franco V, Gray RH, et al. Impact of HIV subtype on performance of the limiting antigen-avidity enzyme immunoassay, the bio-rad avidity assay, and the BED capture immunoassay in Rakai, Uganda. AIDS Res Hum Retroviruses. 2014; 30: 339–344. pmid:24083837
  33. 33. Baral SD, Grosso A, Holland C, Papworth E. The epidemiology of HIV among men who have sex with men in countries with generalized HIV epidemics. Curr Opin HIV AIDS. 2014; 9: 156–167. pmid:24445371
  34. 34. van Griensven F, de Lind van Wijngaarden JW. A review of the epidemiology of HIV infection and prevention responses among MSM in Asia. AIDS. 2010; 24 Suppl 3: S30–40.