Introduction

HIV primary care clinics are an important setting in which to deliver behavioral HIV prevention interventions because HIV-infected individuals are likely to be seen in these settings for regular care four times per year or more. A growing literature on the importance of delivering prevention interventions to HIV-infected patients (prevention with positives or PWP) demonstrates that medical care providers can help patients reduce risk [13]. Other types of prevention service providers have also delivered effective programs for HIV-infected individuals. For example, prevention counselors [4], group facilitators [5] and HIV-infected peers [6] have helped HIV-infected individuals reduce their risk. However, no study has compared the effectiveness of HIV prevention interventions delivered in clinical settings by different types of providers to determine which interventions work best in helping HIV-infected patients reduce their risk of transmitting HIV to others.

To determine the relative effectiveness of different types of prevention programs delivered in clinical settings, the Special Projects of National Significance (SPNS) program of the Health Resources and Services Administration (HRSA) funded 15 demonstration sites and an evaluation and support center to implement and evaluate prevention interventions for HIV-infected people who were seen in clinical settings [7]. Sites were required to use intervention approaches that were based on models that had been shown to be effective in prior research. Most sites chose interventions based on the well-tested health behavior theories of the Transtheoretical Model [8], motivational interviewing [9] and/or harm reduction [10]. Table 1 provides an overview of the theoretical models used by participating sites. All sites used formative research and expert consultation to tailor these approaches to the local client population and clinical setting. Detail on the tailoring processes is available elsewhere [11].

Table 1 Intervention conditions

Sites also used a variety of provider types to deliver intervention services (Table 1). Specifically, in this study, medical care provider-delivered interventions used brief risk assessment via computer to support clinicians in delivering brief counseling during routine medical visits. In some sites, social workers or health educators delivered HIV-prevention counseling. Health educators and social workers worked alone, with medical providers or with HIV-infected peers to deliver interventions. Most often, interventions involved one-on-one client-oriented sessions. In some sites, these were combined with group sessions. The number of sessions defining each intervention ranged from one to nine. In sites where prevention messages were delivered by more than one type of provider (“multi-provider interventions”), medical care providers delivered prevention messages in clinical encounters; health educators, social workers or peer educators also conducted risk assessments and delivered individual counseling sessions alone or in combination with group sessions. Table 1 also provides a description of the provider characteristics in each participating site.

This paper describes the outcomes of the project across all sites. We present findings describing whether and to what degree behavioral interventions in primary care settings help HIV-infected patients reduce the risk of transmitting HIV. We also describe the relative HIV risk reduction among patients receiving medical care provider-led interventions, interventions delivered by health educators, social workers or paraprofessional HIV-infected peers serving as “HIV prevention specialists” or interventions delivered by a medical provider and an HIV prevention specialist (multi-provider interventions) compared to patients receiving the standard of care.

Methods

Interventions and survey interviews were conducted in funded sites between April 2004 and December 2006. Sites were selected based on a competitive application process and were located in Chapel Hill, NC; Boston, MA; Baltimore, MD; New York City, NY; Seattle, WA; Sacramento, CA; San Diego, CA; Birmingham, AL; Philadelphia, PA; Decatur, GA; Miami, FL; Chicago, IL; and Tucson, AZ. Some sites had more than one clinic, and all participating clinics received funding from the federal Ryan White Program with 300 patients or more. Each site required local human research subjects approval in addition to the approval obtained from the University of California, San Francisco, which served as the cross-site evaluation center.

Although 15 sites were funded through this initiative, the analysis presented here is restricted to data from 13 of the sites. The Office of AIDS Policy and Planning, Los Angeles site was omitted because study investigators used different interviewing procedures and the resulting data were systematically different from the other 14 sites. Data from the Whitman Walker Clinic site in Washington, D.C. was omitted because there was an interruption in the study due to fiscal hardship within the organization; this interruption resulted in information not being available on patient receipt of the intervention and assignment to the intervention or assessment-only conditions.

Study Population

A total of 3,556 HIV-infected patients completed audio-computer assisted self interviews (ACASI) at baseline. These interviews included standardized cross-site questions and additional questions that a site’s study team added and used in local analysis. The ACASI survey was programmed using Questionnaire Development System version 2.0 by Nova Research Company (Bethesda, MD). Inclusion criteria were HIV-infected status, receipt of primary care at the clinic, age of 18 years or older, and ability to provide informed consent. For the cross-site evaluation, we translated the interview instrument into Spanish; however, this version was used at only one site. All other respondents were English-speaking. Sites had the option of adding additional inclusion requirements, which are summarized in Table 1. The cross-site evaluation survey took approximately 30 minutes to complete.

Recruitment and screening of potential respondents was undertaken exclusively in medical clinics serving HIV-infected clients. Sites used a variety of recruitment materials including brochures, posters, and project descriptions, as well as direct contact by study staff in clinics. Interested patients were briefly screened by project personnel to determine their self-reported HIV status as well as basic demographic and contact information. Then, eligible participants were scheduled for a baseline interview. Screening took place in a private setting, usually in a room or quiet place in the clinic. Most sites used incentives worth approximately $25 such as cash, a grocery voucher, or a gift certificate, to encourage participation in the evaluation portion of the project. Participants were not given incentives to attend intervention visits.

Randomization

Patients were individually randomized to an intervention group or a comparison condition on a site-by-site basis. Patients in the intervention group were assigned to receive interventions from their medical care providers during routine HIV care visits alone or in combination with services delivered by health educators, case managers or social workers or by HIV-infected peers trained to conduct HIV prevention counseling. Providers delivered interventions as stand alone sessions or in conjunction with routine clinical visits. Social workers, health educators and HIV-infected peers hired by these projects served the same role. In sites that included either medical provider-delivered or prevention specialist-delivered interventions, patients in the comparison group received the standard of care, routine HIV care visits by their medical care provider. Some sites’ interventions used a combination of approaches so that patients received prevention counseling from both medical providers and prevention specialists. In these multi-provider sites, patients in the comparison group received medical provider-delivered prevention counseling only. For this analysis, data were combined from patients in sites where the comparison group received the standard of care with those in multi-provider sites where the intervention condition was medical provider prevention only. Intervention and comparison types are summarized in Table 1.

Study Measures

Demographic Characteristics and Health Status Indicators

Detailed background and demographic items included participant’s age, race/ethnicity, gender, self-identified sexual orientation, relationship status, educational level, employment status, and income. In addition, self-reported health status indicators were assessed including: most recent CD4 count, HIV viral load, and current use of antiretroviral medication.

Sexual Behavior

Participants were asked to report sexual behavior over a 6 month recall period. Separate but equivalent versions of questions were developed for men and women, each with language tailored to be consistent with the participant’s gender and sexual orientation. Participants were asked to provide the number of times they had engaged in insertive or receptive vaginal and/or anal sex with HIV-infected partners, HIV-uninfected partners and partners of unknown HIV status. Participants were also asked about the number of times they had used condoms (male or female) from the beginning to the end of penetration and the number of times sex was unprotected. Unprotected sex was limited in the questioning to any act of insertive or receptive anal or vaginal intercourse in which a participant did not use a condom, a definition that excludes risk acts produced by accidental condom slippage or breakage.

Sexual Transmission Risk

Transmission risk acts were defined as reports of unprotected anal or vaginal intercourse without the use of a condom with any HIV-uninfected or unknown status partners. These acts were dichotomized into, “Yes” or “No.” Our outcome indicator does not include sex with HIV-infected partners because superinfection has not been observed in individuals such as those participating in this project, primarily characterized as having been infected for more than 3 years, engaged in care and on antiretroviral drugs.

Substance Use

Use of legal and illegal substances was assessed over a 3 month recall period. Items included alcohol, cocaine/crack, sedatives, tranquilizers, stimulants (such as crystal methamphetamine), analgesics, inhalants, marijuana, hallucinogens, and heroin. Use of injected drugs was assessed over the past 30 days. Items included frequency of injection and whether a participant had lent a needle to someone else after using it.

Patients repeated the assessments at 6-month intervals for 12 months after their initial baseline assessment and randomization.

Statistical Analysis

We compare participant characteristics, sexual behavior and substance use at study entry by intervention type using chi-square tests of homogeneity. Patients assigned to peer or health educator/social worker-led interventions responded similarly to the interventions with respect to their sexual transmission risk behavior and were combined in the analysis into a category entitled “prevention specialists.” We present the prevalence of sexual transmission risk behavior among participants in each intervention type over the 12-month assessment period graphically (Fig. 1). We compare the odds of sexual transmission risk behavior among participants in each intervention type to the odds of sexual transmission risk behavior among participants in the standard of care group at each time point using generalized estimating equations (GEE). In this model, we estimate the odds of sexual transmission risk behavior among participants in each intervention type at study entry, 6 months and 12 months using indicator variables for each intervention type at each time point. In order to account for clustering of participant behavior by intervention site, the GEE models adjust for sexual transmission risk behavior at study entry, as well as the correlation among participants at each site and within intervention groups.

Fig. 1
figure 1

Transmission Risk Behavior across 3 time points for Medical Care Provider-delivered, Prevention specialist-delivered, Multi-Provider Intervention and Standard of Care Groups

Because randomization occurred at the level of individual sites, rather than across the study as a whole, we employed inverse probability of treatment weighting (IPTW) to account for the effect of differences in the patient populations across intervention types on the observed effect of each intervention type [12, 13]. This method has the effect of creating samples in each intervention type that have been weighted to balance out the distribution of demographic and other patient characteristics associated with sexual transmission risk behavior. This creates a weighed population where characteristics of individuals are similar across all intervention types. Estimated parameters thus reflect the effect of each intervention type that would have been seen if it were possible to randomize the treatments across settings.

To estimate these weights, we used categorical logistic regression to estimate the probability of being assigned to each intervention type, given an individual’s demographic characteristics (age, gender, sexual orientation, race/ethnicity) and reported substance use (alcohol, speed and/or injecting drug use) at baseline. Factors in the model were chosen based on their association with the primary outcome at baseline, which are described in our paper on predictors of risk in this population [14]. The inverses of these probabilities were then applied as weights to the GEE model described above. However, application of these weights impacted the observed results by less than 1%. Therefore, they were not retained in the final model.

Because loss to follow-up was different across study sites and treatment arms, we used additional weighting methods to assess the impact of loss to follow-up on observed study results. These methods have the effect of weighting the data at each follow-up to resemble the sample at baseline with respect to factors associated with sexual transmission risk. Estimated parameters thus reflect the expected effect of each intervention type had no loss-to-follow-up occurred. To estimate these weights, we used logistic regression to estimate the probability of remaining in the study at each time point, given an individual’s demographic and substance use at baseline as defined above. The inverse of these probabilities were then applied as inverse probabilities of censoring weights (IPCW) to the final GEE model described above. Application of these results did impact the observed results. Therefore these weights were retained in the final model. The combination of the GEE model and the weighting procedures allows us to generate estimates for the effect of treatment at a population level accounting for differences across sites and the correlation of individuals results within sites. All analyses were implemented in SAS (version 9.1, SAS Institute Inc, Cary, NC).

Results

Participant Characteristics at Study Entry

Participant characteristics by intervention model are presented in Table 2. Of the 3,556 participants completing baseline assessments, most participants were men (70%) and over 40 years of age (64%). Forty-eight percent were African American, 37% were Caucasian, 11% were Hispanic or Latino and 4% were of mixed or other race/ethnicities. Similar proportions of participants identified as gay (44%) and heterosexual (45%), while fewer identified as bisexual (8%) or of unknown sexual orientation (2%). Approximately half of participants had a high school degree and 39% had a paying job. HIV-related health status among participants was good with 60% reporting CD4+ T cell counts greater than 200 (cells/mm3) and 15% reporting CD4+ T cell counts less than 200 (cells/mm3). One quarter of participants did not know the value of their most recent CD4+ T cell count. One-third of participants reported having an undetectable viral load, 53% reported having a detectable viral load and 12% did not know the value of their most recent viral load test. Two-thirds of participants reported current use of antiretroviral therapy.

Table 2 Characteristics at baseline of 3,556 study participants

Sexual Behavior and Drug Use in the 6 Months Prior to Study Entry

Table 3 presents the sexual risk characteristics at baseline of 3,556 patients across intervention types. Overall, 77% of patients reported at least one sexual partner in the previous 6 months (n = 2,723). Among patients reporting sexual activity at baseline, the mean number of partners overall was five (standard deviation = 11) and the median was 2 (25–75% = 1–3). Thirty-nine percent of sexually active patients reported two or more partners at baseline. Of these, 1,421 (52%) reported one or more HIV-infected partners, 1,324 (49%) reported one or more HIV-uninfected partners and 847 (31%) reported one or more partners of unknown serostatus. Thirty percent reported any vaginal sex. Twenty-seven percent reported anal insertive sex and 32% anal receptive sex. Twenty-four percent of participants reported anal insertive sex with male sexual partners, and 3% reported anal insertive sex with female sexual partners. Eleven percent of patients reported unprotected vaginal or anal sex with an uninfected partner. Twenty-one percent reported unprotected vaginal or anal sex with an HIV-infected partner and 10% reported unprotected vaginal or anal sex with an unknown status partner. Twenty-one percent of patients reported transmission risk acts, i.e. unprotected anal or vaginal intercourse with an HIV-uninfected or unknown status partner in the last 6 months.

Table 3 Risk behaviors at baseline of 3,556 study participants

Patient Characteristics by Study Group Assignment

Overall, 30% of participants were assigned to the standard of care, 22% to a medical care provider-delivered intervention, 27% to a prevention specialist-delivered intervention and 21% to an intervention site using both medical care providers and prevention specialists to deliver intervention messages (multi-provider intervention). We observed demographic and clinic differences in patients assigned to each intervention type (Table 2). Compared to those assigned to standard of care, participants in the medical care provider-delivered interventions were more likely to be women (χ2 = 22.1; P < 0.001), younger than 40 years of age (χ2 = 32.2; P < 0.001), African American (χ2 = 76.7; P < 0.001), to have a paying job (χ2 = 9.6; P < 0.003) and to report having a detectable viral load (χ2 = 15.9; P < 0.001). Participants in the prevention specialist-delivered intervention group were more likely than those in the standard of care to be 40 years of age or older (χ2 = 4.1; P < 0.04), to have a paying job (χ2 = 10.2; P < 0.006) and to report having an undetectable viral load (χ2 = 18.5; P < 0.001). Participants in the multi-provider intervention group were more likely than participants assigned to the standard of care to be younger than 40 years of age (χ2 = 24.3; P < 0.001) and to report having a detectable viral load (χ2 = 17.7; P < 0.004). Participants in the multi-provider intervention group were less likely than participants assigned to standard of care to report current use of antiretroviral therapy (χ2 = 9.4; P < 0.001).

There were also differences in the sexual behavior of patients receiving prevention different intervention providers (Table 3). Compared to patients in the standard of care group, patients in the medical provider-delivered and prevention specialist-delivered intervention groups reported similar sexual transmission risk behavior at baseline. Patients in medical provider-delivered intervention group were more likely to be sexually active (χ2 = 15.4, P < 0.001) and to report any unprotected vaginal or anal sex at baseline (χ2 = 5.3, P < 0.001), while patients in prevention specialist-delivered intervention group were significantly more likely to report any vaginal sex and sex with an HIV-infected partner (χ2 = 5.0, P < 0.03). Patients assigned to receive intervention services from medical care providers and prevention specialists did not differ from those in the standard of care group with respect to unprotected vaginal or anal sex with an HIV-negative or unknown status partner.

In contrast, compared to patients in the standard of care group, patients in the multi-provider intervention group report substantially more sexual transmission risk at baseline. Patients in the multi-provider intervention group were significantly more likely to report being sexually active (χ2 = 18.0, P < 0.001), to have two or more sex partners (χ2 = 5.1, P < 0.02), to report any vaginal (χ2 = 5.4, 0.02) or anal sex (χ2 = 5.7, 0.02) with male (χ2 = 7.2, P < 0.008) or female (χ2 = 8.0, P < 0.005) sex partners, as well as any unprotected vaginal or anal sex (χ2 = 36.1, P < 0.004) and unprotected vaginal or anal sex with HIV-infected (χ2 = 8.5, P < 0.004), HIV-uninfected (χ2 = 11.0, P < 0.001) and unknown HIV-serostatus (χ2 = 10.2, P < 0.001) partners.

Retention and Completion Rates

At the 12-month follow-up assessment, 58% of patients were retained in the standard of care group, 76% of patients were retained in the medical provider intervention group; 62% were retained in the prevention specialist group and 44% in the multi-provider group. There were differences in retention by patient characteristics. Older, white, gay patients with more than a high school education but who did not use cocaine or injection drugs were more likely to be retained in the study at 12-months.

Sexual Transmission Risk Over Time by Intervention Assignment

Figure 1 illustrates transmission risk across time points for the intervention and comparison arms. We observed a statistically significant effect of prevention-specialist-led interventions at 6 months and medical provider-led interventions at 12 months. Compared to the standard of care group, patients in the medical provider-delivered interventions reported a small effect of the intervention at 6 months (Odds Ratio [OR] = 0.93; 95% Confidence Interval [CI] = 0.60, 1.20; P < 0.79) and a much greater effect at 12 months (OR = 0.55; 95% CI = 0.32, 0.94; P < 0.03). In contrast, compared to patients assigned to the standard of care, patients in the specialist-delivered interventions reported a larger effect of the intervention at 6 months (OR = 0.58; 95% CI = 0.35, 0.96; P < 0.04), but this effect diminished at 12 months (OR = 0.67; 95% CI = 0.39, 1.14; P < 0.14). Participants in the multi-provider interventions also reported a small reduction in transmission risk behavior at 6 (OR = 0.89; 95% CI = 0.53, 1.51; P < 0.68) and 12 months (OR = 0.89 (95% CI = 0.53, 1.51; P < 0.68) relative to those in the standard of care group, but these differences were not statistically significant.

Discussion

HIV prevention with positives programs delivered by either medical care providers or HIV prevention specialists are effective in reducing sexual risk behavior among patients seen in clinical settings. In this large, multi-site study, messages delivered by HIV prevention specialists influenced behavior change in the shorter term and medical care provider-delivered messages were effective after they had been in place for several months. This study supports others demonstrating the effectiveness of provider-delivered health promotion messages [15].

This study also illustrates the importance of tailoring behavioral interventions to specific clinical settings. Although prevention specialist-led interventions were less likely to influence longer term behavior changes, they did create meaningful change at 6-months and may be a good option for some clinics. The difference in sustained outcomes may be due to factors associated with implementation. In provider sites, patients likely received intervention-related counseling at each medical visit, with more visits likely to occur and more visits likely to be made closer to the 12-month assessment point. In prevention specialist sites, patients usually received counseling in the days or weeks immediately following the baseline assessment. Our results suggest that behavioral interventions are most effective if they are delivered in “doses”—such as at routine medical care visits—over time, which has been noted in other studies [16].

The sites using a combination of medical care providers and prevention specialists (“multi-provider” sites) did not demonstrate effectiveness in terms of reduced risk among patients receiving intervention services. There is evidence from the qualitative results from this study that these interventions may be difficult to implement because of the attention required to train and sustain provider attention [11]. When a project had to ensure fidelity to an intervention protocol for both medical care providers and prevention specialists within one clinical setting, the effort for project staff was significant and at times, the procedures were too daunting and/or confusing. It may have been that the level of resources available for this intervention study was not great enough to support such complex interventions. It may also be that the complexity of behavioral interventions combined with supporting different types of providers in one setting was just too difficult. In any case, future studies may want to explore issues of quality assurance and efficiency in prevention with positives projects involving more than one type of provider in a clinical setting.

Finally, it is important to note that risk assessment alone seems to influence risk reduction among patients. As has been noted in other studies [16, 17], study participants who were not exposed to any intervention at all still reported reduced risk during ACASI assessments at 6- and 12-months. Lightfoot and colleagues have specifically documented the effects of self-monitoring via ACASI on changes in risk behaviors and attitudes [18]. It appears that simply asking patients to report their risk provides an opportunity for reflection that may serve as a cue for self-motivated change.

Conclusions drawn from this study are limited to some degree by the characteristics of the patients who participated. Most had been infected for 10 years or more and were adherent to both ARVs and to medical care seeking. Patients with these characteristics may have been more likely to also adhere to recommendations from prevention providers. Furthermore, the amount of risk reported by these patients was fairly low and the degree of change possible was therefore limited. Nevertheless, our study yielded significant results among patients receiving medical care provider- and prevention specialist-delivered interventions. There would be a greater magnitude of change possible with riskier patients and thus, our conclusions are likely conservative.

Conclusions are also limited by lack of standardization of intervention content; each site chose and tailored its own intervention. However, we are able to assure some level of commonality across the types we included in this analysis because sites were required to create and implement quality assurance plans to ensure fidelity to the intervention protocols. Study staff used a variety of techniques including provider interview, observation and quizzes to ensure that providers of all kinds adhered to the study protocols. In addition, because this study provides data from “real world” settings and implementation, the chances of replication of proven-effective interventions are enhanced.

Another limitation of our study is that the two sites using medical care provider-delivered messages alone also employed the use of computer-assisted risk assessment. There is some evidence from the qualitative study [19] that medical care providers remain uncomfortable with in-depth discussions of patients’ sexual behavior. For this reason, it is possible that the same degree of change would not have been found if providers and not computers had conducted the risk assessment. On the other hand, it does appear that interventions using computer-aided risk assessment in combination with medical-care provider delivered messages are an effective strategy for prevention with positives programs. This finding supports other recently emerging studies, such as those published by Gilbert and colleagues [20] who note the value of a “Video Doctor.” In the Video Doctor intervention, the computer performed both the risk assessment and the counseling, with durable risk reduction effects. Nevertheless, medical care providers in this study welcomed the opportunity to discuss risk reduction with their patients, an unintended consequence which cannot be underestimated.

This study contributes to the growing evidence regarding the effectiveness of prevention interventions for HIV-infected people in clinical settings. Our results support increased calls for the integration of prevention into care settings and for more research to understand how intervention “fit” contributes to program success. This is the first published cross-site outcomes study from the SPNS Prevention with Positives Initiative. Forthcoming papers describing the findings of the qualitative study and the cost effectiveness of interventions will provide additional evidence for selection and implementation of prevention models.