https://orcid.org/0000-0001-8343-5787
Figures
Abstract
Globally, and in the United States (U.S.) specifically, rates of reported sexually transmitted infections (STIs) have been steadily increasing and are especially high among youth aged 13–25 years. Using condoms correctly and consistently is an effective STI prevention measure for sexually active youth, yet public health endeavors tend to focus only on condom use consistency. Directly measuring condom application is challenging and expensive. Alternative tools evaluate this behaviour, but little evidence exists on the appropriateness of these instruments in measuring application skills. This systematic review and meta-analysis examined the association between condom application skills and self-efficacy. We conducted a search of several databases as well as unpublished works. Studies were included if they were in English, examined youth aged 13–25 years, and were available between 1992 and 2019. The authors screened 630 titles and abstracts for initial inclusion criteria. A full-text review of 30 studies was conducted. The authors included 19 studies in the systematic review and 5 studies were included in the meta-analysis. Both a fixed- and random-effects model (Q = .2321, I2 = 0%) yielded a medium-sized statistically non-significant association (r = 0.217) between skills and self-efficacy. Despite the small sample size, findings suggest that skills and self-efficacy may not be as interchangeable as previously assumed when assessing condom application. Implications for future research are discussed.
Citation: Ferrand JL, Blashill AJ, Corliss HL, Walsh-Buhi ER (2021) Condom application skills and self-efficacy in youth: A systematic review and meta-analysis. PLoS ONE 16(4): e0249753. https://doi.org/10.1371/journal.pone.0249753
Editor: Tamara Taggart, George Washington University, UNITED STATES
Received: May 18, 2020; Accepted: March 24, 2021; Published: April 8, 2021
Copyright: © 2021 Ferrand et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All data and syntax files are available from the principal investigators GitHub repository located here: https://jlferrand.github.io/condomsysma/.
Funding: The author(s) received no specific funding for this work.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Globally, the occurrence of sexually transmitted infections (STIs) are high, with an estimated 127.2 million, 86.9 million, and 6.3 million new incidents of chlamydia, gonorrhoea, and syphilis, respectively, in 2016 [1]. The U.S. has a similarly high rate of STI occurrence. In fact, STIs occurred at a higher rate in the year 2017 than they did at any point in the past two decades, with reported rates of 9.5, 528.8, and 171.9 per 100,000 people of all ages for syphilis (primary and secondary), chlamydia, and gonorrhoea, respectively [2]. Additionally, surveillance data indicate that the rate of occurrence of chlamydia and gonorrhea are highest for those aged 20–24 years, with 2644.0 and 607.5 per 100,000 people, respectively [3]. Similarly, rates of human immunodeficiency virus (HIV) are highest among individuals aged 20–29 years (34.8 per 100,000 people; [3]. Trend data from 2017 paint a similarly bleak portrait of STI occurrences in the U.S., with a 67% and a 76% increase in gonorrhea and syphilis diagnoses, respectively, since 2013 [2].
Significance of condom application skills
Although a minority of studies have reported mixed findings [4–6], overall, correct and consistent condom use remains an effective HIV and STI prevention measure [7, 8]. Yet, efforts to improve sexual health outcomes tend to focus on consistent use over correct use [9], despite the many ways that incorrect use can impede condom effectiveness [10]. Several systematic reviews indicated that sexual health promotion programs frequently focus on increasing condom use consistency, and some of these programs were successful at increasing the frequency in which condoms are reportedly utilized [11, 12]. However, there is evidence that youth aged 15–23 years have incorrect information regarding condom use that could lead to subsequent incorrect application (e.g., not leaving space at the tip, using oil-based lubricants; [13]). Incorrect condom application includes behaviors such as opening the package incorrectly, putting the condom on the penis backwards, removing the condom in the middle of sexual activity, and using a condom more than one time [9, 14]. A study of sexually active women reported that those between the ages of 21–25 years were at a higher risk of incorrectly applying a condom than younger women in the study [15]. More importantly, almost one-third (32%) of women in the study who reported consistent condom use committed application errors (e.g., re-using a condom or genital contact before or after condom use) compared to over two-fifths (43%) of women who reported inconsistent condom use. These findings are similar to that of a study of men enrolled in college where consistent and inconsistent condom users were equally likely to report condom application errors [16]. This suggests that frequent condom use without adequate application skills training may leave individuals with a trial and error approach to correct condom application. For the purposes of this study, condom application must include the act of applying the condom to, and removing the condom from, a penis either as reported by a participant or as observed by a research investigator. Studies that included other aspects of condom use, such as purchasing condoms or negotiating their use, but did not include the actual application and removal of the condom were excluded.
The significance of correct condom application has been documented in studies highlighting the association between incorrect application and subsequent condom failure [9, 14, 16–18]. Several studies conducted in STI treatment clinics attempted to further validate the association between self-reported or observed incorrect condom application and STI transmission by assessing for the presence of biological indicators of STI transmission such as prostate specific antigen detection in vaginal swabs following reported condom use. Using this method, Crosby et al. [19] found that correct condom application combined with consistent condom use significantly reduced one’s odds of STI transmission whereas Duerr et al. [17] found that, while not every condom error resulted in condom failure, several were associated with semen exposure (e.g., touching tip of penis with hand before applying condom). Despite the demonstrated importance of correct condom application in those studies, few investigators assess application skills, choosing instead to measure a different dimension of condom use, such as self-efficacy or attitudes towards condom use, which have not been comprehensively evaluated as appropriate approximations of one’s condom application skills. These dimensions are frequently used as approximations for one’s condom application skills possibly due to their coexistence in well-known behavioural theories such as the Social Cognitive Theory and the Information-Motivation-Behavioural Skills Model [20–22]. In fact, in a review of condom use measurements, self-efficacy was cited as the most frequently assessed construct when measuring condom use correctness [23]. Given these findings, the next logical step in evaluating sexual health programs and interventions should be to further assess how accurately participants use condoms, but at the time of this study, no actual efforts have been made to do so.
Evaluation of condom application skills
As noted above, correct condom application is effective in preventing negative sexual health outcomes [10, 24, 25], yet it remains a complex and multifaceted behavior that is challenging to measure [23, 26, 27]. Instruments have been developed to measure condom application skills through knowledge tests of condom application steps [28] or by observing participants while they apply a condom to a penile model and rating their performance [29–32]. Unfortunately, studies utilizing direct observation methodologies are scarce. The scarcity of direct observation instruments and approaches is not surprising considering the difficulty in conducting a skills assessment of condom application. As mentioned, different instruments tend to assess different skills related to correct condom application with some instruments overlapping in items and some assessing entirely different dimensions of condom application. For instance, the Condom Use Directly Observable Skill (CUDOS) measure [32], the Measure of Observed Condom Use Skills (MOCUS) scale [31], and the Male Condom Use Skills (MCUS) measure [29] contain similar items for assessing the actual demonstrated application of the condom and the removal of the condom, but the MCUS evaluates the selection of appropriate lubricants and latex condoms whereas the CUDOS only evaluates the selection of a latex condom and the MOCUS does not evaluate either of these dimensions. This makes knowing what skills to measure difficult. In addition to the varying skills a scale or survey purports to assess, conducting the skills assessment, whether it be direct observation or self-report, has often been met with resistance from multiple entities (e.g., legislation banning condom application skills trainings in schools and cultural antipathy towards participating in such an assessment), which reduces the sample of participants [33]. These barriers to effectively measuring condom application skills led to the adoption of alternate methods to quantify the behavior, many of which have not been evaluated as appropriate approximations of condom application skills.
Some research and behavioral interventions for youth have incorporated condom use skills training along with assessments of knowledge and attitudes towards condoms, but few researchers assess these outcomes using the same instruments, with evidence of reliability and validity, making it difficult to draw comparisons between programs with different outcome measures [34]. While responses to distinct instruments are not impossible to compare, the operationalization of the underlying constructs should be comparable between the instruments. In addition to concerns regarding operationalization of condom application skills, directly assessing condom application skills is challenging for several reasons, such as the time necessary to conduct such an assessment in the midst of other intervention tasks or stakeholder pushback with regards to providing condoms to young people [28, 33, 35–37]. These barriers to directly assessing condom use have stunted progress towards developing and evaluating direct observation instruments. Accordingly, sexual health promotion researchers have utilized alternative methods in approximating this behavior [28, 31], while others have attempted to estimate skills using the concept of self-efficacy applied to condom use [33].
An alternative to direct observation of condom application skills
Self-efficacy.
Self-efficacy has been used as a predictor for outcomes, such as academic performance [38–40] and myriad health behaviors such as physical activity and medication adherence [41–45]. Assessing condom use with a self-efficacy scale was more common than with a correct application scale as demonstrated in a systematic review of studies conducted between 1989 and 2003. This review found that of 56 studies examining condom use measurements only 9 studies assessed correct condom use skills, and the majority of those 9 studies used a measure of self-efficacy to assess skills [23]. Another review of studies who reported increases in general condom use indicated that not a single study used a measure of condom application skills [46]. Eventually, scales were developed specifically for assessing self-efficacy for condom use, such as the Condom Use Self-Efficacy Scale (CUSES), which has been used for the past 25 years to assess one’s confidence in applying a condom as well as buying, negotiating their use, and disposing of them [47]. Condom use self-efficacy can also be quite nuanced in its own conceptualization with a number of dimensions included under its auspices such as confidence to talk about condoms with a partner and confidence in using a condom correctly in both non-intoxicated and intoxicated situations [48, 49]. While assessing condom use self-efficacy may circumvent the difficulty in directly assessing condom use skills, little is known about the association between actual condom use skills and condom use self-efficacy among youth, as well as evidence of reliability and validity of data collected via measures to assess such attributes.
Research questions/hypothesis
In accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement [50], this systematic review and meta-analysis examined the association between measures of condom application skills and measures of condom use self-efficacy to answer the following research question: What is the association between measures of condom application skills and condom use self-efficacy? Due in part to differences in conceptualization and construction between measures of skills and measures of self-efficacy [51], we hypothesized there will be a weak, positive association between these two classifications of measures.
Materials and methods
Systematic literature review
Preparation.
Before conducting the review, we searched for similar reviews in the Cochrane Database of Systematic Reviews and in the journal, Systematic Reviews. While no reviews examined both condom use skills and condom use self-efficacy, there were some that examined one of the primary assessment methods, such as condom use self-efficacy. These reviews were mined for keywords that could be used to generate search terms. In addition, we determined that the most similar operationalization of condom use self-efficacy would appear after the development of the CUSES in 1991. Therefore, we decided to begin our search near this time point while also allowing for dissemination of the CUSES. We developed a systematic review protocol and submitted it to an international register of prospective systematic reviews (PROSPERO; CRD42018081960). In preparation for data extraction, we developed an online survey abstraction form, using Qualtrics, that we used to catalog and code study information and characteristics.
Search strategy.
Inclusion in this review study was contingent upon studies meeting the following criteria: 1) published in English between January 1992 and December 2019, 2) explicitly mentioned skills and self-efficacy in the article’s methods section, and 3) focused on youth aged 13–25 years of age. While restricting to English language articles may have introduced some additional bias in our pooled sample (as results in English language articles may be more positively skewed [52], the cost associated with translating languages other than English outweighed the risk of bias in this study. The inclusion age range of 13–25 years was chosen to account for some variation in definitions of youth populations [53, 54] which could include teenagers (aged 13–19 years) and young adults (aged 18–25 years). Research suggests that those aged 10–14 years undergo pubertal changes that could result in engaging in sexual activity [55, 56], but trend data from the Youth Risk Behavior Survey [57] suggest that sexual activity is not prevalent in those aged younger than 13 years in the U.S. (3.0% in 2019). With that in mind, we chose 13 years as the lower bound for the age range. We included theses and dissertations if they were indexed within ProQuest Dissertations and Theses. Investigators were contacted regarding unpublished manuscripts, but none were included in this review. We excluded articles if they were not quantitative (e.g., qualitative studies, reviews, editorials). Database searches were conducted through PsycINFO, MEDLINE, ISI Web of Knowledge, CINAHL, and ProQuest Dissertations and Theses. Members of the study team and a reference librarian at San Diego State University developed the following Boolean search string: (“condom use skill*” OR “condom use step*” OR “condom use abilit*” OR “condom use criteri*” OR “condom skill*” OR “condom abilit*” OR “condom step*” OR “condom use failures”) AND (“self-efficacy” OR “self efficacy” OR confidence OR “self concept”) AND (adolescen* OR youth OR teen* OR college OR university OR “young adult” OR “high school” OR “high-school). A total of 654 articles were collected from this search conducted by the lead investigator. A PRISMA flowchart [58], which outlines the complete review process, is provided in Fig 1, and a PRISMA checklist (S1 File) was used to adhere to the PRISMA guidelines.
Duplicate articles.
We compiled metadata from every article into Zotero citation management software [59] and sorted studies into folders based on the database from which they were mined. Using DOI and title metadata, 24 duplicate articles were identified and reconciled. After this de-duplication process, 630 unique studies remained to be included in the screening process.
Screening articles.
Using a web-based machine learning program, Rayyan [60], the lead investigator screened titles and abstracts for mentions of both “self-efficacy” and “skills,” and studies meeting these inclusion criteria were retained for further screening. Titles and abstracts were further screened for inclusion to ensure they examined the correct age range as well as to ensure they were quantitative research designs. Thirty (N = 30) articles met the inclusion criteria and were reviewed in full.
In addition to the database search, relevant articles were compiled from the reference lists of studies selected for the full-text review. Since this review also included unpublished or non-peer-reviewed studies (e.g., dissertations), relevant investigators were contacted via email as well as through professional email lists to solicit any existing manuscripts or unpublished data analyses that met the inclusion criteria. In instances where it was difficult to determine whether a study should be included, additional team members discussed the study and arrived at a decision. Our final sample of studies consisted of 19 articles that met the criteria for inclusion in the review and were subjected to a full data extraction and analysis.
Data extraction & synthesis.
Using Qualtrics online surveys, a template was developed for efficiently extracting relevant data from each article during a full-text review. The survey template was structured to collect numerous types and formats of data ranging from open-ended text to multiple choice response options. Flexible response options were included to ensure meaningful data were captured from studies that varied from our expected format. The following data were extracted from each of the included studies and assembled into a table for comparison: author last name, publication year, journal name, theories/frameworks that informed the study, study design, sample size, sample age range, sample race/ethnicity, sample genders, sample sexual orientation, study location, type of skills assessment, psychometrics reported (e.g., evidence of reliability), self-efficacy operationalization, type of self-efficacy assessment, instrument used, and study results. Assessing risk of bias in individual studies was limited to noting whether investigators provided raw data which could be used to calculate effect sizes, and, if they did not provide raw data, whether they provided an appropriate effect size.
Coding studies.
The studies were all independently coded by three team members (JF and either MR or RH). Each study was coded for study characteristics, such as sample and measurement instrument descriptors, as well as for effect size characteristics. Investigators were specifically interested in extracting reported bivariate associations between condom application skills and self-efficacy (e.g., Pearson’s correlations). Discrepancies between the coders were resolved during a reconciliation facilitated by a third, unbiased moderator (AK) resulting in a final agreement of 100%. Using R [61], additional agreement statistics were calculated using the irr package [62] for each coded variable across the included studies (κ = 1.00; ICC = 1.00). Both direct observation of condom application skills as well as proxy measures that estimated a person’s actual skills through knowledge of correct and incorrect steps were included in this review. We also classified any measurement instrument that assesses perceived confidence or ability to apply a condom as a measurement of self-efficacy.
Risk of bias and quality assessment.
The quality of studies included in the systematic review was assessed by two independent raters (JF and AJ) using the revised Cochrane risk of bias tool (ROB-2) for randomized trials [63] and the AXIS tool for cross-sectional studies [64]. The ROB-2 was used for studies meeting the criteria for a randomized trial whereas the AXIS tool was used for the remaining non-randomized studies. The raters reconciled discrepancies through discussion resulting in 100% agreement in quality assessments.
Data synthesis.
We compiled descriptive study characteristics from each article into a narrative review to highlight common and disparate features of each study. Additionally, characteristics of each included article are displayed in Tables 1 and 2.
Meta-analysis
Following data extraction, several studies were excluded from the quantitative analyses due to lack of appropriate effect size statistics, resulting in five studies included in the meta-analysis. Analyses were conducted using SPSS 24.0 [65] as well as macros developed for meta-analyses by Wilson [66]. To determine whether there was significant heterogeneity between the included studies, a Cochran’s Q statistic [67] and an I2 statistic [68] were calculated. Due to the low statistical power of the Q-test for rejecting homogeneity with few effect sizes from small samples, we attempted to fit both a fixed- and random-effects model to these data [68, 69]. The random effects model was appropriate for this examination since different populations or operationalizations of the outcome variables may have existed between studies, introducing additional, uncontrollable variance that may be difficult to detect using the Q and I2 statistic [69]. Correlation coefficients were transformed using Fisher’s z transformation. While it is common to assess the likelihood of various publication biases using a statistical test of asymmetry, the overall small sample that we used appeared too under-powered to provide a meaningful assessment [70–72].
Results
Systematic literature review
Study characteristics.
A summary of characteristics of the 19 articles included in the systematic review is provided in Table 1. Studies included appeared in a variety of journals such as AIDS and Behavior (3; 15.7%) and The Journal of Adolescent Health (2; 10.5%). Two studies were conducted as theses in partial fulfilment of doctoral degrees and were not published in academic journals. In total, 4 of the 19 studies (21.1%) were not guided by any specific theory, whereas 15 studies (78.9%) reported at least 1 guiding theory. The most frequently cited theoretical/behavioral frameworks were the Protection Motivation Theory (8 studies; 42.1%) and Social Cognitive Theory (6 studies; 31.6%) Table 2 contains more detailed information about the 19 included studies.
Risk of bias and quality assessments.
Fig 2 depicts the results from the ROB-2 on randomized trials, which suggests that most randomized trials have some concerns that should be considered when making inferences based on their conclusions. Specifically, the randomization processes and the reported results in several studies were not presented effectively and lower the overall quality of the study and subsequent conclusions.
Fig 3 depicts the frequency of different responses to items on the AXIS quality assessment tool across all non-randomized trials included in the systematic review.
Condom application skills.
More than half of the studies in this review (11 out of 19, 57.9%) assessed condom application skills through direct observation of the condom application. It should be noted that all direct observation instruments were completed by a study investigator instead of self-reported by the study participant. One study used both a direct observation instrument and a proxy instrument to assess condom application skills. Two studies out of those 11 directly assessing skills employed an existing instrument to directly assess skills. The remaining nine studies where skills were directly assessed used scales or checklists developed by the investigators on that research team. For studies directly assessing skills, the number of steps (for using a condom) assessed ranged from 4 steps to 15 steps, with most studies (six out of 11) citing between 7 and 9 steps. Only 3 out of the 11 studies utilizing a direct observation instrument (27.2%) reported reliability characteristics for the direct observation instrument employed (α = .78 to .93). All the studies that utilized a proxy instrument (9 out of 11, 81.8%) used one of 2 versions of the CUSC. Either 7 or 8 steps were considered crucial to correct condom application depending on which version was used. Out of the nine studies that used the CUSC, just over half (five out of nine; 55.6%) reported reliability characteristics for the CUSC (α = .42 - .83). It should be noted that all proxy instruments were self-report measures that were completed by study participants instead of by the study investigators.
Self-efficacy.
Overall, five out of 19 studies (26.3%) used an existing measure to assess condom use self-efficacy (e.g., CUSES), and the remaining 14 out of 19 studies (73.7%) employed measures that were developed by the research team for that specific examination. With regards to condom use self-efficacy, four out of 19 studies (21.1%) used specific items related to condom application whereas seven out of 19 studies (36.8%) operationalized the construct in a more cursory sense (i.e., a single item assessing their ability to apply a condom or consisting mostly of items not related to application). The remaining eight studies either did not state how they operationalized self-efficacy or the operationalization could not be determined. Additionally, most studies (17 out of 19; 84.2%) reported reliability characteristics for the self-efficacy measurement instrument employed (α = .69 to .94).
Meta-analysis
Association between skills and self-efficacy.
After coding the extracted data, 5 studies with a total sample size of 693 people contributed effect sizes for analyses of the association between condom application skills and self-efficacy. A random effects model was used to calculate an average effect size and 95% confidence interval. Results indicated a medium [90] but not statistically significant association between skills and self-efficacy, r = 0.217, 95% CI: -.043, .449, z = 1.639, p = .101. The studies were not found to be heterogeneous (Q = .2321, p = .994; I2 = 0%). Fig 4 depicts the distribution of standardized effect sizes of each study included in the meta-analysis as well as the results from the random effects model.
Discussion
The purpose of this study was to examine the association between condom application skills and condom use self-efficacy in youth aged 13–25 years reported in both published and unpublished studies. The results from a random effects model indicated no statistically significant association (r = 0.217, p = .101) between skills and self-efficacy. To our knowledge, this is the first attempt to summarize existing data on the association between condom application skills and self-efficacy, and our results suggest that a person’s perceived confidence in their ability to apply a condom may not be as strongly associated with their actual skills as was previously thought.
One of the most enduring aspects of sexual health interventions is condom use, but upon which facets of condom use to focus remains challenging. While the current literature reports that interventions including a condom skills training component are effective, few studies report an outcome involving a skills assessment, opting instead to report consistency of condom use over time [34, 91, 92]. This may be due in part to policies that inhibit the implementation of condom application skill trainings and assessments in certain settings such as schools [33] suggesting that additional effort should be directed towards legislation that is informed by and supportive of scientific inquiry in this domain. Since condom application skills assessments can be challenging to administer, researchers develop and utilize more convenient measures targeting condom use self-efficacy which are often used in place of actual skills assessments. This practice assumes that these two concepts are interchangeable; however, our findings suggest that this is not empirically supported.
Regarding the theoretical impacts, Bandura linked these two constructs in his Social Cognitive Theory, which frequently has been used as a guiding theory in many public health and behavior change interventions [93–95]. Our results suggest that this linkage is not present in the context of condom application, and our reported effect size suggests that they are not as interchangeable as previously assumed. The absence of this association in our meta-analyses may suggest that the instruments included in the study examine two distinct constructs that are not well-aligned, possibly due to varying operationalizations of the constructs or selective reporting practices. This implies a more complementary nature between these two constructs instead of one of substitution for convenience as is often the case.
Limitations
We recommend that additional research be undertaken to further examine the association between condom application skills and self-efficacy, as there were several limitations of the current study. The number of studies that fit the inclusion criteria for the meta-analysis was limited for several reasons. Many studies did not report effect sizes that could be used to calculate an association between condom use skills and self-efficacy. In these instances, our team attempted to contact the study investigators to inquire about these supplementary data, but we were overall unsuccessful in procuring them for several reasons (e.g., no response or unable to conduct analyses at that time). There were several experimental studies that reported appropriate effect sizes, but that also utilized multiple treatment or control conditions. This analysis was primarily concerned with the reported association between two measurement instruments instead of the overall effect of the intervention in different participant groups. Additionally, any study that involved assignment to one or more interventions would report the comparison to the same control group participants for each intervention. A similar issue arose with data from participants who were outside of our age range at baseline assessment which necessitated including data from only those timepoints in which they were aged 13–25 years. Even more studies may have been included had we not limited the inclusion criteria to English language articles which limited the number of studies in the review and analysis. This study also only assessed external condom application skills and self-efficacy which resulted in exclusion of any studies that focused on internal condom use. As a result of these characteristics, these studies were excluded from the meta-analysis, thus reducing our power to more robustly assess the association between our outcomes of interest and raising the probability that a Type-II error was committed. Due to the low-power of this meta-analysis, it was not prudent to conduct any moderation analyses (i.e., small between-study variability among so few studies severely limited the detection of heterogeneity; [96]).
Additionally, measurement instruments used to assess skills and self-efficacy were frequently developed by the investigators for that specific study, and these new instruments were not always well-defined (i.e., item development process). This may have resulted in studies using an instrument developed to assess a construct that was conceptually different from that of others included in the analysis. This would further culminate in a comparison of idiosyncratic conceptualizations of the outcomes of interest, creating a space for competing interpretations of the associations between them. Of those studies included in the meta-analysis, 3 used an existing scale and 2 used an instrument developed by their research team to assess skills. While this variation in measurement instrument may have introduced additional error, our assessment of homogeneity indicated that the included studies were not significantly different with regard to our outcomes of interest. Additionally, studies used the same general methodology for assessing self-efficacy (self-report questionnaires) and skills (self-report knowledge test proxy or a checklist of skills). Therefore, it is unlikely that an idiosyncratic conceptualization of application skills and self-efficacy are disparate enough to raise alarm in this study.
The range of reported reliability estimates suggests that the scales/instruments used across the included studies vary somewhat. Studies employing direct observation instruments (n = 3) reported Cronbach’s alphas ranging from 0.78–0.93 for data collected via those instruments, whereas the Cronbach’s alphas of self-efficacy instruments (n = 17) ranged from 0.69–0.94, indicating that these instruments range in their levels of internal consistency from below the acceptable alpha of 0.70 to more acceptable values [97]. Most concerning was that, of the five studies using a proxy instrument (all of which were the CUSC) to assess condom application skills that reported reliability characteristics, Cronbach’s alphas ranged from 0.42–0.83. An instrument with low internal consistency reliability often suggests that responses to items on the scale are not strongly correlated and participants are responding inconsistently–a problematic result given that reliability is necessary to establish construct validity [98]. This could be alleviated by removing or re-wording certain items on these scales so that they provide additional information related to the construct of interest (condom application skills or self-efficacy) that is not redundant of items already included.
The amount of studies that assess both condom application skills and condom use self-efficacy was small due to a lack of publications focusing on these two constructs simultaneously. During the initial screening process, 95 articles were excluded from the systematic review because they examined only self-efficacy for condom use without an appropriate skills component. That translates to approximately 67% of the sample being excluded for this reason alone. This was especially concerning considering the importance of both constructs in one of the most frequently utilized theoretical frameworks for studies in this review: the social cognitive theory (SCT). The conception of the SCT [20] included the construct of “appropriate skills” (p. 194) as a component of behavior change, yet only 18 studies in this review were found to measure and report on skills as well as self-efficacy. It seems logical that any intervention or study involving self-efficacy must also include a skills assessment of the same behavior in order to maintain at least partial theoretical fidelity.
Finally, few randomized trials included in this review exhibited a low risk of bias with the majority exhibiting some concerning characteristics that may have influenced the investigators’ findings. Specifically, most randomized trials lacked sufficient information describing deviations from intended interventions. Similarly, how investigators chose which outcomes to report was not always clear suggesting potential reporting bias in their studies. The cross-sectional studies were generally good quality with few demonstrating any glaring issues with the exception of very few mentions of how non-responses were handled in these studies.
Implications
Despite this study’s limitations, there are important implications that may be used to shape current practices. The lack of studies reporting eligible effect sizes was especially limiting in our efforts to assess an association and points to a larger concern regarding reporting practices. Both the American Psychological Association (APA) and the American Education Research Association (AERA) have provided effect size reporting guidelines [99–101]. Since then, there have been improvements in the quality of effect size reporting, and yet there are still discrepancies in best practices, much to the frustration of reviewers and meta-analysts [102–104]. Even with professional associations and journals disseminating similar protocols for effect size reporting, there is no “hard-and-fast” rule regarding which effect sizes should be reported. Lakens [105] suggested that research questions and designs are primary drivers behind which effect sizes are reported. This implies that any approach to synthesizing reported effect sizes is often dictated by the initial investigators, thus putting the onus on such scholars to report all potentially salient data well in advance of a meta-analytic approach. While this seems like a heavy mandate to place on researchers, Thompson [106] posited that adopting a meta-analytic viewpoint, as demonstrated by consistently reporting effect sizes, is a positive step that would benefit future syntheses.
Most importantly, the sheer lack of articles assessing both condom use skills and condom use self-efficacy should be regarded as a high-priority issue in sexual health promotion endeavors. In this systematic review, 78% of all of the excluded studies did not assess condom use skills (n = 96) whereas 33% of all of the excluded studies did not assess condom use self-efficacy (n = 41). Additionally, 65% of the excluded studies only examined condom use-self-efficacy and did not examine condom use skills (n = 80). Assuming, without evaluation, that a behavior is being correctly performed may prove detrimental especially if participants are exposed to a “quantity over quality” approach to condom use wherein higher frequency of condom use is deemed an adequate metric for safer sex. It is also inappropriate to assume that a concept as cerebral as self-efficacy is an acceptable proxy for one’s actual ability without the requisite associative assessments between the two constructs. Sexual health promotion interventions and studies that have been eager to simplify the assessment of condom use skills should view this study as an impetus to further sharpen such tools. When we detach the concept of self-efficacy from demonstrated skills by assessing one and not the other, we see a fragmented picture of one’s behavior. Instead, future efforts should be devoted to developing brief measurement instruments for both constructs such that they can be employed in tandem. Special attention should be paid to assessing instruments among groups of women, men, and both women and men, as well as among other priority populations, such as men who have sex with men (MSM).
With regards to condom application skills, future directions could involve the development or application of innovative technologies from other fields such as virtual reality (VR) and augmented reality (AR) devices. Both VR and AR have emerged as potential complements to existing smartphone applications and immersive video games in addressing both mental and physical health areas [107–109]. Specifically, studies of surgeons who practiced surgical techniques using VR-simulated environments showed improved surgical skills compared to those who did not practice using VR devices [110–113]. Since these technologies aim to create an immersive environment within which the participant behaves, they may allow us to better assess condom skills in a cognitive state that better resembles real-world situations and their accompanying physical and emotional arousals (i.e., "hot" cognitive states; [114, 115]. Moving towards this type of thinking has the potential to yield a more robust assessment of how skills and self-efficacy can be targeted to promote healthier, safer sexual behaviors.
Supporting information
S1 File. PRISMA checklist.
List of PRISMA items and where to find them in-text.
https://doi.org/10.1371/journal.pone.0249753.s001
(PDF)
Acknowledgments
The first author wishes to recognize Meaghan Roach, Amanda Farr, Ryli Hockensmith, and Ashley Judge for their efforts with the data extraction, coding, quality assessment, and reconciliation processes.
References
- 1. Rowley J, Vander Hoorn S, Korenromp E, Low N, Unemo M, Abu-Raddad LJ, et al. Chlamydia, gonorrhoea, trichomoniasis and syphilis: global prevalence and incidence estimates, 2016. Bull World Health Organ. 2019 Aug 1;97(8):548–562P. pmid:31384073
- 2.
Centers for Disease Control and Prevention. Sexually Transmitted Disease Surveillance, 2017 [Internet]. Atlanta: U.S. Department of Health and Human Services; 2018. Available from: https://www.cdc.gov/std/stats17/2017-STD-Surveillance-Report_CDC-clearance-9.10.18.pdf
- 3.
Centers for Disease Control and Prevention. HIV Surveillance Report, 2017 [Internet]. 2018 Nov [cited 2019 Feb 21] p. 129. Available from: http://www.cdc.gov/hiv/library/reports/hiv-surveillance.html
- 4. Kennedy SB, Nolen S, Applewhite J, Waiters E, Vanderhoff J. Condom use behaviours among 18–24 year-old urban African American males: a qualitative study. AIDS Care. 2007 Sep;19(8):1032–8. pmid:17852001
- 5. Ochieng MA, Kakai R, Abok K. Knowledge, attitude and practice of condom use among secondary school students in Kisumu district, Nyanza province. Asian J Med Sci. 2011;3(1):32–6.
- 6.
Toroitich-Ruto C. The Effect of HIV/AIDS on Sexual Behavior of Young People in Kenya. 2004;27.
- 7. Holmes KK, Levine R, Weaver M. Effectiveness of condoms in preventing sexually transmitted infections. Bull World Health Organ. 2004 Jun;82(6):454–61. pmid:15356939
- 8. Warner L, Newman DR, Kamb ML, Fishbein M, Douglas JM, Zenilman J, et al. Problems with Condom Use among Patients Attending Sexually Transmitted Disease Clinics: Prevalence, Predictors, and Relation to Incident Gonorrhea and Chlamydia. Am J Epidemiol. 2008 Feb 1;167(3):341–9. pmid:17989058
- 9. Sanders SA, Yarber WL, Kaufman EL, Crosby RA, Graham CA, Milhausen RR. Condom use errors and problems: a global view. Sex Health. 2012 Mar 9;9(1):81–95. pmid:22348636
- 10. Warner L, Gallo MF, Macaluso M. Condom use around the globe: how can we fulfil the prevention potential of male condoms? Sex Health. 2012 Mar 9;9(1):4–9. pmid:22348627
- 11. Becasen JS, Ford J, Hogben M. Sexual health interventions: a meta-analysis. J Sex Res. 2015;52(4):433–43. pmid:25211119
- 12. Sani AS, Abraham C, Denford S, Ball S. School-based sexual health education interventions to prevent STI/HIV in sub-Saharan Africa: a systematic review and meta-analysis. BMC Public Health. 2016 Oct 10;16:1069. pmid:27724886
- 13. Crosby R, Yarber W. Perceived versus actual knowledge about correct condom use among US adolescents: results from a national study. J Adolesc Health. 2001;28(5):415–20. pmid:11336872
- 14. Crosby R, Sanders S, Yarber W, Graham C. Condom-use errors and problems: A neglected aspect of studies assessing condom effectiveness. Am J Prev Med. 2003 May 1;24(4):367–70. pmid:12726876
- 15. Shih SL, Kebodeaux CA, Secura GM, Allsworth JE, Madden T, Peipert JF. Baseline correlates of inconsistent and incorrect condom use among sexually active women in the Contraceptive CHOICE Project. Sex Transm Dis. 2011 Nov;38(11):1012–9. pmid:21992976
- 16. Warner L, Clay-Warner J, Boles J, Williamson J. Assessing Condom Use Practices: Implications for Evaluating Method and User Effectiveness. Sex Transm Dis. 1998 Jul;25(6):273. pmid:9662759
- 17. Duerr A, Gallo MF, Warner L, Jamieson DJ, Kulczycki A, Macaluso M. Assessing Male Condom Failure and Incorrect Use. Sex Transm Dis. 2011 Jul;38(7):580. pmid:21278626
- 18. Macaluso M, Kelaghan J, Artz L, Austin H, Fleenor M, Hook EWI, et al. Mechanical Failure of the Latex Condom in a Cohort of Women at High STD Risk. Sex Transm Dis. 1999 Sep;26(8):450. pmid:10494936
- 19. Crosby RA, Charnigo RA, Weathers C, Caliendo AM, Shrier LA. Condom effectiveness against non-viral sexually transmitted infections: a prospective study using electronic daily diaries. Sex Transm Infect. 2012 Nov;88(7):484–9. pmid:23002192
- 20. Bandura A. Self-efficacy: toward a unifying theory of behavioral change. Psychol Rev. 1977;84(2):191. pmid:847061
- 21. Bandura A. Perceived self-efficacy in the exercise of control over AIDS infection. Eval Program Plann. 1990 Jan 1;13(1):9–17.
- 22. Fisher JD, Fisher WA, Bryan AD, Misovich SJ. Information-Motivation-Behavioral Skills Model-Based HIV Risk Behavior Change Intervention for Inner-City High School Youth. CHIP Doc. 2002;6:13. pmid:11950108
- 23. Noar SM, Cole C, Carlyle K. Condom use measurement in 56 studies of sexual risk behavior: review and recommendations. Arch Sex Behav. 2006 Jun;35(3):327–45. pmid:16799837
- 24. Warner L, Stone KM, Macaluso M, Buehler JW, Austin HD. Condom Use and Risk of Gonorrhea and Chlamydia: A Systematic Review of Design and Measurement Factors Assessed in Epidemiologic Studies. Sex Transm Dis. 2006 Jan;33(1):36. pmid:16385221
- 25. Weller S, Davis K. Condom effectiveness in reducing heterosexual HIV transmission. Cochrane Database Syst Rev. 2002;(1):CD003255. pmid:11869658
- 26. Fonner VA, Kennedy CE, O’Reilly KR, Sweat MD. Systematic Assessment of Condom Use Measurement in Evaluation of HIV Prevention Interventions: Need for Standardization of Measures. AIDS Behav. 2014 Dec 1;18(12):2374–86. pmid:24197972
- 27. McCallum EB, Peterson ZD. Investigating the Impact of Inquiry Mode on Self-Reported Sexual Behavior: Theoretical Considerations and Review of the Literature. J Sex Res. 2012 Mar 1;49(2–3):212–26. pmid:22380589
- 28. Stanton B, Deveaux L, Lunn S, Yu S, Brathwaite N, Li X, et al. Condom-use Skills Checklist: A Proxy for Assessing Condom-use Knowledge and Skills When Direct Observation Is Not Possible. J Health Popul Nutr. 2009 Jun;27(3):406–13. pmid:19507756
- 29. Calsyn DA, Hatch-Maillette MA, Doyle SR, Cousins S, Chen T, Godinez M. Teaching Condom Use Skills: Practice Is Superior to Observation. Subst Abuse. 2010 Oct 15;31(4):231–9. pmid:21038177
- 30. Farris CA, Fenaughty AM, Lindemann DF. A condom skill scale: assessing condom skills among female drug users. J Drug Educ. 2003;33(2):217–31. pmid:12929711
- 31. Lindemann DF, Brigham TA. A Guttman scale for assessing condom use skills among college students. AIDS Behav. 2003 Mar;7(1):23–7. pmid:14534387
- 32. Ross D, Schumacher JE. Condom Use Assessment of Persons in Drug Abuse Treatment. J Community Health. 2004 Dec;29(6):499–509. pmid:15587348
- 33. Carey MP. Behavioral Skills and Adolescent Sexual Risk Behavior. J Adolesc Health. 2007 Aug 1;41(2):211–2. pmid:17659228
- 34. Free C, Roberts IG, Abramsky T, Fitzgerald M, Wensley F. A systematic review of randomised controlled trials of interventions promoting effective condom use. J Epidemiol Community Health. 2011 Feb 1;65(2):100–10. pmid:19822557
- 35. Buhi ER, Goodson P. Predictors of adolescent sexual behavior and intention: a theory-guided systematic review. J Adolesc Health Off Publ Soc Adolesc Med. 2007 Jan;40(1):4–21. pmid:17185201
- 36. Goodson P, Buhi ER. The Authors reply. J Adolesc Health. 2007 Aug 1;41(2):212. pmid:17659230
- 37. Stanton B, Harris C, Cottrell L, Li X, Gibson C, Guo J, et al. Trial of an urban adolescent sexual risk-reduction intervention for rural youth: a promising but imperfect fit. J Adolesc Health. 2006 Jan 1;38(1):55.e25-55.e36. pmid:16387250
- 38. Multon KD, Brown SD, Lent RW. Relation of self-efficacy beliefs to academic outcomes: A meta-analytic investigation. J Couns Psychol. 1991;38(1):30.
- 39. Pajares F. Self-efficacy beliefs in academic settings. Rev Educ Res. 1996;66(4):543–78.
- 40. Zimmerman BJ, Bandura A, Martinez-Pons M. Self-motivation for academic attainment: The role of self-efficacy beliefs and personal goal setting. Am Educ Res J. 1992;29(3):663–76.
- 41. Holden G. The relationship of self-efficacy appraisals to subsequent health related outcomes: A meta-analysis. Soc Work Health Care. 1992;16(1):53–93.
- 42. Hyde J, Hankins M, Deale A, Marteau TM. Interventions to Increase Self-efficacy in the Context of Addiction Behaviours: A Systematic Literature Review. J Health Psychol. 2008 Jul 1;13(5):607–23. pmid:18519435
- 43. Schwarzer R, Fuchs R. Self-efficacy and health behaviours. Predict Health Behav Res Pract Soc Cogn Models. 1996;163–96.
- 44. Sheeran P, Maki A, Montanaro E, Avishai-Yitshak A, Bryan A, Klein WMP, et al. The impact of changing attitudes, norms, and self-efficacy on health-related intentions and behavior: A meta-analysis. Health Psychol. 2016;35(11):1178–88. pmid:27280365
- 45. Williams SL, French DP. What are the most effective intervention techniques for changing physical activity self-efficacy and physical activity behaviour—and are they the same? Health Educ Res. 2011 Apr 1;26(2):308–22. pmid:21321008
- 46. Whiting W, Pharr JR, Buttner MP, Lough NL. Behavioral Interventions to Increase Condom Use Among College Students in the United States: A Systematic Review. Health Educ Behav Off Publ Soc Public Health Educ. 2019 Oct;46(5):877–88. pmid:31165629
- 47. Brafford LJ, Beck KH. Development and validation of a condom self-efficacy scale for college students. J Am Coll Health J ACH. 1991 Mar;39(5):219–25. pmid:1783705
- 48. Barkley TW, Burns JL. Factor analysis of the Condom Use Self-Efficacy Scale among multicultural college students. Health Educ Res. 2000 Aug 4;15(4):485–9. pmid:11066465
- 49. Brien TM, Thombs DL, Mahoney CA, Wallnau L. Dimensions of self-efficacy among three distinct groups of condom users. J Am Coll Health J ACH. 1994 Jan;42(4):167–74. pmid:8132940
- 50. Moher D, Liberati A, Tetzlaff J, Altman DG, Group TP. Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. PLOS Med. 2009 Jul 21;6(7):e1000097. pmid:19621072
- 51.
Bandura A. Guide for constructing self-efficacy scales. In: Urdan T, Pajares F, editors. Self-Efficacy Beliefs of Adolescents. Greenwich, CT: Information Age Publishing; 2006. p. 307–37.
- 52. Morrison A, Polisena J, Husereau D, Moulton K, Clark M, Fiander M, et al. The effect of English-language restriction on systematic review-based meta-analyses: a systematic review of empirical studies. Int J Technol Assess Health Care. 2012 Apr;28(2):138–44. pmid:22559755
- 53. Wilens TE, Rosenbaum JF. Transitional Aged Youth: A New Frontier in Child and Adolescent Psychiatry. J Am Acad Child Adolesc Psychiatry. 2013 Sep 1;52(9):887–90. pmid:23972688
- 54. Sawyer SM, Azzopardi PS, Wickremarathne D, Patton GC. The age of adolescence. Lancet Child Adolesc Health. 2018 Mar 1;2(3):223–8. pmid:30169257
- 55. Arnal RB, Llario MDG. Sexuality in children 9–14 years old. Psicothema. 2006 Feb;18(1):25–30. pmid:17296005
- 56. Fortenberry JD. Puberty and Adolescent Sexuality. Horm Behav. 2013 Jul;64(2):280–7. pmid:23998672
- 57.
National Center for HIV/AIDS, Viral Hepatitis, STD, and TB Prevention. Trends in the Prevalence of Sexual Behaviors and HIV Testing National YRBS: 1991–2019. 2020 Aug 20;2.
- 58.
Wasey JO. PRISMAstatement: Plot Flow Charts According to the “PRISMA” Statement [Internet]. 2019. Available from: https://CRAN.R-project.org/package=PRISMAstatement}
- 59.
Roy Rosenzweig Center for History and New Media. Zotero. 2017.
- 60. Ouzzani M, Hammady H, Fedorowicz Z, Elmagarmid A. Rayyan—a web and mobile app for systematic reviews. Syst Rev. 2016 Dec 5;5:210. pmid:27919275
- 61.
R Core Team. R: A language and environment for statistical computing [Internet]. Vienna, Austria: R Foundation for Statistical Computing; 2018. Available from: https://www.R-project.org/
- 62.
Gamer M, Lemon J, Singh P. irr: Various Coefficients of Interrater Reliability and Agreement [Internet]. 2012. (R Package). Available from: https://CRAN.R-project.org/package=irr
- 63. Sterne JA, Savović J, Page MJ, Elbers RG, Blencowe NS, Boutron I, et al. RoB 2: a revised tool for assessing risk of bias in randomised trials. bmj. 2019;366. pmid:31462531
- 64. Downes MJ, Brennan ML, Williams HC, Dean RS. Development of a critical appraisal tool to assess the quality of cross-sectional studies (AXIS). BMJ Open. 2016 Dec 1;6(12):e011458. pmid:27932337
- 65.
IBM Corp. IBM SPSS Statistics for Windows. Armonk, NY: IBM Corp; 2016.
- 66.
Wilson DB. Meta-analysis macros for SAS, SPSS, and Stata [Internet]. 2005. Available from: http://mason.gmu.edu/~dwilsonb/ma.html
- 67. Cochran WG. The Combination of Estimates from Different Experiments. Biometrics. 1954;10(1):101–29.
- 68. Higgins JPT, Thompson SG, Deeks JJ, Altman DG. Measuring Inconsistency In Meta-Analyses. BMJ. 2003;327(7414):557–60. pmid:12958120
- 69.
Lipsey MW, Wilson DB. Practical meta-analysis. Thousand Oaks, CA, US: Sage Publications, Inc; 2001. ix, 247 p. (Practical meta-analysis.).
- 70. Dalton JE, Bolen SD, Mascha EJ. Publication Bias: The Elephant in the Review. Anesth Analg. 2016 Oct;123(4):812–3. pmid:27636569
- 71. Ioannidis JPA, Trikalinos TA. The appropriateness of asymmetry tests for publication bias in meta-analyses: a large survey. Can Med Assoc J. 2007 Apr 10;176(8):1091–6. pmid:17420491
- 72. Jin Z-C, Zhou X-H, He J. Statistical methods for dealing with publication bias in meta-analysis. Stat Med. 2015 Jan 30;34(2):343–60. pmid:25363575
- 73. Forsyth AD, Carey MP, Fuqua RW. Evaluation of the validity of the condom use self-efficacy scale (CUSES) in young men using two behavioral simulations. Health Psychol Off J Div Health Psychol Am Psychol Assoc. 1997 Mar;16(2):175–8. pmid:9269889
- 74. Murphy DA, Rotheram-Borus MJ, Reid HM. Adolescent gender differences in HIV-related sexual risk acts, social-cognitive factors and behavioral skills. J Adolesc. 1998 Apr;21(2):197–208. pmid:9585496
- 75. Lucenko BA, Malow RM, Sanchez-Martinez M, Jennings T, Dévieux JG. Negative affect and HIV risk in alcohol and other drug (AOD) abusing adolescent offenders. J Child Adolesc Subst Abuse. 2003 Sep;13(1):1–17. pmid:19112523
- 76. Lang DL, DiClemente RJ, Hardin JW, Crosby RA, Salazar LF, Hertzberg VS. Threats of Cross-Contamination on Effects of a Sexual Risk Reduction Intervention: Fact or Fiction. Prev Sci. 2009;10(3):270–5. pmid:19241171
- 77. Malow RM, Stein JA, McMahon RC, Devieux JG, Rosenberg R, Jean-Gilles M. Effects of a Culturally Adapted HIV Prevention Intervention in Haitian Youth. Janac-J Assoc Nurses Aids Care. 2009 Apr;20(2):110–21. pmid:19286123
- 78. Chen X, Stanton B, Gomez P, Lunn S, Deveaux L, Brathwaite N, et al. Effects on condom use of an HIV prevention programme 36 months postintervention: a cluster randomized controlled trial among Bahamian youth. Int J Std Aids. 2010 Sep 10;21(9):622–30. pmid:21097734
- 79. Sales JM, Lang DL, Hardin JW, Diclemente RJ, Wingood GM. Efficacy of an HIV prevention program among African American female adolescents reporting high depressive symptomatology. J Womens Health 2002. 2010 Feb;19(2):219–27. pmid:20109119
- 80.
Sarafian I. Evaluation of a peer education program for HIV prevention among hotel-based sex workers in Dhaka, Bangladesh: A social support framework [Internet] [Ph.D.]. [Ann Arbor]: McGill University (Canada); 2011. Available from: http://libproxy.sdsu.edu/login?url=https://search.proquest.com/docview/878223619?accountid=13758
- 81. Stanton B, Chen X, Koci V, Deveaux L, Lunn S, Harris C, et al. Effect of a grade 6 HIV risk reduction intervention four years later among students who were and were not enrolled in the study trial. J Adolesc Health Off Publ Soc Adolesc Med. 2012 Mar;50(3):243–9.
- 82. Wang B, Stanton B, Chen X, Li X, Dinaj-Koci V, Brathwaite N, et al. Predictors of Responsiveness Among Early Adolescents to a School-Based Risk Reduction Intervention Over 3 Years. Aids Behav. 2013;17(3):1096–104. pmid:22311147
- 83. DiClemente RJ, Davis TL, Swartzendruber A, Fasula AM, Boyce L, Gelaude D, et al. Efficacy of an HIV/STI Sexual Risk-Reduction Intervention for African American Adolescent Girls in Juvenile Detention Centers: A Randomized Controlled Trial. Women Health. 2014 Nov;54(8):726–49. pmid:25190056
- 84. Wang B, Stanton B, Deveaux L, Li X, Koci V, Lunn S. The impact of parent involvement in an effective adolescent risk reduction intervention on sexual risk communication and adolescent outcomes. AIDS Educ Prev Off Publ Int Soc AIDS Educ. 2014;26(6):500–20.
- 85.
Hurrell Z. Evaluation of a skills-based condom intervention in an alcohol-using student population: a feasibility study [Internet] [D.Health.Psy.]. [Ann Arbor]: University of the West of England, Bristol (United Kingdom); 2015. Available from: http://libproxy.sdsu.edu/login?url=https://search.proquest.com/docview/1780279617?accountid=13758
- 86. Stanton B, Wang B, Deveaux L, Lunn S, Rolle G, Li X, et al. Assessing the effects of a complementary parent intervention and prior exposure to a preadolescent program of HIV risk reduction for mid-adolescents. Am J Public Health. 2015 Mar;105(3):575–83. pmid:25602877
- 87. Stanton B, Dinaj-Koci V, Wang B, Deveaux L, Lunn S, Li X, et al. Adolescent HIV Risk Reduction in the Bahamas: Results from Two Randomized Controlled Intervention Trials Spanning Elementary School Through High School. AIDS Behav. 2016 Jun;20(6):1182–96. pmid:26499123
- 88. Wang B, Stanton B, Deveaux L, Lunn S, Rolle G, Adderley R, et al. Multi-year school-based implementation and student outcomes of an evidencebased risk reduction intervention. Implement Sci. 2017 Feb 10;12:7. pmid:28086813
- 89. Yu B, Chen X, Stanton B, Chen D-G (Din), Xu Y, Wang Y. Quantum changes in self-efficacy and condom-use intention among youth: A chained cusp catastrophe model. J Adolesc. 2018 Oct;68:187–97. pmid:30118949
- 90. Funder DC, Ozer DJ. Evaluating Effect Size in Psychological Research: Sense and Nonsense. Adv Methods Pract Psychol Sci. 2019 Jun;2(2):156–68.
- 91. Gonçalves TR, Faria ER, Carvalho FT de, Piccinini CA, Shoveller JA, Gonçalves TR, et al. Behavioral interventions to promote condom use among women living with HIV: a systematic review update. Cad Saúde Pública [Internet]. 2017 [cited 2018 Jul 3];33(1). Available from: http://www.scielo.br/scielo.php?script=sci_abstract&pid=S0102-311X2017000102001&lng=en&nrm=iso&tlng=en pmid:28125130
- 92. von Sadovszky V, Draudt B, Boch S. A Systematic Review of Reviews of Behavioral Interventions to Promote Condom Use. Worldviews Evid Based Nurs. 2014 Apr;11(2):107–17. pmid:24119245
- 93. Bluethmann SM, Bartholomew LK, Murphy CC, Vernon SW. Use of Theory in Behavior Change Interventions: An Analysis of Programs to Increase Physical Activity in Posttreatment Breast Cancer Survivors. Health Educ Behav Off Publ Soc Public Health Educ. 2017 Apr;44(2):245–53.
- 94. Davis R, Campbell R, Hildon Z, Hobbs L, Michie S. Theories of behaviour and behaviour change across the social and behavioural sciences: a scoping review. Health Psychol Rev. 2015 Aug 7;9(3):323–44. pmid:25104107
- 95. Stacey FG, James EL, Chapman K, Courneya KS, Lubans DR. A systematic review and meta-analysis of social cognitive theory-based physical activity and/or nutrition behavior change interventions for cancer survivors. J Cancer Surviv Res Pract. 2015 Jun;9(2):305–38.
- 96.
Borenstein M, Hedges LV, Higgins JP, Rothstein HR. Introduction to Meta-Analysis. Wiley-Blackwell; 2009.
- 97.
Nunnally J, Bernstein I. Psychometric Theory. McGraw-Hill Companies,Incorporated; 1994. 786 p.
- 98. Cook DA, Beckman TJ. Current Concepts in Validity and Reliability for Psychometric Instruments: Theory and Application. Am J Med. 2006 Feb 1;119(2):166.e7-166.e16.
- 99. American Education Research Association. Standards for Reporting on Empirical Social Science Research in AERA Publications: American Educational Research Association. Educ Res. 2006 Aug 1;35(6):33–40.
- 100.
American Psychological Association. Publication manual of the American Psychological Association. 5th ed. Washington, D.C.: American Psychological Association; 2001.
- 101.
American Psychological Association. Publication manual of the American Psychological Association. 6th ed. Washington, D.C.: American Psychological Association; 2010.
- 102. Peng C-YJ, Chen L-T, Chiang H-M, Chiang Y-C. The Impact of APA and AERA Guidelines on Effect Size Reporting. Educ Psychol Rev. 2013 Jun 1;25(2):157–209.
- 103. Sun S, Pan W, Wang LL. A Comprehensive Review of Effect Size Reporting and Interpreting Practices in Academic Journals in Education and Psychology. J Educ Psychol. 2010;102(4):989–1004.
- 104. Thompson B. Statistical Significance and Effect Size Reporting: Portrait of a Possible Future. Res Sch. 1998;5(2):33–8.
- 105. Lakens D. Calculating and reporting effect sizes to facilitate cumulative science: a practical primer for t-tests and ANOVAs. Front Psychol [Internet]. 2013 Nov 26 [cited 2018 Mar 30];4. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3840331/ pmid:23378839
- 106.
Thompson B. Research synthesis: Effect sizes. In: Green JL, Camilli G, Elmore PB, editors. Handbook of Complementary Methods in Education Research. Routledge; 2006. p. 383–609.
- 107. Coons MJ, Roehrig M, Spring B. The Potential of Virtual Reality Technologies to Improve Adherence to Weight Loss Behaviors. J Diabetes Sci Technol. 2011 Mar 1;5(2):340–4. pmid:21527103
- 108. Firth J, Torous J, Carney R, Newby J, Cosco TD, Christensen H, et al. Digital Technologies in the Treatment of Anxiety: Recent Innovations and Future Directions. Curr Psychiatry Rep. 2018 Jun 1;20(6):44. pmid:29779065
- 109. Riva G, Gaggioli A, Grassi A, Raspelli S, Cipresso P, Pallavicini F, et al. NeuroVR 2-A free virtual reality platform for the assessment and treatment in behavioral health care. In: MMVR. 2011. p. 493–5. pmid:21335845
- 110. Aïm F, Lonjon G, Hannouche D, Nizard R. Effectiveness of Virtual Reality Training in Orthopaedic Surgery. Arthroscopy. 2016 Jan 1;32(1):224–32. pmid:26412672
- 111. Alaker M, Wynn GR, Arulampalam T. Virtual reality training in laparoscopic surgery: A systematic review & meta-analysis. Int J Surg. 2016 May 1;29:85–94. pmid:26992652
- 112. Larsen CR, Soerensen JL, Grantcharov TP, Dalsgaard T, Schouenborg L, Ottosen C, et al. Effect of virtual reality training on laparoscopic surgery: randomised controlled trial. BMJ. 2009 May 15;338:b1802. pmid:19443914
- 113. Seymour NE, Gallagher AG, Roman SA, O’Brien MK, Bansal VK, Andersen DK, et al. Virtual Reality Training Improves Operating Room Performance. Ann Surg. 2002 Oct;236(4):458–64. pmid:12368674
- 114. Arain M, Haque M, Johal L, Mathur P, Nel W, Rais A, et al. Maturation of the adolescent brain. Neuropsychiatr Dis Treat. 2013;9:449–61. pmid:23579318
- 115. Steinberg L. Cognitive and affective development in adolescence. Trends Cogn Sci. 2005;9(2):69–74. pmid:15668099