World J Mens Health. 2023 Apr;41(2):289-310. English.
Published online Oct 28, 2022.
Copyright © 2023 Korean Society for Sexual Medicine and Andrology
Original Article

Impact of Varicocele Repair on Semen Parameters in Infertile Men: A Systematic Review and Meta-Analysis

Ashok Agarwal,1 Rossella Cannarella,2,3 Ramadan Saleh,4 Florence Boitrelle,5,6 Murat Gül,7 Tuncay Toprak,8 Gianmaria Salvio,9 Mohamed Arafa,10,11 Giorgio I. Russo,12 Ahmed M. Harraz,13,14,15 Rajender Singh,16 Nicolas Garrido,17 Taha Abo-Almagd Abdel-Meguid Hamoda,18,19 Amarnath Rambhatla,20 Parviz Kavoussi,21 Shinnosuke Kuroda,3 Gökhan Çalik,22 Pallavi Saini,16 Erman Ceyhan,23 Fotios Dimitriadis,24 Ralf Henkel,25,26,27 Andrea Crafa,2 Ayad Palani,28 Mesut Berkan Duran,29 Evangelos Maziotis,30,31 Émine Saïs,5,6 Marion Bendayan,5,6 Mahsa Darbandi,32,33 Tan V. Le,34,35 Sezgin Gunes,36 Petroula Tsioulou,30 Pallav Sengupta,37 Berk Hazir,38 Gökhan Çeker,39,40 Sara Darbandi,32,33 Damayanthi Durairajanayagam,41 Azin Aghamajidi,42 Noora Alkhalidi,43 Emrullah Sogutdelen,44 Kristian Leisegang,45 Abdullah Alarbid,14 Christopher C. K. Ho,46 Vineet Malhotra,47 Federica Finocchi,9,48 Luís Crisóstomo,49,50,51 Raghavender Kosgi,52 Haitham ElBardisi,10,11 Armand Zini,53 Ponco Birowo,54 Giovanni Colpi,55 Hyun Jun Park,56,57 Ege Can Serefoglu,58 Quang Nguyen,59,60 Edmund Ko,61 Jean de la Rosette,62 Germar M. Pinggera,63 Ho Vinh Phuoc Nguyen,34,35 Hussein Kandil,64 and Rupin Shah65
    • 1Global Andrology Forum, American Center for Reproductive Medicine, Moreland Hills, OH, USA.
    • 2Department of Clinical and Experimental Medicine, University of Catania, Catania, Italy.
    • 3Glickman Urological & Kidney Institute, Cleveland Clinic Foundation, Cleveland, OH, USA.
    • 4Department of Dermatology, Venereology and Andrology, Faculty of Medicine, Sohag University, Sohag, Egypt.
    • 5Department of Reproductive Biology, Fertility Preservation, Andrology, CECOS, Poissy Hospital, Poissy, France.
    • 6Department of Biology, Reproduction, Epigenetics, Environment and Development, Paris Saclay University, UVSQ, INRAE, BREED, Jouy-en-Josas, France.
    • 7Department of Urology, Selcuk University School of Medicine, Konya, Türkiye.
    • 8Department of Urology, Fatih Sultan Mehmet Training and Research Hospital, University of Health Sciences, Istanbul, Türkiye.
    • 9Department of Endocrinology, Polytechnic University of Marche, Ancona, Italy.
    • 10Department of Urology, Hamad Medical Corporation, Doha, Qatar.
    • 11Department of Urology, Weill Cornell Medical-Qatar, Doha, Qatar.
    • 12Urology Section, University of Catania, Catania, Italy.
    • 13Mansoura University Urology and Nephrology Center, Mansoura, Egypt.
    • 14Department of Surgery, Urology Unit, Farwaniya Hospital, Farwaniya, Kuwait.
    • 15Department of Urology, Sabah Al Ahmad Urology Center, Kuwait City, Kuwait.
    • 16Division of Endocrinology, Central Drug Research Institute, Lucknow, India.
    • 17IVI Foundation, Instituto de Investigación Sanitaria La Fe (IIS La Fe), Valencia, Spain.
    • 18Department of Urology, King Abdulaziz University, Jeddah, Saudi Arabia.
    • 19Department of Urology, Faculty of Medicine, Minia University, Minia, Egypt.
    • 20Department of Urology, Vattikuti Urology Institute, Henry Ford Health System, Detroit, MI, USA.
    • 21Austin Fertility & Reproductive Medicine/Westlake IVF, Austin, TX, USA.
    • 22Department of Urology, Faculty of Medicine, Istanbul Medipol University, Istanbul, Türkiye.
    • 23Department of Urology, Baskent University Faculty of Medicine, Ankara, Türkiye.
    • 24Department of Urology, Medical School, Aristotle University of Thessaloniki, Thessaloniki, Greece.
    • 25Department of Metabolism, Digestion and Reproduction, Imperial College London, London, UK.
    • 26Department of Medical Bioscience, University of the Western Cape, Bellville, South Africa.
    • 27LogixX Pharma, Theale, Berkshire, UK.
    • 28Research Centre, University of Garmian, Kalar, Iraq.
    • 29Department of Urology, School of Medicine, Pamukkale University, Denizli, Türkiye.
    • 30Laboratory of Physiology, Medical School, National and Kapodistrian University of Athens, Athens, Greece.
    • 31Assisted Reproduction Unit, Second Department of Obstetrics and Gynecology, Aretaieion Hospital, Medical School, National and Kapodistrian University of Athens, Athens, Greece.
    • 32Fetal Health Research Center, Hope Generation Foundation, Tehran, Iran.
    • 33Gene Therapy and Regenerative Medicine Research Center, Hope Generation Foundation, Tehran, Iran.
    • 34Department of Andrology, Binh Dan Hospital, Ho Chi Minh City, Vietnam.
    • 35Department of Urology and Andrology, Pham Ngoc Thach University of Medicine, Ho Chi Minh City, Vietnam.
    • 36Department of Medical Biology, Faculty of Medicine, Ondokuz Mayis University, Samsun, Türkiye.
    • 37Department of Biomedical Sciences, College of Medicine, Gulf Medical University, Ajman, UAE.
    • 38Reproductive Medicine, Department of Translational Medicine, Lund University, Malmö, Sweden.
    • 39Department of Urology, Başakşehir Çam and Sakura City Hospital, Istanbul, Türkiye.
    • 40Department of Embryology and Histology, Zonguldak Bülent Ecevit University Institute of Health Sciences, Zonguldak, Türkiye.
    • 41Department of Physiology, Faculty of Medicine, Universiti Teknologi MARA, Sungai Buloh Campus, Selangor, Malaysia.
    • 42Department of Immunology, School of Medicine, Iran University of Medical Sciences, Tehran, Iran.
    • 43Department of Internal Medicine, Trinity Health/Mercy Health, Muskegon, MI, USA.
    • 44Department of Urology, Bolu Abant Izzet Baysal University, Bolu, Türkiye.
    • 45School of Natural Medicine, Faculty of Community and Health Sciences, University of the Western Cape, Bellville, South Africa.
    • 46Department of Surgery, School of Medicine, Faculty of Health and Medical Sciences, Taylor’s University, Subang Jaya, Malaysia.
    • 47Department of Urology and Andrology, VNA Hospital, New Delhi, India.
    • 48Unit of Andrology and Reproductive Medicine, Department of Medicine, University of Padua, Padua, Italy.
    • 49Unidade Multidisciplinar de Investigação Biomédica (UMIB), Instituto de Ciências Biomédicas Abel Salazar (ICBAS), Universidade do Porto, Porto, Portugal.
    • 50Laboratory for Integrative and Translational Research in Population Health (ITR), Universidade do Porto, Porto, Portugal.
    • 51Institute of Biomedicine, University of Turku, Turku, Finland.
    • 52Department of Urology and Andrology, AIG Hospitals, Gachibowli, Hyderabad, India.
    • 53Department of Surgery, McGill University, Montreal, QC, Canada.
    • 54Department of Urology, Cipto Mangunkusumo General Hospital, Faculty of Medicine, Universitas Indonesia, Jakarta, Indonesia.
    • 55Andrology and IVF Center, Next Fertility Procrea, Lugano, Switzerland.
    • 56Department of Urology, Pusan National University School of Medicine, Busan, Korea.
    • 57Medical Research Institute of Pusan National University Hospital, Busan, Korea.
    • 58Department of Urology, Biruni University School of Medicine, Istanbul, Türkiye.
    • 59Center for Andrology and Sexual Medicine, Viet Duc University Hospital, Hanoi, Vietnam.
    • 60Department of Urology, Andrology and Sexual Medicine, University of Medicine and Pharmacy, Vietnam National University, Hanoi, Vietnam.
    • 61Department of Urology, Loma Linda University Health, Loma Linda, CA, USA.
    • 62Department of Urology, Faculty of Medicine, Istanbul Medipol Mega University Hospital, Istanbul, Türkiye.
    • 63Department of Urology, Innsbruck Medical University, Innsbruck, Austria.
    • 64Fakih IVF Fertility Center, Abu Dhabi, UAE.
    • 65Division of Andrology, Department of Urology, Lilavati Hospital and Research Centre, Mumbai, India.
Received July 13, 2022; Accepted July 24, 2022.

This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/4.0) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Purpose

Despite the significant role of varicocele in the pathogenesis of male infertility, the impact of varicocele repair (VR) on conventional semen parameters remains controversial. Only a few systematic reviews and meta-analyses (SRMAs) have evaluated the impact of VR on sperm concentration, total motility, and progressive motility, mostly using a before-after analytic approach. No SRMA to date has evaluated the change in conventional semen parameters after VR compared to untreated controls. This study aimed to evaluate the effect of VR on conventional semen parameters in infertile patients with clinical varicocele compared to untreated controls.

Materials and Methods

A literature search was performed using Scopus, PubMed, Embase, and Cochrane databases following the Population Intervention Comparison Outcome (PICOS) model (Population: infertile patients with clinical varicocele; Intervention: VR [any technique]; Comparison: infertile patients with clinical varicocele that were untreated; Outcome: sperm concentration, sperm total count, progressive sperm motility, total sperm motility, sperm morphology, and semen volume; Study type: randomized controlled trials and observational studies).

Results

A total of 1,632 abstracts were initially assessed for eligibility. Sixteen studies were finally included with a total of 2,420 infertile men with clinical varicocele (1,424 patients treated with VR vs. 996 untreated controls). The analysis showed significantly improved post-operative semen parameters in patients compared to controls with regards to sperm concentration (standardized mean difference [SMD] 1.739; 95% CI 1.129 to 2.349; p<0.001; I2=97.6%), total sperm count (SMD 1.894; 95% CI 0.566 to 3.222; p<0.05; I2=97.8%), progressive sperm motility (SMD 3.301; 95% CI 2.164 to 4.437; p<0.01; I2=98.5%), total sperm motility (SMD 0.887; 95% CI 0.036 to 1.738; p=0.04; I2=97.3%) and normal sperm morphology (SMD 1.673; 95% CI 0.876 to 2.470; p<0.05; I2=98.5%). All the outcomes showed a high inter-study heterogeneity, but the sensitivity analysis showed that no study was sensitive enough to change these results. Publication bias was present only in the analysis of the sperm concentration and progressive motility. No significant difference was found for the semen volume (SMD 0.313; 95% CI -0.242 to 0.868; I2=89.7%).

Conclusions

This study provides a high level of evidence in favor of a positive effect of VR to improve conventional semen parameters in infertile men with clinical varicocele. To the best of our knowledge, this is the first SRMA to compare changes in conventional semen parameters after VR with changes in parameters of a control group over the same period. This is in contrast to other SRMAs which have compared semen parameters before and after VR, without reference to a control group. Our findings strengthen the available evidence and have a potential to upgrade professional societies’ practice recommendations favoring VR to improve conventional semen parameters in infertile men.

Keywords
Male infertility; Semen; Varicocele

INTRODUCTION

Infertility is estimated to impact 15% of couples attempting to conceive worldwide [1]. The male partner is solely responsible in 17.1% of cases [2]. Varicoceles have been identified as the most common surgically correctable cause of male infertility [3]. They are common in the general male population being present in 15% of healthy men [4]. Additionally, 35% to 44% of men with primary infertility and 45% to 81% of men with secondary infertility have a varicocele [5, 6]. In a study conducted by the World Health Organization (WHO), it was shown that men with varicocele had lower sperm concentration and motility than men without varicocele [7]. Another study carried out in healthy men in Europe identified deterioration in sperm quality even in men with a grade 1 varicocele [4].

The American Urological Association (AUA) and the American Society for Reproductive Medicine (ASRM) recommend surgical varicocele repair (VR) of clinical varicoceles in non-azoospermic infertile men with abnormal semen parameters (moderate recommendation; moderate evidence level) [8]. Unfortunately, the term “abnormal semen parameters” is not defined. These recommendations are based primarily on the study by Wang et al [9], in which the effect of different VR techniques on sperm concentration and sperm motility were meta-analyzed. In the latter study, surgical techniques with an inguinal and subinguinal approach had the greatest improvement in sperm concentration and sperm motility parameters (compared with the retroperitoneal technique) [8]. The European Association of Urology (EAU) also recommends VR in infertile men with a clinical varicocele, abnormal semen parameters, and without other male causes of infertility (strong recommendation; high evidence level) [10]. Again, the term “abnormal semen parameters” is not defined. These recommendations are essentially based on two meta-analyses (MAs) that reported an improvement of sperm concentration (mean difference [MD] 9.71 and 12.32×106/mL) [11, 12], total sperm motility (MD 9.92% and 10.86%), progressive sperm motility (MD 9.69%), and sperm morphology (MD 3.16%) after microsurgical VR or surgical VR [11, 12]. The European Academy of Andrology (EAA) asked the question differently, assessing the management of oligo-astheno-teratozoospermia (OAT) [13]. Based on the WHO study, which found a varicocele in a quarter of the 9,304 men with OAT [7], the EAA advises discussing VR in infertile couples whose male partner has a palpable varicocele associated with OAT, highlighting the improvement of semen parameters [11, 12] and/or fertility rates after VR [14, 15].

Hence, although surgical VR is recommended in infertile men with a clinical varicocele and abnormal semen parameters, the sperm parameter(s) used to determine the indication for VR and to assess its efficacy are not detailed. According to a recent worldwide survey, it is also unclear whether VR is indicated or not in cases of isolated oligozoospermia, isolated asthenozoospermia, or isolated teratozoospermia [16].

Despite the well-established role of varicocele in the pathogenesis of male infertility, current literature does not provide enough data to draw firm conclusions as to the impact of VR on semen quality and male fertility potential. Several MAs have shown that it has a positive effect of VR on semen parameters [11, 12, 17, 18]. However, the studies published to date addressing the effect of VR on semen characteristics have been criticized for many reasons such as the inclusion of men with subclinical varicoceles or normal semen parameters, poor study designs, significant drop-outs after randomization, selective reporting or inadequate sample size. Therefore, the aim of this systematic review and meta-analysis (SRMA) was to investigate the impact of VR on conventional semen parameters (semen volume and sperm concentration, total sperm count, total motility, progressive motility, and morphology) in infertile men with clinical varicocele when compared to a control group of infertile men with clinical varicocele that did not undergo VR (i.e., no treatment). The results of the current report will provide an update of the impact of VR on semen parameters in infertile men by adding newer studies and analysing outcomes in comparision to a control group.

MATERIALS AND METHODS

1. Search strategy

A systematic search was conducted from May 2021 to August 2021 using Scopus, PubMed, Embase, and Cochrane databases. In the initial query string on Scopus, the entry term “varicoc*” was searched in combination (AND) with the terms “management” OR “embolization” OR “microsurg*” OR “micro-surg*” OR “repair” OR “correction” OR “treatment” OR “ligation” OR “surg*” OR “operation” OR “radiolog*”. Alternative entry term was “varicocelectomy”. To identify studies evaluating the effect of VR on semen parameters and natural pregnancy, additional keywords, were “sperm*” OR “semen” OR “ejaculate” OR “azoosperm*” OR “oligozoosperm*” OR “asthenozoosperm*” OR “teratozoosperm*” OR “necrozoosperm*” OR “fragmentation” OR “dna” OR “chromatin” OR “sdf” OR “azoo*” or “oxida*” OR “ros” OR “orp” OR “seminal” OR “astheno*” OR “terato*” OR “oligo*” OR “oxygen” OR “pregnan*” OR “conception” OR “child” OR “conceive*” OR “scsa” OR “tunel” OR “apoptiosis” OR “time (AND) to (AND) pregnanc*” OR “fertil*” OR “offspring*”. The query “LIMIT-TO ( DOCTYPE , “ar” )” was used to limit retrieve only original studies. The same combination of terms was used for PubMed, Embase, and Cochrane databases.

The search strategy was performed in compliance with the Meta-analysis Of Observational Studies in Epidemiology (MOOSE) guidelines [19] and the Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-P) [20]. Abstracts of the retrieved articles were independently screened by researchers in duplicate and assessed to confirm their eligibility by 48 researchers, who worked in pairs. Disagreements were resolved by a third person.

The protocol of this SRMA has been registered in the PROSPERO database (ID 329842).

2. Selection criteria

This SRMA included all published studies on infertile men with clinical varicocele that measured conventional semen parameters in varicocele-treated patients vs. untreated controls. There was no language restriction as translation to English was performed by native language researchers. All eligible studies were selected following the PICOS (Population, Intervention, Comparison, Outcome, Study type) model (Supplement Table 1) [21]. Studies on azoospermia, subclinical varicocele, animal studies, in vitro studies, case reports, and case series were excluded.

3. Data extraction

Data extraction was performed by 37 well-trained researchers (24 active researchers and 13 assistant team leaders) divided in four teams, under the supervision of twelve team leaders and co-team leaders. The following data were collected: study design, characteristics of varicocele (laterality, grade, classification used for grading) and VR (method, laterality), time from VR to last follow-up evaluation, number of patients and controls, semen analysis data - semen volume (mL), sperm concentration (×106/mL), total sperm count (×106), sperm vitality (%), total sperm motility (%), progressive motility (%), normal morphology (%), in the infertile men that underwent VR versus a control group that received no treatment. Data were extracted by one researcher and verified by a second researcher. Any disagreements were resolved by a third senior researcher.

4. Quality assessment

The quality of evidence of the included studies was assessed using the following checklists: the Cambridge Quality Checklist [22], which was applied to observational studies (case-control and cohort), the Cochrane Risk of Bias [23], the Jadad score [24], and the CONSORT (consolidated standards of reporting trials) guidelines [25] which were applied to randomized controlled trials (RCTs). Each study was independently evaluated by two researchers, and disagreements were resolved by a third researcher.

5. Statistical analysis

1) Quantitative data analysis

We used Comprehensive Meta-Analysis Software (Version 2; Biostat Inc., Englewood, NJ, USA) for performing MA on quantitative data. We chose the standardized mean difference (SMD) as the effect size for statistical comparison between cases and controls, which allows the comparison even between those studies which did not measure the outcome using the same instruments. Cochran’s Q test and heterogeneity index (I2) were used to assess heterogeneity across pooled studies, with p<0.10 considered as statistically significant [26]. I2 is an indicator of heterogeneity and lies between 0% and 100%, where <25% suggests low heterogeneity, 50% suggests moderate heterogeneity, and 75% suggests high heterogeneity [27]. The pooled effect size was calculated using either the fixed effect or random effects models, depending upon the level of heterogeneity. In case of low heterogeneity, the fixed effect model was adopted while in case of significant heterogeneity, random effects model was adopted. High resolution forest plots were generated for the SMD and confidence interval (CI) for all studies and the pooled data [28].

2) Cumulative analysis

Cumulative analysis was performed to assess the chronological trend of statistical significance over a period of time. For this, the effect size and the corresponding CI were calculated after the addition of each new study in a temporal manner. The trend of p-value and statistical inference was used to draw inferences regarding the strength of the association, its vulnerability to variations and the history of variations.

3) Sensitivity analysis

The pooled effect size and the corresponding CI were calculated after exclusion of one study at a time. A study resulting in the change of inference upon its exclusion was labelled as a ‘sensitive study’.

4) Publication bias analysis

Publication bias was qualitatively analysed by the asymmetry of the funnel plot, which suggested some missing studies on one side of the graph. For quantitative analysis of publication bias, we employed Egger’s intercept test, which evaluated statistical significance of publication bias. In case of the presence of publication bias, unbiased estimates were calculated using the‘trim and fill’ method [29].

The results were independently verified by four experienced biostatisticians (Rajender Singh, Ahmed Harraz, Ralf Henkel, Nicolas Garrido), and their independent analysis showed full agreement. The results reported in this article were analyzed by Rajender Singh.

RESULTS

Using the above-mentioned search strategy, 1,632 abstracts were extracted. After the removal of 661 duplicates, 971 abstracts were assessed. Of these, 100 articles were identified by title and abstract as review articles, case reports, book chapters, papers on different topics or duplicates and were judged ineligible. Of the remaining 871 articles, 164 full-texts were not found, whereas 151 were definitively excluded after reading the full-text because they did not contain analyzable data. Finally, 537 articles included data of VR in the context of male infertility treatment. Of these, 19 studies assessing the impact of VR versus no treatment on basic semen parameters were included in the present analysis (Fig. 1). A full list of excluded studies, with reason, is provided in Supplement Table 2.

Fig. 1
Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) flow-chart.

Among the 19 included studies, 5 reported data on semen volume [30, 31, 32, 33, 34], 13 reported sperm concentration [30, 31, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44], 5 reported total sperm count [30, 34, 36, 37, 45], 7 reported total sperm motility [30, 31, 32, 33, 34, 35, 36], 9 reported progressive sperm motility [30, 36, 37, 38, 39, 41, 42, 43, 44], and 11 reported data on sperm morphology [30, 32, 33, 35, 36, 37, 38, 39, 41, 42, 43]. The main characteristics of the included studies are shown in Table 1.

Table 1
Main characteristics of the included studies

1. Quality of evidence of included studies

Among the 19 included studies, 11 had an observational design and were evaluated using the Cambridge quality checklist; 5 were RCTs and were evaluated using the Cochrane risk bias for RCTs, the CONSORT, and the Jadad’s tools (Table 2).

Table 2
Quality of evidence assessment (results of the Cambridge Quality Checklist [22], Cochrane Risk of Bias for Randomized controlled trials [23], CONSORT guidelines [25] and Jadad score [24])

Although the Cambridge scale does not enstablish a precise threshold to differentiate between high quality and low quality studies, out of a total score of 15, 6 studies scored ≥10 [30, 33, 38, 40, 41, 44], while 5 studies scored 7 to 9 [31, 32, 35, 36, 42].

Among the RCTs, the quality of 4 out 5 studies was ranked as high using the Cochrane’s tool [37, 39, 43, 45]. The CONSORT and the JADAD’s scales both identified the best quality study among the 4 [39]. Only one RCTs was judged as of low quality [34].

2. Semen volume

Five [30, 31, 32, 33, 34] including 732 patients, 439 cases and 293 controls, reported changes of semen volume. At random effect, SMD was 0.313 (95% CI -0.242 to 0.868; I2=89.7%; p>0.05). Hence, VR non-significantly increased the semen volume (Fig. 2). At the sensitivity analysis no study was sensitive enough to change this conclusion (Fig. 3). Also, Egger’s regression model and funnel plots reported no risk of bias (intercept=4.23; 95% CI -4.94 to 13.40; p=0.23) (Fig. 4). Cumulative analysis showed consistent non-significant change in semen volume, except the first study [34] (Fig. 5).

Fig. 2
Forest plot of the semen volume in infertile men with varicocele repair compared to no treatment.

Fig. 3
Forest plot of the semen volume in infertile men with varicocele repair compared to no treatment: sensitivity analysis.

Fig. 4
Funnel plot of the semen volume in infertile men with varicocele repair compared to no treatment.

Fig. 5
Forest plot of the semen volume in infertile men with varicocele repair compared to no treatment: cumulative analysis.

3. Sperm concentration

Fourteen studies including 2,267 subjects (1,347 cases vs. 920 controls) evaluated the sperm concentration parameter [30, 31, 32, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44]. Due to the presence of significant heterogeneity, as demonstrated by the Q-test (Q-value=579.085; p<0.001) and the I2=97.6%, the random effect model was used. There was a significant increase in sperm concentration in favour of VR (SMD 1.739; 95% CI 1.129 to 2.349; p<0.001) (Fig. 6). No study was significantly sensitive enough to alter the above results (Fig. 7). There was a significant publication bias as demonstrated by the Egger’s test (p<0.001) and the asymmetrical funnel plots (Fig. 8). Cumulative analysis showed that sperm concentration achieved significant association with the addition of Di Bisceglie et al [41] in the pool and has stayed significant after that (Fig. 9).

Fig. 6
Forest plot of the sperm concentration in infertile men with varicocele repair compared to no treatment.

Fig. 7
Forest plot of the sperm concentration in infertile men with varicocele repair compared to no treatment: sensitivity analysis.

Fig. 8
Funnel plot of the sperm concentration in infertile men with varicocele repair compared to no treatment.

Fig. 9
Forest plot of the sperm concentration in infertile men with varicocele repair compared to no treatment: cumulative analysis.

4. Total sperm count

Five studies reported the total sperm count in patients treated with VR against no treatment, for a total of 1,073 patients, including 622 cases and 451 controls [30, 34, 36, 37, 45]. The analysis showed a significant improvement in the total sperm count (SMD 1.894; 95% CI 0.566 to 3.222; p<0.05; I2=97.8%) (Fig. 10), and no study was sensitive enough to change this conclusion (Fig. 11). There wasn’t significant publication bias as demonstrated by the Egger’s test (p>0.05) and the symmetrical funnel plots (Fig. 12). Cumulative analysis showed that total sperm count achieved significance with the addition of Ketabchi et al [45] and stayed significant after that (Fig. 13).

Fig. 10
Forest plot of the total sperm count in infertile men with varicocele repair compared to no treatment.

Fig. 11
Forest plot of the total sperm count in infertile men with varicocele repair compared to no treatment: sensitivity analysis.

Fig. 12
Funnel plot of the total sperm count in infertile men with varicocele repair compared to no treatment.

Fig. 13
Forest plot of the total sperm count in infertile men with varicocele repair compared to no treatment: cumulative analysis.

5. Progressive sperm motility

Nine studies assessing the effect of VR on sperm progressive motility were eligible for the analysis [30, 36, 37, 38, 39, 41, 42, 43, 44]. The statistical analysis of 1,438 cases (854 cases vs. 584 controls) on progressive sperm motility indicated considerable heterogenity (I2=98.5%); however, VR demonstrated improvement in all nine studies. The effect of VR were more distinct in the series of Mansour Ghanaie et al [37] and Di Bisceglie et al [42]. The pooled analysis indicates that VR enhanced progressive sperm motility significantly (SMD 3.301; 95% CI 2.164 to 4.437; p<0.01) (Fig. 14). At the sensitivity analysis, no study was sensitive enought to change this conclusion (Fig. 15). Furthermore, publication bias was present, as demonstrated by the Egger’s test (p<0.001) and the asymmetrical funnel plots (Fig. 16). The adjusted values were SMD 3.239 (95% CI 0.030 to 2.448). Cumulative analysis showed that progressive sperm motility became significant after the addition of Di Bisceglie et al [41] and has stayed significant after that (Fig. 17).

Fig. 14
Forest plot of the progressive sperm motility in infertile men with varicocele repair compared to no treatment.

Fig. 15
Forest plot of the progressive sperm motility in infertile men with varicocele repair compared to no treatment: sensitivity analysis.

Fig. 16
Funnel plot of the progressive sperm motility in infertile men with varicocele repair compared to no treatment.

Fig. 17
Forest plot of the progressive sperm motility in infertile men with varicocele repair compared to no treatment: cumulative analysis.

6. Total sperm motility

The random-effects model of 7 studies involving 1,126 participants, 659 who underwent VR and 467 controls [30, 31, 32, 33, 34, 35, 36] showed that there was a significant improvement in total sperm motility in the VR group (SMD 0.887; 95% CI 0.036 to 1.738; p=0.041) (Fig. 18). The interstudy heterogeneity was high (I2=97.3%). No study was sensitive enough to change the conclusion that VR improves total sperm motility (Fig. 19). No publication bias was found, as demonstrated by the Egger test results (p>0.05) and the symmetry of the funnel plots (Fig. 20). Cumulative analysis showed that total sperm motility is slightly significant and is highly vulnerable to changes with the addition of further studies (Fig. 21).

Fig. 18
Forest plot of the total sperm motility in infertile men with varicocele repair compared to no treatment.

Fig. 19
Forest plot of the total sperm motility in infertile men with varicocele repair compared to no treatment: sensitivity analysis.

Fig. 20
Funnel plot of the total sperm motility in infertile men with varicocele repair compared to no treatment.

Fig. 21
Forest plot of the total sperm motility in infertile men with varicocele repair compared to no treatment: cumulative analysis.

7. Sperm morphology

A total of 11 studies included normal sperm morphology in their outcome, overall including 818 cases and 585 controls [30, 32, 33, 35, 36, 37, 38, 39, 41, 42, 43]. There was a significant improvement in normal sperm morphology (SMD 1.673; 95% CI 0.876 to 2.470; p<0.05) (Fig. 22). Furthermore, significant inter-study heterogety was found (I2=98.5%). Also, sensitivity analysis was performed and no study was sensitive enough to change this conclusion (Fig. 23). Furthermore, publication bias was not present, as as demonstrated by the Egger’s test (p>0.05) and the symmetrical funnel plots (Fig. 24). Cumulative analysis showed that sperm morphology achieved significance with the addition of Ghanem et al [38] and has stayed significant after that (Fig. 25).

Fig. 22
Forest plot of the sperm morphology in infertile men with varicocele repair compared to no treatment.

Fig. 23
Forest plot of the sperm morphology in infertile men with varicocele repair compared to no treatment: sensitivity analysis.

Fig. 24
Funnel plot of the sperm morphology in infertile men with varicocele repair compared to no treatment.

Fig. 25
Forest plot of the sperm morphology in infertile men with varicocele repair compared to no treatment: cumulative analysis.

DISCUSSION

Varicocele remains one of the most controversial topics in male infertility. Although most international fertility societies agree on the indication for VR in cases of male infertility with clinically palpable varicocele and abnormal semen parameters [13, 14, 46], there are still some clinicians who doubt the beneficial effect of VR on semen parameters and fertility status [47, 48, 49].

Results of the current MA indicate significant improvements in sperm concentration (SMD 1.864; p<0.001), total sperm count (SMD 1.894; p<0.05), total sperm motility (SMD 0.887; p=0.04), progressive sperm motility (SMD 3.301; p<0.01), and normal sperm morphology (SMD 1.673; p<0.05) in infertile men with clinically palpable varicocele that underwent VR when compared to men who did not undergo VR. VR was also associated with an increase in semen volume but this was not statistically significant. No publication bias could be found in the analyzed studies semen volume, total sperm count, total sperm motility, and normal morphology. For sperm concentration and progressive motility, no study was sensitive enough to change the conclusion of our findings. However, the results of the current MA are limited by the high heterogeneity noted among the included studies.

Over the last 30 years, nearly 2,000 original articles have been published on varicocele and about half of them have evaluated the impact of varicocele and VR on semen parameters [50]. Agarwal et al [12] described the positive effect of VR on semen parameters in a MA of 17 studies. The authors evaluated infertile men with bilateral or unilateral clinically palpable varicoceles and at least one abnormality in semen parameters. The study results reported that sperm concentration, morphology, and sperm motility were significantly increased after microsurgical or high-ligation VR. Baazeem et al [11] performed a similar MA evaluating 17 RCTs before and after varicocelectomy. The results of the latter MA demonstrated that VR resulted in a significant increase in total and progressive sperm motility as well as in sperm concentration. Schauer et al [17] examined the effects of three surgical approaches of VR: subinguinal, inguinal, and high ligation. VR resulted in significant improvement in sperm count and motility independently of the surgical approach. Asafu-Adjei et al [18] performed a MA evaluating the outcome of VR classified by varicocele grade. They concluded that VR showed improvement in sperm concentration and motility across all varicocele grades, but the greatest improvement was observed with higher grade varicoceles. Results emerging from these MAs have led to guidelines from international societies [8, 10, 13] regarding the indications for VR in the management of clinical varicocele.

Previous MAs explored the effect of VR on semen parameters [11, 12, 17, 51]. All these studies adopted a statistical approach that compared preoperative and postoperative semen analyses. They found statistically significant improvement of different semen parameters post-operatively (Table 3). The authors of these studies suggested that the post-operative improvement of semen parameters is not a mere finding due to repetition of testing but is a result of VR. However, the lack of proper control group in these studies left room for doubt on the efficacy of VR.

Table 3
Evidence coming from previous meta-analyses on varicocele repair by comparing preoperative and postoperative semen analyses

For researchers opposing VR as a treatment for male infertility, the main concern is that spontaneous improvement of semen parameters can occur even without intervention and this was not accounted for in various studies due to defective analysis resulting from lack of a proper control group [48, 52]. During the last decade, several MA studies, including Cochrane Database of systematic reviews [13, 53, 54], have primarily focused on the differences in pregnancy and/or life birth rates reported with “treated versus non-treated” varicoceles. Surprisingly, no previously published MA has addressed the comparison of the “after treatment versus after no treatment” variations in conventional semen parameters among patients with varicocele.

In the current MA, we have sought to avoid the shortcomings of previous studies (which compared pre- and post-operative data), and provide more reliable conclusions by only including studies that compared postoperative semen parameters of the treatment group (infertile men where varicocele is repaired) versus the parameters after a similar period of time in the control group (infertile patients with varicocele that were not treated). A proper control group is the key to establish a cause-and-effect relationship of a certain variable [55].

To the best of our knowledge, the present study is the first MA primarily assessing the impact of VR on conventional semen parameters in a population of infertile men with clinical varicocele, as compared to no treatment (Table 4). The findings of our MA are in favour of a positive effect of VR on conventional semen parameters among infertile patients with clinical varicoceles. Our “after treatment versus after no treatment” study comparison should provide a more robust, and higher level of evidence than the other previously published MAs that used the usual “before and after treatment” approach.

Table 4
Summary of the findings of the present study

The primary outcome of the present MA is semen parameters. These represent additional important end point to pregnancy or live birth which are emphasized by other MA on VR [53]. In a recently published global survey, with 574 respondents, exploring the general attitude of clinicians toward the management of varicocele, an increase in the pregnancy rate or in the live birth rate was considered as the primary outcome measure of the success of VR by only 16.3% and the 9.8% of respondents, respectively. Importantly, the 58.7% agreed that a significant improvement in semen parameters could be considered a successful outcome of VR, even if normal values are not reached [16]. This may reflect the understanding that pregnancy and live birth depend upon both male and female factors. VR could improve semen conventional parameters, but the improvement itself alone may not lead to a proportionate increase in pregnancy rates since it depends on several factors in both the male and the female. Therefore, conventional semen parameters represent a valid outcome measure of VR.

Despite the interesting findings of the current MA, there are a few limitations. First, only a few RCTs fulfilled the criteria for inclusion in the analysis. Second, significant heterogeneity was found for all tested outcomes. Third, risk of publication bias was remarkable for studies addressing the impact of VR on sperm concentration and progressive sperm motility. Fourth, there is a concern regarding the quality of the included studies (Table 4).

1. SWOT analysis

The highlights of our MA are summarized in a SWOT analysis (SWOT stands for strengths [S], weaknesses [W], opportunities [O], and threats [T]) (Fig. 26). The “strengths” (S) and “weaknesses” (W) are related to the internal environment while the “opportunities” (O), and “threats” (T) are all external factors that can either enhance or hinder the development of a subject, respectively [56]. Using the SWOT method, we summarize the main advantages and limitations of our MA on the topic of VR in infertile men with clinical varicocele. We also summarize the factors that could limit the use of the results of this MA and address the opportunities that could ensure the wide diffusion of this MA in the medical and scientific community.

Fig. 26
Strengths, Weaknesses, Opportunities, and Threats (SWOT) analysis. RCT: randomized controlled trial, VR: varicocele repair.

CONCLUSIONS

This SRMA of controlled studies, provides further evidence that VR significantly improves conventional semen parameters. To the best of our knowledge, this is the first SRMA to compare changes in conventional semen parameters after VR with changes in parameters of a control group over the same period. This is in contrast to other SRMAs which have compared semen parameters before and after VR, without reference to a control group. Our findings strengthen the available evidence and have a potential to upgrade professional societies’ practice recommendations favoring VR to improve conventional semen parameters in infertile men.

Supplementary Materials

Supplementary materials can be found via https://doi.org/10.5534/wjmh.220142.

Supplement Table 1

The PICOS (Population, Intervention, Comparison, Outcome, Study type) model [21] of the current systematic review and meta-analysis

Click here to view.(70K, pdf)

Supplementary Table 2

Excluded studies with reasons

Click here to view.(138K, pdf)

Notes

Conflict of Interest:The authors have nothing to disclose.

Funding:None.

Author Contribution:

  • Conceptualization: RC, AA, Rupin S.

  • Data curation: AH.

  • Formal analysis: Rajender S.

  • Investigation: FB, Ramadan S.

  • Methodology: TAAAMH.

  • Project administration: AA, Rupin S.

  • Software: Rajender S.

  • Visualization: all authors.

  • Writing – original draft: all authors.

  • Writing – review & editing: all authors.

Acknowledgements

Authors wish to thank the members of the Global Andrology Forum for their support.

References

    1. Thonneau P, Marchand S, Tallec A, Ferial ML, Ducot B, Lansac J, et al. Incidence and main causes of infertility in a resident population (1,850,000) of three French regions (1988-1989). Hum Reprod 1991;6:811–816.
    1. Odisho AY, Nangia AK, Katz PP, Smith JF. Temporal and geospatial trends in male factor infertility with assisted reproductive technology in the United States from 1999-2010. Fertil Steril 2014;102:469–475.
    1. Freeman S, Bertolotto M, Richenberg J, Belfield J, Dogra V, Huang DY, et al. members of the ESUR-SPIWG WG. Ultrasound evaluation of varicoceles: guidelines and recommendations of the European Society of Urogenital Radiology Scrotal and Penile Imaging Working Group (ESUR-SPIWG) for detection, classification, and grading. Eur Radiol 2020;30:11–25.
    1. Damsgaard J, Joensen UN, Carlsen E, Erenpreiss J, Blomberg Jensen M, Matulevicius V, et al. Varicocele is associated with impaired semen quality and reproductive hormone levels: a study of 7035 healthy young men from six European countries. Eur Urol 2016;70:1019–1029.
    1. Gorelick JI, Goldstein M. Loss of fertility in men with varicocele. Fertil Steril 1993;59:613–616.
    1. Jarow JP, Coburn M, Sigman M. Incidence of varicoceles in men with primary and secondary infertility. Urology 1996;47:73–76.
    1. World Health Organization. The influence of varicocele on parameters of fertility in a large group of men presenting to infertility clinics. Fertil Steril 1992;57:1289–1293.
    1. Schlegel PN, Sigman M, Collura B, De Jonge CJ, Eisenberg ML, Lamb DJ, et al. Diagnosis and treatment of infertility in men: AUA/ASRM guideline part I. Fertil Steril 2021;115:54–61.
    1. Wang J, Xia SJ, Liu ZH, Tao L, Ge JF, Xu CM, et al. Inguinal and subinguinal micro-varicocelectomy, the optimal surgical management of varicocele: a meta-analysis. Asian J Androl 2015;17:74–80.
    1. Minhas S, Bettocchi C, Boeri L, Capogrosso P, Carvalho J, Cilesiz NC, et al. EAU Working Group on Male Sexual and Reproductive Health. European Association of Urology guidelines on male sexual and reproductive health: 2021 update on male infertility. Eur Urol 2021;80:603–620.
    1. Baazeem A, Belzile E, Ciampi A, Dohle G, Jarvi K, Salonia A, et al. Varicocele and male factor infertility treatment: a new meta-analysis and review of the role of varicocele repair. Eur Urol 2011;60:796–808.
    1. Agarwal A, Deepinder F, Cocuzza M, Agarwal R, Short RA, Sabanegh E, et al. Efficacy of varicocelectomy in improving semen parameters: new meta-analytical approach. Urology 2007;70:532–538.
    1. Colpi GM, Francavilla S, Haidl G, Link K, Behre HM, Goulis DG, et al. European Academy of Andrology guideline management of oligo-astheno-teratozoospermia. Andrology 2018;6:513–524.
    1. Marmar JL, Agarwal A, Prabakaran S, Agarwal R, Short RA, Benoff S, et al. Reassessing the value of varicocelectomy as a treatment for male subfertility with a new meta-analysis. Fertil Steril 2007;88:639–648.
    1. Kroese AC, de Lange NM, Collins J, Evers JL. Surgery or embolization for varicoceles in subfertile men. Cochrane Database Syst Rev 2012;10:CD000479
    1. Shah R, Agarwal A, Kavoussi P, Rambhatla A, Saleh R, Cannarella R, et al. Consensus and diversity in the management of varicocele for male infertility: results of a global practice survey and comparison with guidelines and recommendations. World J Mens Health. 2022 [doi: 10.5534/wjmh.220048]
      [Epub].
    1. Schauer I, Madersbacher S, Jost R, Hübner WA, Imhof M. The impact of varicocelectomy on sperm parameters: a meta-analysis. J Urol 2012;187:1540–1547.
    1. Asafu-Adjei D, Judge C, Deibert CM, Li G, Stember D, Stahl PJ. Systematic review of the impact of varicocele grade on response to surgical management. J Urol 2020;203:48–56.
    1. Stroup DF, Berlin JA, Morton SC, Olkin I, Williamson GD, Rennie D, et al. Meta-analysis of observational studies in epidemiology: a proposal for reporting. Meta-analysis of observational studies in epidemiology (MOOSE) group. JAMA 2000;283:2008–2012.
    1. Shamseer L, Moher D, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. PRISMA-P Group. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation. BMJ 2015;350:g7647
      Erratum in: BMJ 2016;354:i4086.
    1. Methley AM, Campbell S, Chew-Graham C, McNally R, Cheraghi-Sohi S. PICO, PICOS and SPIDER: a comparison study of specificity and sensitivity in three search tools for qualitative systematic reviews. BMC Health Serv Res 2014;14:579
    1. Murray J, Farrington DP, Eisner MP. Drawing conclusions about causes from systematic reviews of risk factors: the Cambridge Quality Checklists. J Exp Criminol 2009;5:1–23.
    1. Sterne JAC, Savović J, Page MJ, Elbers RG, Blencowe NS, Boutron I, et al. RoB 2: a revised tool for assessing risk of bias in randomised trials. BMJ 2019;366:l4898
    1. Jadad AR, Moore RA, Carroll D, Jenkinson C, Reynolds DJ, Gavaghan DJ, et al. Assessing the quality of reports of randomized clinical trials: is blinding necessary? Control Clin Trials 1996;17:1–12.
    1. Schulz KF, Altman DG, Moher D. CONSORT Group. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. BMJ 2010;340:c332
    1. Huedo-Medina TB, Sánchez-Meca J, Marín-Martínez F, Botella J. Assessing heterogeneity in meta-analysis: Q statistic or I2 index? Psychol Methods 2006;11:193–206.
    1. Higgins JP, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. BMJ 2003;327:557–560.
    1. Andrade C. Mean difference, standardized mean difference (SMD), and their use in meta-analysis: as simple as it gets. J Clin Psychiatry 2020;81:20f13681
    1. Duval S, Tweedie R. A nonparametric “trim and fill” method of accounting for publication bias in meta-analysis. J Am Stat Assoc 2000;95:89–98.
    1. Gomaa MD, Motawaa MA, Al-Nashar AM, El-Sakka AI. Impact of subinguinal varicocelectomy on serum testosterone to estradiol ratio in male patients with infertility. Urology 2018;117:70–77.
    1. McGarry P, Alrabeeah K, Jarvi K, Zini A. Is varicocelectomy beneficial in men previously deemed subfertile but with normal semen parameters based on the new guidelines? A retrospective study. Urology 2015;85:357–362.
    1. Seo JT, Kim KT, Moon MH, Kim WT. The significance of microsurgical varicocelectomy in the treatment of subclinical varicocele. Fertil Steril 2010;93:1907–1910.
    1. Çakan M, Bakirtas H, Aldemir M, Demirel F, Altug U. Results of varicocelectomy in patients with isolated teratozoospermia. Urol Int 2008;80:172–176.
    1. Nilsson S, Edvinsson A, Nilsson B. Improvement of semen and pregnancy rate after ligation and division of the internal spermatic vein: fact or fiction? Br J Urol 1979;51:591–596.
    1. Turgut H. The effect of varicocelectomy on the pregnancy rate in patients with severe oligospermia. Niger J Clin Pract 2020;23:1744–1747.
    1. Gokce MI, Gülpınar O, Süer E, Mermerkaya M, Aydos K, Yaman O. Effect of performing varicocelectomy before intracytoplasmic sperm injection on clinical outcomes in non-azoospermic males. Int Urol Nephrol 2013;45:367–372.
    1. Mansour Ghanaie M, Asgari SA, Dadrass N, Allahkhah A, Iran-Pour E, Safarinejad MR. Effects of varicocele repair on spontaneous first trimester miscarriage: a randomized clinical trial. Urol J 2012;9:505–513.
    1. Ghanem MA, Safan MA, Ghanem AA, Dohle GR. The role of varicocele sclerotherapy in men with severe oligo-astheno-teratozoospermia. Asian J Androl 2011;13:867–871.
    1. Abdel-Meguid TA, Al-Sayyad A, Tayib A, Farsi HM. Does varicocele repair improve male infertility? An evidence-based perspective from a randomized, controlled trial. Eur Urol 2011;59:455–461.
    1. Sathya Srini V, Belur Veerachari S. Does varicocelectomy improve gonadal function in men with hypogonadism and infertility? Analysis of a prospective study. Int J Endocrinol 2011;2011:916380
    1. Di Bisceglie C, Bertagna A, Baldi M, Lanfranco F, Tagliabue M, Gazzera C, et al. Varicocele sclerotherapy improves serum inhibin B levels and seminal parameters. Int J Androl 2007;30:531–536.
    1. Di Bisceglie C, Fornengo R, Grosso M, Gazzera C, Mancini A, Andriani B, et al. Follow-up of varicocele treated with percutaneous retrograde sclerotherapy: technical, clinical and seminal aspects. J Endocrinol Invest 2003;26:1059–1064.
    1. Grasso M, Lania C, Castelli M, Galli L, Franzoso F, Rigatti P. Low-grade left varicocele in patients over 30 years old: the effect of spermatic vein ligation on fertility. BJU Int 2000;85:305–307.
    1. Okuyama A, Fujisue H, Matsui T, Doi Y, Takeyama M, Nakamura N, et al. Surgical repair of varicocele: effective treatment for subfertile men in a controlled study. Eur Urol 1988;14:298–300.
    1. Ketabchi AA, Salajegheh S. The effects of acupuncture treatment in infertile patients with clinical varicocele. Nephrourol Mon 2018;10:e65451
    1. Schlegel PN, Sigman M, Collura B, De Jonge CJ, Eisenberg ML, Lamb DJ, et al. Diagnosis and treatment of infertility in men: AUA/ASRM guideline part II. J Urol 2021;205:44–51.
    1. Silber SJ. The varicocele dilemma. Hum Reprod Update 2001;7:70–77.
    1. Kantartzi PD, Goulis ChD, Goulis GD, Papadimas I. Male infertility and varicocele: myths and reality. Hippokratia 2007;11:99–104.
    1. Silber S. The varicocele argument resurfaces. J Assist Reprod Genet 2018;35:1079–1082.
    1. Agarwal A, Finelli R, Durairajanayagam D, Leisegang K, Henkel R, Salvio G, et al. Comprehensive analysis of global research on human varicocele: a scientometric approach. World J Mens Health. 2022 [doi: 10.5534/wjmh.210202]
      [Epub].
    1. Birowo P, Rahendra Wijaya J, Atmoko W, Rasyid N. The effects of varicocelectomy on the DNA fragmentation index and other sperm parameters: a meta-analysis. Basic Clin Androl 2020;30:15
    1. Baker HW, Kovacs GT. Spontaneous improvement in semen quality: regression towards the mean. Int J Androl 1985;8:421–426.
    1. Persad E, O'Loughlin CA, Kaur S, Wagner G, Matyas N, Hassler-Di Fratta MR, et al. Surgical or radiological treatment for varicoceles in subfertile men. Cochrane Database Syst Rev 2021;4:CD000479
    1. Kroese ACJ, de Lange NM, Collins J, Evers JLH, Marjoribanks J. Surgery or embolization for varicoceles in subfertile men: summary of a Cochrane review. Fertil Steril 2014;102:1553–1555.
    1. Hinkelmann K, Kempthorne O. In: Design and analysis of experiments. 2nd ed. Vol. 1, Introduction to experimental design. Hoboken (NJ): Wiley; 2008.
    1. Teoli D, Sanvictores T, An J. SWOT analysis. In: Abai B, Abu-Ghosh A, Acharya AB, Acharya U, Adhia SG, Sedeh PA, editors. StatPearls. Treasure Island (FL): StatPearls Publishing; 2022.

Metrics
Share
Figures

1 / 26

Tables

1 / 4

PERMALINK