Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Identifying radiation-induced survivorship syndromes affecting bowel health in a cohort of gynecological cancer survivors

  • Gunnar Steineck ,

    Gunnar.Steineck@gu.se

    Affiliations Division of Clinical Cancer Epidemiology, Department of Oncology, Institute of Clinical Sciences, Sahlgrenska Academy at the University of Gothenburg, Gothenburg, Sweden, Department of Oncology and Pathology, Division of Clinical Cancer Epidemiology, Karolinska Institutet, Stockholm, Sweden

  • Viktor Skokic,

    Affiliation Division of Clinical Cancer Epidemiology, Department of Oncology, Institute of Clinical Sciences, Sahlgrenska Academy at the University of Gothenburg, Gothenburg, Sweden

  • Fei Sjöberg,

    Affiliation Division of Clinical Cancer Epidemiology, Department of Oncology, Institute of Clinical Sciences, Sahlgrenska Academy at the University of Gothenburg, Gothenburg, Sweden

  • Cecilia Bull,

    Affiliation Division of Clinical Cancer Epidemiology, Department of Oncology, Institute of Clinical Sciences, Sahlgrenska Academy at the University of Gothenburg, Gothenburg, Sweden

  • Eleftheria Alevronta,

    Affiliation Division of Clinical Cancer Epidemiology, Department of Oncology, Institute of Clinical Sciences, Sahlgrenska Academy at the University of Gothenburg, Gothenburg, Sweden

  • Gail Dunberger,

    Affiliation Institute of caring Sciences, Ersta Sköndal University College, Stockholm, Sweden

  • Karin Bergmark,

    Affiliation Division of Clinical Cancer Epidemiology, Department of Oncology, Institute of Clinical Sciences, Sahlgrenska Academy at the University of Gothenburg, Gothenburg, Sweden

  • Ulrica Wilderäng,

    Affiliation Division of Clinical Cancer Epidemiology, Department of Oncology, Institute of Clinical Sciences, Sahlgrenska Academy at the University of Gothenburg, Gothenburg, Sweden

  • Jung Hun Oh,

    Affiliation Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York, United States of America

  • Joseph O. Deasy,

    Affiliation Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York, United States of America

  • Rebecka Jörnsten

    Affiliation Chalmers University of Technology, Gothenburg, Sweden

Abstract

Background

During radiotherapy unwanted radiation to normal tissue surrounding the tumor triggers survivorship diseases; we lack a nosology for radiation-induced survivorship diseases that decrease bowel health and we do not know which symptoms are related to which diseases.

Methods

Gynecological-cancer survivors were followed-up two to 15 years after having undergone radiotherapy; they reported in a postal questionnaire the frequency of 28 different symptoms related to bowel health. Population-based controls gave the same information. With a modified factor analysis, we determined the optimal number of factors, factor loadings for each symptom, factor-specific factor-loading cutoffs and factor scores.

Results

Altogether data from 623 survivors and 344 population-based controls were analyzed. Six factors best explain the correlation structure of the symptoms; for five of these a statistically significant difference (P< 0.001, Mann-Whitney U test) was found between survivors and controls concerning factor score quantiles. Taken together these five factors explain 42 percent of the variance of the symptoms. We interpreted these five factors as radiation-induced syndromes that may reflect distinct survivorship diseases. We obtained the following frequencies, defined as survivors having a factor loading above the 95 percent percentile of the controls, urgency syndrome (190 of 623, 30 percent), leakage syndrome (164 of 623, 26 percent), excessive gas discharge (93 of 623, 15 percent), excessive mucus discharge (102 of 623, 16 percent) and blood discharge (63 of 623, 10 percent).

Conclusion

Late effects of radiotherapy include five syndromes affecting bowel health; studying them and identifying the underlying survivorship diseases, instead of the approximately 30 long-term symptoms they produce, will simplify the search for prevention, alleviation and elimination.

Introduction

When cancer treatment has eliminated the last malignant cell, the long-term unwanted consequences of the treatment, sadly enough, become lifelong threats to the cured cancer survivor’s health [1]. Concerning cancer situated in the thorax, the threats are handled primarily as a survivorship disease such as, for example, radiation-induced heart failure or cardiac infarction. Such an approach has advantages as compared to using single symptoms as an end point in clinical research [2]. Concerning cancer situated in the pelvic cavity a large number of symptoms have been documented as radiation-induced late effects [3]; it is unclear, however, if these symptoms should be seen as manifestations of one or several survivorship diseases [46]. We have no nosology for radiation-induced survivorship diseases and we do not know which disease decreasing bowel health produces which symptoms. Identifying radiation-induced syndromes among cancer survivors may give insight into the presence of distinct radiation-induced survivorship diseases and the symptoms they produce.

Modern cancer treatment clearly differs from that given 50 years ago [7]. Surgical mortality has declined, e.g. due to anesthesiological achievements and refined surgical techniques. We now have access to an ever increasing number of cytotoxic drugs and biological response modifiers [8]. New technology for imaging of the patient and tumor and for administration of ionizing radiation has made it possible to dramatically increase the ratio between the dose of ionizing radiation to the tumor and unwanted doses to surrounding normal tissue during radiotherapy, an improvement often making it possible to increase doses to the tumor [9]. All these success stories have produced a historically new situation with a large growth in the number of aging cancer survivors—probably in the vicinity of 21 million in Europe—as well as an increasing number of survivors with treatment-induced survivorship diseases that decrease long-term bowel health.

Possibly we already have the means to prevent, alleviate or eradicate a large part of the survivorship diseases that decrease bowel health, means including better dose plans, dietary changes, probiotics or drugs. We just lack the knowledge needed to employ these means satisfactorily. In our division we have developed clinimetric methods to document patient-reported long-term symptoms one by one (atomized symptom documentation) [1013]. These methods give data sets which can be used to disentangle syndromes that may reflect radiation-induced survivorship diseases that produce the symptoms. Moreover, during the 1990s and 2000s by and large all patients with cancer in Sweden in a certain geographical region were treated at the same single clinic for radiotherapy. All residents in Sweden have personal identity numbers which together with population-based registers makes it easy to identify and follow up long-term cancer survivors by using postal questionnaires. Together with a literate and cooperative population we thus have the possibility to retrieve truly population-based information with high accuracy. Benefiting from this situation, we have retrieved patient-reported information on 28 long-term gastrointestinal symptoms among gynecological cancer survivors treated with radiotherapy [14]. Using a novel modification of factor analysis, we here disentangle syndromes among these, syndromes that may be related to distinct radiation-induced survivorship diseases. We also investigate which long-term symptoms to be included in which syndrome.

Methods

Survivors and controls

Dunberger and co-workers describe the data collection in detail [1416]. Between 1991 and 2003 altogether 1800 women were treated with external pelvic radiotherapy for a gynecological malignancy at two clinics in Sweden, by and large corresponding to all relevant patients in two geographical regions. We excluded survivors born 1927 or earlier and who could not understand Swedish (S1 Fig).

Data collection

Qualitative phase.

In semistructured interviews with 23 women, we attempted to document all of the symptoms the survivors had at the time. A secretary transcribed the interviews verbatim, and we sorted the information into groups of statements reflecting specific atomized long-term symptoms. Based on this, we constructed a study-specific questionnaire with wording as close as possible to those of the survivors. For example, when asking for flatulence we gave both of the Swedish words corresponding to fart and wind in English. We asked for occurrence and, selectively, intensity and duration of the symptom [13]. For example, in answering “Do you have uncontrolled loud wind (fart)” answering categories were “No”, “Yes, occasionally”, “Yes, at least once a month,” “Yes, at least once a week,” “Yes, at least 3 times a week,” and “Yes, at least once a day” (a person-incidence scale).

Data collection.

All survivors received a letter and a telephone call before we sent out the questionnaire. Three weeks after posting the questionnaire we sent a thank-you-and-reminder card and, when appropriate, made reminding telephone calls. All actions were taken by neutral third-party secretariat [17]; none of the previously involved health-care professionals were involved or had access to the data.

Ethics statement, as endorsed by the Ethical Review Board, completing the questionnaire and posting it to us was considered as a written consent of participation. The study was approved by the Regional Ethical Review Board (2005/1424-31/4), Stockholm, Sweden.

Statistical analysis

Overview.

To make the analysis blinded, the two involved statisticians used variable names such as “V43” with no labels referring to the symptoms during the programming. We used a modified Exploratory Factor Analysis to define the number of factors that best describe the correlation matrix of the data, factor loadings, factor-specific cutoffs for factor loadings and factor scores (for details, please see the statistical appendix S1 File) [18]. Having ordinal data, we consistently used Spearman’s rank correlation coefficient as input to the Exploratory Factor Analysis. Parameters were estimated using maximum likelihood estimation [19].

Number of factors.

In an effort to avoid over- and underestimation of the optimal number of factors, we used Parallel analysis with 10 000 permutations of the data as well as a version of Kaiser’s rule, based on 10 000 non-parametric bootstrap estimates [2022]. Both methods are based on an investigation of eigenvalues of the estimated data correlation matrix.

Factor-specific factor-loading cutoffs.

We formulated a tailor-made method for setting factor-specific cutoffs. We evaluated this method and made decisions on parameter values based on simulated data from nine distributions of known factor structures.

Factor-score comparison.

We compared quantiles of the factor scores of the survivors and population controls. The factor scores were calculated using only symptoms with factor loadings greater in magnitude than the previously determined factor-specific factor-loading cut-offs. First the two data sets were imputed using mode imputation. The imputed data sets were then combined into one data set that was standardized and the survivor-specific factor scores were calculated as linear combinations of the observations for the survivor and the factor-loadings associated with a specific factor that were larger in magnitude than the factor-specific cutoff. We finally compared, for each factor, the factor-score quantiles of the survivors and the population controls using the Mann-Whitney U test.

Results

As seen in the flow chart (S1 Fig), 650 (79%) of 823 eligible gynecological-cancer survivors and 344 (72%) of 478 eligible matched population-based controls returned a questionnaire. Of the gynecological-cancer survivors we excluded seven with missing information on more than 30 percent of the 28 variables reflecting long-term symptoms and 20 having a bowel stoma, leaving us with 623 survivors for the present analysis. Table 1 shows that most survivors were in the age 60 to 69 category, 63 percent were married or had a partner and 30 percent had a university education. A coding error made the population controls on average younger than the survivors; the difference in mean age was 6.2 years. Any relation between age and symptom occurrence among the population-based controls (data not shown) is weak if at all present.

thumbnail
Table 1. Certain characteristics for 623 gynecological-cancer survivors and 344 population-based controls.

https://doi.org/10.1371/journal.pone.0171461.t001

Number of factors

The optimal number of factors was estimated to be six both when we used Parallel analysis and a bootstrap version of Kaiser's rule (Fig 1 and data in statistical appendix S1 File) [23].

thumbnail
Fig 1. The estimated factor loadings onto the six factors after the Varimax rotation was performed.

Factor loadings are colored according to factor affiliation and are connected by solid lines of the corresponding color. Dashed horizontal lines correspond to the factor specific cutoffs suggested by the Variable Cutoff Method. Crosses of a specific color correspond to factor loadings strictly greater in magnitude than the cutoff of the same color whereas solid dots of a specific color correspond to factor loadings smaller in magnitude than the cutoff of the corresponding color. Using the Variable Cutoff Method 10000 parametric bootstrap estimates of the factor loadings were calculated and 0,0.01,…,0.99,1 were used as candidate cutoffs.

https://doi.org/10.1371/journal.pone.0171461.g001

Symptoms included in each factor

In Table 2 the varying cut-offs for the factor loadings across the six factors are presented along with the factor loading for each symptom and factor. Since each factor is regarded as a syndrome that may reflect a distinct survivorship disease (with the long-term symptoms being seen as manifestations of the disease), we in Table 2 describe the factors as urgency syndrome, leakage syndrome, constipation, excessive gas discharge, excessive mucus discharge and blood discharge. The factors in Table 2 and Figs 2 and 3 are ordered according to the proportion of variance in the data that is explained. Fig 2 shows a graphical view of the symptoms having factor loadings above the factor-specific factor-loading cutoffs. The bars represent the value of the factor loading (and do not represent a confidence interval)–the broader the bar is, the greater the proportion of the variance of the symptom the specific factor explains. Thirteen of the 28 symptoms loaded onto two or more factors.

thumbnail
Table 2. Estimated factor loading structure and factor model properties.

https://doi.org/10.1371/journal.pone.0171461.t002

thumbnail
Fig 2. The result of applying the cutoffs suggested by the Variable Cutoff Method to the estimated factor loadings onto the six factors.

Dots correspond to factor loadings that are strictly greater in magnitude than the factor specific cutoff. Lines through the dots correspond to the magnitude of the specific factor loadings and are presented for comparison purposes only with the aim of identifying the variables that most heavily load onto a specific factor and thus to aid interpretation. The plot illustrates how cutoffs on factor loadings ease the interpretation of the factor loading structure produced by EFA. Several factor loadings are discarded by the Variable cutoff method. Based on this reduced factor loading structures the six factors were interpreted as: Urgency syndrome (red), Leakage syndrome (green), Constipation (dark blue), Excessive gas discharge (light blue), Excessive mucus discharge (magenta), Blood discharge (black).

https://doi.org/10.1371/journal.pone.0171461.g002

thumbnail
Fig 3. Comparisons between estimated factor score quantile positions of survivors and controls for the six factors.

The 0.25, 0.5 (median), 0.75, 0.9 and 0.95 sample quantiles are presented. Scores were calculated based on the reduced factor loading structure. Prior to calculating scores a simple mode imputation was performed. Further Mann-Whitney p-values were calculated and are presented to the left in the figure. Except in the case of the constipation factor, the factor scores of the treated population were found to be distributed significantly differently from the scores of the non-treated population. Clearly, in all cases where these distributions differ, the scores of the survivors tend to be larger than the scores of the controls.

https://doi.org/10.1371/journal.pone.0171461.g003

Comparison between survivors and controls

Fig 3 shows that being a survivor is associated with five of the factors but not with the factor cited as constipation. Notwithstanding that, the symptoms loading onto this factor may have different causes in survivors and population-based controls, we thus have no data to support the belief that constipation is a syndrome related to a survivorship disease.

Classifying a survivor as having a specific syndrome with a factor loading above that of the 95 percentile among the controls, we obtained the following numbers: urgency syndrome (190 of 623, 30 percent), leakage syndrome (164 of 623, 26 percent), excessive gas discharge (93 of 623, 15 percent), excessive mucus discharge (102 of 623, 16 percent) and blood discharge (63 of 623, 10 percent).

Discussion

Using a population-based setting for identifying and retrieving patient-reported information from cancer survivors, we previously have found that gynecological-cancer survivors three to 15 years after radiotherapy have 28 different gastrointestinal symptoms [14]. Applying a modified factor analysis, and comparing with population controls, our results indicate that these 28 symptoms may be seen as five syndromes that may be manifestations of five different radiation-induced survivorship diseases causing a decrease in bowel health.

Technically speaking, the first step in the analyses we performed answered the question “How many factors can be disentangled [20]? In the second step we sought to determine which estimated factor loadings reflect non-zero population factor loadings. The initial identification of six factors was done with two different methods [21]. This observation is thus robust. However, a number of cautions indicate that six may not be the exact number in real life. Although we, during a meticulous qualitative phase, interviewed survivors and experts to search for all manifestations of survivorship diseases occurring among gynecological cancer survivors, we may have missed key symptoms. Moreover, despite repeated face-to-face validation we may have missed key variations in the wording used to identify each of the different symptoms; this error may turn up as varying degrees of sensitivity and specificity in identifying different symptoms during the data collection. All these weaknesses may have compromised our ability to disentangle additional factors that may be captured in a new data collection.

In comparing factor-score quantiles of the cancer survivors and population controls, we found a statistically significant difference for five of the six identified factors. Thus, in the application of these statistical parameters to the real world, we consider the five factors as five distinct treatment-induced survivorship syndromes. We have no biological data from the survivors; for example, we have no tests in the blood or feces for markers indicating inflammatory processes or fibrosis. We are not aware of any previous effort similar to ours in identifying survivorship syndromes. Nevertheless, based on biological, physiological and medical facts presented in the S1 Table we label the five syndromes leakage syndrome, urgency syndrome, excessive mucus discharge, excessive gas discharge and blood discharge. The initiation of the survivorship diseases, manifested by these syndromes, results when unwanted ionizing radiation reaches the anal-sphincter region, the rectum, the sigmoid, the small bowel and possibly also other volumes of normal tissue in the pelvic cavity (S2 Fig). These disease labels are preliminary as are the designations of the organs involved and the mechanisms.

When we varied the details of the factor analysis, fine-tuning which variables to include in a certain factor, e.g., by making varying assumptions for the determination of cut-offs, we produced somewhat different results (data not shown). In the interpretation we thus have a variation in the degree of evidence for which symptoms to include in one of the identified syndromes. But some clear distinctions can be made. No analysis, for example, produced a result in which the three symptoms included in excessive mucus discharge loaded in the factor interpreted as urgency syndrome. Results thus clearly indicate these mucus-related symptoms are produced by processes other than the processes giving the symptoms in urgency syndrome.

Concerning the pathophysiology, we know little about the processes that ultimately produced the symptoms included in respective syndrome. Probably endothelial damage in capillaries in the gut wall attracts white blood cells; they may aggregate causing hypoxia and later ischemia. We believe inflammatory and fibrotic processes in the gut wall, as well as stem-cell depletion, play a role. Possibly changes in the wall of the small bowel, proximal colon, distal colon (sigmoid colon) and rectum are related to varying symptoms. Excessive gas discharge and excessive mucus discharge probably are related to a changed composition and function of the gut microbiota, and we know the microbiota interacts with the gut wall. Endoscopically, in survivors with blood discharge, one can inspect a gut wall exclusively comprised of connective tissue, with telangiectasia and ulcerations that bleed on the surface. Fibrotic muscle in the internal and external anal sphincters probably explains leakage-related symptoms, but some symptoms in the leakage syndrome may also reflect increased pressure on the sphincters. Gall salt malabsorption, and bacterial overgrowth from the colon to the small bowel are well recognized clinically but we have no data to relate these phenomena to the syndromes we identified. If a relation exists between age and symptom occurrence among the population-based controls, it is weak at most. That the controls are younger than the cancer survivors probably does not spuriously affect the conclusion that one of the six identified syndromes is not radiation-induced.

Lacking a basic understanding of how different pathophysiological processes in different parts of the abdomen and gut can be linked to the syndromes we identified (or to single symptoms), it is too early to suggest a nosology for the survivorship diseases decreasing bowel health. This study only concerns females; in males (prostate-cancer survivors) a corresponding factor analysis resulted in four syndromes that may be cited as leakage syndrome, urgency syndrome, excessive mucus discharge and excessive gas discharge/abdominal pain [24]. That is, in that population, four of the five syndromes we identified were disentangled and the data indicate the same survivorship diseases affect men and women concerning the bowel. Possibly new factor analyses on already collected material can give us more information. Combining the loading factor for each symptom with symptom frequency we get a metric (factor score) of the intensity of the syndrome. Using this metric we can investigate different effects of the five syndromes on factors such as dose to different risk organs, smoking, time since treatment and diet—investigating whether the syndromes may manifest different pathophysiological processes. Such a metric of the intensity of a syndrome may assist the search for preventive measures. Toxicity scores and quality-of-life instruments may introduce a noise when symptoms from different syndromes are combined. Such instruments may mix symptoms from different syndromes that reflect different pathophysiological processes. If for example, a genetic factor, or dose to a specific risk organ, is studied, the noise may be reduced if symptoms related to the effect (a pathophysiological process) by the gene or the dose can be studied separately. Concerning today’s survivors, time will show if we can get sharper diagnostic tools and better treatments if we combine the identification of syndromes with tests in the blood and feces, and possibly also endoscopic studies and X-rays, to specific survivorship diseases for which we develop prevention, alleviation and treatments.

Supporting information

S1 Fig. Flow chart.

Inclusion an exclusion criteria of the gynecological-cancer survivors and matched population-based controls and questionnaire return rate.

https://doi.org/10.1371/journal.pone.0171461.s001

(PDF)

S2 Fig. Preliminary designations of the organs involved in the survivorship diseases.

https://doi.org/10.1371/journal.pone.0171461.s002

(TIF)

S1 File. Statistical appendix.

Modified Exploratory Factor Analysis to define the number of factors that best describe the correlation matrix of the data, factor loadings, factor-specific cutoffs for factor loadings and factor scores.

https://doi.org/10.1371/journal.pone.0171461.s003

(DOCX)

S1 Table. Information regarding survivorship diseases and references.

Possible radiation-induced pathophysiological processes in the suggested survivorship diseases.

https://doi.org/10.1371/journal.pone.0171461.s004

(DOCX)

Acknowledgments

We thank the gynecological cancer survivors for providing information. We also thank Larry Lundgren for the language revision.

Author Contributions

  1. Conceptualization: GS RJ VS JOD.
  2. Data curation: KB GD GS.
  3. Formal analysis: VK RJ UW.
  4. Funding acquisition: GS.
  5. Investigation: GS GD KB.
  6. Methodology: VS RJ JOD JHO GS.
  7. Project administration: GS.
  8. Resources: GS.
  9. Software: VS RJ JHO.
  10. Supervision: RJ GS.
  11. Validation: GS VK RJ KB.
  12. Visualization: CB VS FS.
  13. Writing – original draft: GS VS FS CB RJ.
  14. Writing – review & editing: GS VS FS CB EA GD KB UW JHO JOD RJ.

References

  1. 1. Steineck G, Schmidt H, Alevronta E, Sjoberg F, Bull CM, Vordermark D. Toward Restored Bowel Health in Rectal Cancer Survivors. Seminars in radiation oncology. 2016;26(3):236–50. pmid:27238476
  2. 2. Jackson A, Marks LB, Bentzen SM, Eisbruch A, Yorke ED, Ten Haken RK, et al. The lessons of QUANTEC: recommendations for reporting and gathering data on dose-volume dependencies of treatment outcome. Int J Radiat Oncol Biol Phys. 2010;76(3 Suppl):S155–60. pmid:20171512
  3. 3. Michalski JM, Gay H, Jackson A, Tucker SL, Deasy JO. Radiation dose-volume effects in radiation-induced rectal injury. Int J Radiat Oncol Biol Phys. 2010;76(3 Suppl):S123–9. pmid:20171506
  4. 4. Andreyev HJ. Pelvic radiation disease. Colorectal Dis. 2015;17(1):2–6. pmid:25363743
  5. 5. Andreyev HJ, Muls AC, Norton C, Ralph C, Watson L, Shaw C, et al. Guidance: The practical management of the gastrointestinal symptoms of pelvic radiation disease. Frontline Gastroenterol. 2015;6(1):53–72. pmid:25580207
  6. 6. Teo MT, Sebag-Montefiore D, Donnellan CF. Prevention and Management of Radiation-induced Late Gastrointestinal Toxicity. Clin Oncol (R Coll Radiol). 2015;27(11):656–67.
  7. 7. Gilman A. The initial clinical trial of nitrogen mustard. Am J Surg. 1963;105:574–8. pmid:13947966
  8. 8. Goodman LS, Wintrobe MM, et al. Nitrogen mustard therapy; use of methyl-bis (beta-chloroethyl) amine hydrochloride and tris (beta-chloroethyl) amine hydrochloride for Hodgkin's disease, lymphosarcoma, leukemia and certain allied and miscellaneous disorders. Journal of the American Medical Association. 1946;132:126–32. pmid:20997191
  9. 9. Yamauchi FI, Penzkofer T, Fedorov A, Fennessy FM, Chu R, Maier SE, et al. Prostate cancer discrimination in the peripheral zone with a reduced field-of-view T(2)-mapping MRI sequence. Magn Reson Imaging. 2015;33(5):525–30. pmid:25687187
  10. 10. Bergmark K, Avall-Lundqvist E, Dickman PW, Henningsohn L, Steineck G. Vaginal changes and sexuality in women with a history of cervical cancer. The New England journal of medicine. 1999;340(18):1383–9. pmid:10228188
  11. 11. Kreicbergs U, Valdimarsdottir U, Onelov E, Henter JI, Steineck G. Talking about death with children who have severe malignant disease. The New England journal of medicine. 2004;351(12):1175–86. pmid:15371575
  12. 12. Steineck G, Helgesen F, Adolfsson J, Dickman PW, Johansson JE, Norlen BJ, et al. Quality of life after radical prostatectomy or watchful waiting. The New England journal of medicine. 2002;347(11):790–6. pmid:12226149
  13. 13. Steineck G, Bergmark K, Henningsohn L, al-Abany M, Dickman PW, Helgason A. Symptom documentation in cancer survivors as a basis for therapy modifications. Acta Oncol. 2002;41(3):244–52. pmid:12195743
  14. 14. Dunberger G, Lind H, Steineck G, Waldenstrom AC, Nyberg T, Al-Abany M, et al. Self-reported symptoms of faecal incontinence among long-term gynaecological cancer survivors and population-based controls. European journal of cancer. 2010;46(3):606–15. pmid:19926277
  15. 15. Dunberger G, Lind H, Steineck G, Waldenstrom AC, Nyberg T, al-Abany M, et al. Fecal incontinence affecting quality of life and social functioning among long-term gynecological cancer survivors. International journal of gynecological cancer: official journal of the International Gynecological Cancer Society. 2010;20(3):449–60.
  16. 16. Dunberger G, Lind H, Steineck G, Waldenstrom AC, Onelov E, Avall-Lundqvist E. Loose stools lead to fecal incontinence among gynecological cancer survivors. Acta Oncol. 2011;50(2):233–42. pmid:21231784
  17. 17. Mansson A, Henningsohn L, Steineck G, Mansson W. Neutral third party versus treating institution for evaluating quality of life after radical cystectomy. European urology. 2004;46(2):195–9. pmid:15245813
  18. 18. Spearman C. General Intelligence, Objectively Determined and Measured. Am J Psychol. 1904;15 201–93.
  19. 19. Choi J, Zou H, Oehlert G. A penalized maximum likelihood approach to sparse factor analysis. Stat Interface. 2010;3(4):429–36.
  20. 20. Zientek LR, Thompson B. Applying the bootstrap to the multivariate case: bootstrap component/factor analysis. Behavior research methods. 2007;39(2):318–25. pmid:17695360
  21. 21. Efron B. Bootstrap methods: another look at the jackknife. Ann Stat. 1979;7(1):1–26.
  22. 22. Buja A, Eyuboglu N. Remarks on Parallel Analysis. Multivariate behavioral research. 1992;27(4):509–40. pmid:26811132
  23. 23. Kaiser HF. The Varimax Criterion for Analytic Rotation in Factor-Analysis. Psychometrika. 1958;23(3):187–200.
  24. 24. Oh JH, Thor M, Olsson C, Skokic V, Jornsten R, Alsadius D, et al. A Factor Analysis Approach for Clustering Patient Reported Outcomes. Methods Inf Med. 2016;55(5).