Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Can Quality of Life Assessments Differentiate Heterogeneous Cancer Patients?

  • Ryan M. McCabe,

    Current address: American College of Surgeons, Chicago, Illinois, United States of America

    Affiliation Medicine & Science, Cancer Treatment Centers of America at Midwestern Regional Medical Center, Zion, Illinois, United States of America

  • James F. Grutsch,

    Affiliations Medicine & Science, Cancer Treatment Centers of America at Midwestern Regional Medical Center, Zion, Illinois, United States of America, Department of Epidemiology, University of Illinois School of Public Health, Chicago, Illinois, United States of America

  • Swetha B. Nutakki,

    Affiliation Medicine & Science, Cancer Treatment Centers of America at Midwestern Regional Medical Center, Zion, Illinois, United States of America

  • Donald P. Braun,

    Affiliation Medicine & Science, Cancer Treatment Centers of America at Midwestern Regional Medical Center, Zion, Illinois, United States of America

  • Maurie Markman

    rmccabe@facs.org

    Affiliation Medicine & Science, Cancer Treatment Centers of America at Eastern Regional Medical Center, Philadelphia, Pennsylvania, United States of America

Abstract

Purpose

This research conducted a face validation study of patient responses to the application of an HRQOL assessment research tool in a comprehensive community cancer program setting across a heterogeneous cohort of cancer patients throughout the natural history of diagnosed malignant disease, many of whom would not be considered candidates for clinical research trial participation.

Methods

Cancer registries at two regional cancer treatment centers identified 11072 cancer patients over a period of nine years. The EORTC QLQ-C30 was administered to patients at the time of their initial clinical presentation to these centers. To determine the significance of differences between patient subgroups, two analytic criteria were used. The Mann-Whitney test was used to determine statistical significance; clinical relevance defined a range of point differences that could be perceived by patients with different health states.

Results

Univariate analyses were conducted across stratification variables for population, disease severity and demographic characteristics. The largest differences were associated with cancer diagnosis and recurrence of disease. Large differences were also found for site of origin, mortality and stage; minimal differences were observed for gender and age. Consistently sensitive QoL scales were appetite loss, fatigue and pain symptoms, and role (work-related), social and physical functions.

Conclusions

1) The EORTC QLQ-C30 collected meaningful patient health assessments in the context of non-research based clinical care, 2) patient assessment differences are manifested disparately across 15 QoL domains, and 3) in addition to indicating how a patient may feel at a point in time, QoL indicators may also reveal information about underlying biological responses to disease progression, treatments, and prospective survival.

Introduction

Quality of Life (QoL) has become a primary outcome used to measure the value and effectiveness of cancer therapy [1], [2]. Patient reported outcomes may differ from clinician reported observations on symptoms and functioning, and both sets of data when considered together can yield more accurate and predictive patient assessments [3]. Formal QoL assessment tools are not commonly used in clinical practice despite data showing their effectiveness to screen patients for problems, monitor health over time, and improve patient-provider communication [4][6]. One problem has been the difficulty in developing guidelines that interpret the clinical significance of differences in QoL scores. The lack of accepted guidelines has delayed oncologists from developing an intuitive grasp of the clinical meaning of assessment scores [4]. QoL assessment tools are in a similar position where blood pressure cuffs were 100 years ago [7]. Today, physicians understand the significance of blood pressure cuff readings to diagnose and manage hypertension in patients. As a result, such measurements are taken in nearly every clinical setting.

Another problem delaying the integration of these tools into routine patient care is the clinicians' lack of confidence that the published results from clinical trials extrapolate to patients undergoing treatment in the community setting [8]. Often times in medicine, patients in the community setting do not experience the outcomes reported in the clinical trial literature. Clinical trials use highly selected and motivated patients undergoing treatment at leading centers; that is, ideal patients being treated under near ideal conditions. Consequently, the current gap in knowledge about what a QoL profile is for a given health state of a patient in the community setting is stalling the incorporation of these tools in routine clinical practice.

This research conducted a face validation of responses to the clinical application of the EORTC QLQ-C30 tool in a heterogeneous cohort of cancer patients throughout the natural history of diagnosed disease, many of whom would not be considered candidates for clinical trial participation. Patients were stratified into subgroups based on clinical and demographic factors known to influence patient longevity in order to identify differences in symptom burden, functioning and overall quality of life between prognostically distinct groups [9], [10]. In contrast to studies that combine results from multiple trials – such as review papers or meta-data analysis applications – data for this research came from a single cohort, collected over nine years and comprising over 11,000 patients from a North American population.

Prior research used anchor-based and evidence-based methods (e.g., meta-analysis) in longitudinal patient data to determine what changes in scale scores were trivial, small, modest and large [4], [11]. Extensive data collected from cross-cultural research settings have shown QoL symptom and functioning scales reported with the EORTC QLQ-C30 instrument can discriminate patients with different performance status [9], [10]. These approaches using either statistical techniques or anchor-based methods have yet to provide a complete mapping of differences in scale scores to clinically different health states [12], [13]. This work used both statistical and clinical significance measures to contextualize for clinicians the magnitudes of differences in QoL scores between clinically distinct patient cohorts (e.g., by stage of tumor, site of origin, relapse, etc.).

Methods

Study Design

Research staff offered all prospective patients, regardless of treatment or disease history, an opportunity to complete the EORTC QLQ-C30 instrument upon arrival at Cancer Treatment Centers of America (CTCA) at Southwestern Regional Medical Center in Tulsa, OK or CTCA at Midwestern Regional Medical Center in Zion, IL between January 1, 2001 and December 30, 2009. The only criterion for participation was being able to read and complete the survey in English. The instrument was administered during registration at the patient's first visit before they had an opportunity to visit clinical staff. This research was approved by the CTCA Institutional Review Board.

QoL Instrument

The EORTC QLQ-C30 is a validated quality of life (QoL) instrument that collects Patient-Reported Outcomes (PROs) [9], [14], [15]. The tool assesses common cancer symptoms querying patient functioning and presence of symptoms. The instrument consists of 30 questions. Responses range from 1 to 4 for symptom and function items (1 = Not at all, 4 = Very much) or 1 to 7 for global health items (1 = Very poor, 7 = Excellent). Responses are linearly transformed to a 0–100 score in each of 15 categorical, non-overlapping scales (i.e., each item response contributes to only one scale score).

There are nine symptom scales. Fatigue, pain, and nausea/vomiting are comprised of multiple items. The remaining symptom scales are composed of single items regarding dyspnea, appetite loss, insomnia, constipation, diarrhea, and perceived financial effects of the disease and treatment. There are five functioning scales: physical (five-questions), role/work-related (two-questions), cognitive (two-questions), emotional (four-questions), and social (two-questions). The global health scale combines responses to two items pertaining to overall quality of life. For functioning scales and global health, a higher score represents better functioning, while for symptoms, a higher score represents greater symptom burden.

Statistical Methods

Responses were not normally distributed as evident by qualitative visual comparisons and confirmed by a Kolmogorov-Smirnov test comparing distribution to a reference sample (e.g., standard normal distribution). The overall study population was stratified into disparate subgroups for the purpose of making meaningful clinical comparisons. Comparisons were not designed to make cause and effect conclusions but to show differences between archetypical patients representing a variety of clinical conditions. For each set of comparisons, 15 QoL scales which were assumed to be independent were used to test 15 null hypotheses; the multiple comparisons problem was accounted for by a factor of 15 using the Bonferroni correction. Statistical significance was assessed using the Mann-Whitney test with a significance threshold of p<0.05/15 = 0.0033.

Clinically Relevant Differences

The number of patients in this study and each subgroup comparison was relatively large. Differences between large subgroups, while often statistically significant, do not necessarily indicate clinically meaningful differences in health states. No single set of guidelines exists to categorize differences in patient responses to the QLQ-C30 instrument as small, intermediate, or large differences [4], [16], [17]. QoL investigators have reported that scale scores must differ by a ‘minimal’ level for patients to perceive differences in ability to function [18], [19]. Several reports using the EORTC QLQ-C30 tool found asymmetry in magnitude of clinical differences depending on cancer patients' QoL improving or worsening [20], [21]. It is unclear how these insights apply to an analysis that uses a cross-sectional study design. Anchor-based research on the QoL tool used in this study indicated symmetry in differences and linked changes in QLQ-C30 scale scores to patient perception of differences [11]. This scale was applied herein with clinically relevant differences defined as small (5–10), moderate (10–20) or large (>20). All clinically relevant differences reported were statistically significant, unless noted otherwise.

Stratification Variables

Stratification variables were chosen by a panel of clinicians considering prognostic power and availability of data. Demographic and clinical data were provided by hospital cancer registries, and all symptom, functioning and global health scales were included for analysis. Patients were included in this study whose disease effects on their longevity ranged from potentially insignificant (e.g., stage 1 & 2 breast cancer) to limiting their life span to months – metastatic pancreatic disease. Patients were stratified by newly diagnosed/recurrent disease, site of origin, mortality, best AJCC (American Joint Committee on Cancer) stage for newly diagnosed patients, re-classified stage for recurrent patients, number of comorbidities (both pre-existing and post-cancer diagnosis), gender, and age at study. Recurrent disease was re-categorized using staging criteria to indicate current disease state. Patients with newly diagnosed and recurrent disease were assessed as separate cohorts for all comparisons. General population (mostly European) values from the EORTC Reference Manual [22] were used to compare cancer patients' responses with those from an undiagnosed population [9].

Results

Participant Demographics

This study – conducted from January, 2001 through December, 2009 – identified 23,783 potential participants from which 12,357 agreed to complete the instrument preceding initial clinical consultation. 11,469 patients returned the questionnaire; 397 surveys were disqualified due to incomplete responses leaving 11,072 patients included in this research (46.6% response rate).

Three sub-cohorts of patients responded to the QOL surveys (Table 1): patients with newly diagnosed disease who treated at a participating facility (34.3%); patients with recurrent disease who treated at a participating facility (42.3%); and participants who elected to forego treatment at a participating facility (defined as “consults”, (23.4%)).

thumbnail
Table 1. Characteristics of patients who participated and who chose not to participate in the study.

https://doi.org/10.1371/journal.pone.0099445.t001

Median age for patients was 56 years; there was a female preponderance (n = 6374; 55.6%) and 66.3% had disease of the lung, breast, colon, rectum, prostate or pancreas. A significant fraction of patients had newly diagnosed advanced disease (stage 3 or 4, 18.8%) or recurrent disease (42.6%). Most patients who subsequently underwent treatment at a participating facility reported at least one comorbidity (66.5% of newly diagnosed, 61.2% of recurrent disease).

Nearly 23% of the patients who took the EORTC surveys did not undergo therapy at a participating facility. To identify any treatment intention or institutional bias, data were included for the patient and non-patient populations participating in this research (Table 1).

Eligible Patients Who Did Not Participate

Approximately one-half of eligible patients (11,426) did not respond to the QOL surveys, and 527 non-responders had incomplete demographic data (Table 1). To identify any potential study selection bias, comparison of demographics and clinical variables between participants and non-participants revealed similar distributions of age at study, gender, site of origin, and prevalence of recurrent or advanced disease. An exception was the lower prevalence of comorbidities in non-participants – no comorbidities in 60-63% of non-participants vs. 33-38% for participants.

Effects of Disease Status and Site of Origin

Patients grouped by site of origin (prostate, breast, colorectal, lung, and pancreatic) were compared between newly diagnosed and recurrent disease (Table 2, Table S10 in File S1). Among the newly diagnosed, subgroups who reported the highest levels of QoL by site of origin reported the largest differences with recurrent disease. For example newly diagnosed prostate patients reported the highest global health and functioning scores and the lowest symptom burden, but on relapse they reported the largest negative differences in scores in global health, physical, role and social functioning, and in symptoms of fatigue, pain, appetite loss and constipation.

thumbnail
Table 2. QoL scale scores and differences between patient sub-groups by site of origin.

https://doi.org/10.1371/journal.pone.0099445.t002

With the exception of prostate and breast patients, there were small differences between the newly diagnosed and recurrent patients by site of origin. Newly diagnosed pancreatic cancer patients reported among the lowest scores for global health and functioning, and the highest symptom burdens. Negligible differences were observed between newly diagnosed and recurrent pancreatic cancer patients. Two unexpected exceptions to this were with appetite loss and constipation, wherein patients with recurrent pancreatic disease reported significantly less severe scores than newly-diagnosed patients (43.5 vs. 35.4, appetite loss; 32.0 vs. 23.4, constipation; newly-diagnosed vs. recurrent disease cohorts, respectively, Table 2, Table S10 in File S1).

Comparison to Published Reference Values from General Populations

An assumption of the analysis is that the majority of any reference population would be undiagnosed and that cancer patients, across different cultures should report higher symptom and lower functioning scores. Currently, there is no population based reference data from North America. The reference population published by the EORTC [22] was used as the best available comparison (Table S1, Table S9 in File S1). Statistical significance and clinical relevance were applied to these population comparisons for the purpose of providing context.

Newly diagnosed and recurrent patient populations were compared to reported reference values and to each other to differentiate QoL health states at a population level [22], [23]. In comparison to the reference populations, patients reported moderate to large differences for nearly every scale except diarrhea (Table 3, Table S11 in File S1). For both newly diagnosed and recurrent cohorts, the largest differences compared to the general population were financial problems, appetite loss, and social and role (work-related) functioning. A comparison between newly diagnosed and recurrent patients revealed clinically meaningful differences (i.e., lower scores in functioning and higher in symptoms) in global health, physical, role and social functioning, and symptoms of fatigue, pain, and dyspnea.

thumbnail
Table 3. Summary of sub-group comparisons within population, disease severity and demographic characteristics.

https://doi.org/10.1371/journal.pone.0099445.t003

Three Month Mortality

Declines in QoL scores have been reported in longitudinal studies as patients approach death [24], [25]. In this study patients were stratified by mortality occurring within three months of survey. Large and moderate, clinically meaningful differences between patient survival sub-groups were seen in global health; role, physical and social function; fatigue, pain, dyspnea, appetite loss, and constipation. These differences were consistent for both newly-diagnosed and recurrent disease cohorts, though differences were larger between newly diagnosed patient subgroups (Table 3, Table S11 in File S1). Interestingly, the mean and median values for recurrent and newly diagnosed patients who died within three months of baseline were similar, and in all scales except appetite loss, mean scores were clinically indistinguishable (Table S2 in File S1).

Stage

Best AJCC stage was used to classify newly diagnosed patients. Recurrent patients were re-classified by hospital cancer registrars according to standard American College of Surgeons protocols for populating cancer registries. Stage 1 and 2 patients exhibited better global health scores compared to patients with stage 3 or 4 disease for both newly diagnosed and recurrent disease cohorts (Table S3 in File S1). The largest clinically meaningful differences in both cohorts were observed in role, social and physical function and symptoms of appetite loss and fatigue (Table 3, Table S11 in File S1).

Number of Comorbidities

When patients were stratified between <3 or ≥3 comorbidities, both newly diagnosed and relapsed patient cohorts showed clinically meaningful differences in favor of fewer comorbidities in global health (Table S4 in File S1). Differences favoring fewer comorbidities for newly-diagnosed and recurrent patients were also found for role function and symptoms of fatigue, pain, dyspnea, and appetite loss (Table 3, Table S11 in File S1).

Gender and Age

Few comparisons across gender or age were statistically significant. Minimal, clinically insignificant differences were found between men and women for both newly diagnosed and recurrent disease patients (Table S5 in File S1). One small difference was observed in newly diagnosed women reporting lower emotional functioning than males.

Patients were stratified into sub-groups of below median age, or equal to and above median age (Table S6 in File S1). In each cohort global health scores were statistically indistinguishable between the two age groups. Three scales showed small differences, disproportionately affecting the younger sub-group: emotional function, insomnia and financial problems (Table 3, Table S11 in File S1).

Discussion

This study generated a large database of QoL health assessments of heterogeneous cancer patients in a comprehensive community cancer program setting including all phases of the natural history of diagnosed disease. The EORTC QLQ-C30 instrument was found to capture clinically meaningful quality of life differences in patients whose health states ranged from highly curable to hospice bound.

In multiple comparisons moderate and large differences in functioning and symptom scales were found in clinically distinct populations. The largest differences were found when newly diagnosed or relapsed patients were compared to a general population in all scales except diarrhea. A limitation was the lack of availability of a North American reference population.

Clinically meaningful differences were observed when comparing patients categorized by site of origin in newly diagnosed patients. For the global health scale, baseline level differences in descending order were observed for prostate > breast > colorectal > lung > pancreatic and other patients (Table 2, Table S10 in File S1). For certain functional scales, the differences were large enough (∼20 points) to be highly clinically meaningful (e.g., role, social functioning). Similarly, for certain symptom scales, the differences were large enough (20–30 points) to be largely clinically meaningful (e.g., fatigue, pain, appetite loss, constipation). Not surprisingly, dyspnea levels in newly-diagnosed lung cancer patients were highly clinically meaningful and at least twofold greater than levels for other tumor types.

Meaningful differences for newly diagnosed patients could be expected when comparing tumor types with a high preponderance of limited stage disease at diagnosis (e.g., prostate, breast cancer) to tumor types which typically present with more extensive stage disease (e.g., lung, pancreatic). But it is notable that the rank order of functioning and symptom scores was largely maintained when stage 1 and 2 breast and prostate patients were compared to stage 1 and 2 cohorts with colorectal, lung, pancreatic and other cancers (Table S7 in File S1). This suggests that different types of malignant disease that affect QoL are distinct and independent of disease progression, and the tool was able to capture these differences.

Within most sites of origin, relapsed patients reported lower scores for functioning scales and higher symptom scale scores compared to the corresponding newly diagnosed cohort (Table S8 in File S1). Disease progression generally corresponded to clinically significant differences in most functioning and symptom scales. Certain scales – emotional and cognitive functioning, and diarrhea, nausea/vomiting and insomnia – did not reveal differences following disease progression.

Within site of origin subgroups, patients with newly diagnosed prostate or breast disease reported scores that were indistinguishable from the general population's (Table 2, Table S10 in File S1). This was in contrast to newly diagnosed lung and pancreatic cancer patients whose QoL was significantly diminished at diagnosis.

Stage was not found to be a surrogate variable for QoL. Newly diagnosed stage 1 & 2 patients with breast or prostate disease scored nearly identically to the general population, with exceptions of insomnia and financial problems (Table S7 in File S1). Small encapsulated breast and prostate lesions tend not to adversely affect the patient's overall physiological function. However, the emergence of metastatic prostate or breast disease can have an adverse effect on an individual's physiology. This hypothesis could explain the comparatively large negative differences in QoL scales between these patients with stage 1 & 2 and stage 3 & 4 disease [26]. By contrast, newly diagnosed stage 1 & 2 patients in other sites of origin reported moderate to large differences in nearly every scale compared to the general population. This indicates that stage of disease alone is not a sufficient indicator of QoL, and patients with near normal physical assessments may experience mental symptom and functioning burden.

Although most comparison results in this research reflected previous trial research [9], [22], an unexpected observation was made of less severe symptoms of appetite loss and constipation in recurrent pancreatic cancer patients compared with newly diagnosed [27]. This is an example of the potential of this sort of data-driven research conducted across clinical practice to uncover QoL domains that should not be viewed dogmatically in the context of general oncologic practices. Further research is required to show whether such insights can be developed into a tool to identify those pancreatic patients who could benefit from therapy.

Clinically significant differences were observed for multiple function and symptom scales for patients nearing death (mortality < three months from survey). Notably, the magnitudes of these differences were larger for newly diagnosed patients than for those with recurrent disease. When newly diagnosed patients nearing death were compared to recurrent disease patients nearing death, differences across all scales were clinically negligible, except for appetite loss (Table S2 in File S1). This suggests that when patients are stratified by disease progression and near-term mortality, this tool has a greater sensitivity to mortality. This finding supports the hypothesis that patterns of symptom and functioning scale scores could identify patients who are at high risk of dying.

A number of population based survey studies conducted in European populations have reported age and gender differences, but the study cohort showed few differences that were clinically relevant or statistically significant [23], [28].

Certain functioning and symptom scales were found to be relatively more sensitive to differences in a patient's clinical health state. No single scale showed differences across every clinical health state comparison. The symptoms appetite loss, fatigue, pain, and dyspnea were the most consistent and responsive. For patient functioning, physical, role and social functions were most responsive and consistent clinical differentiators. Furthering previous findings by King [13], physical and role functioning scores demonstrated the largest range of means across patient sub-groups, whereas emotional and cognitive function scale means had little variance. Diarrhea, emotional and cognitive scales showed little capacity to differentiate the sub-groups of this study, indicating they may not be effective outcomes measures in this context, regardless of their ability to represent individual patient states.

There were several limitations in this investigation. Clinical relevance of minimally important differences in mean scores was assumed to be the same regardless of direction of difference. This assumption is supported by prior research but is not consistent across all findings [11], [13], [20], [21]. Applying such definitions – derived from longitudinal studies – across different patient sub-groups (e.g., different tumor types) is an additional limitation of this work and may introduce a source of error. Data were not available for every domain relevant to patient QoL, including treatment history, time from diagnosis, performance status and other cancer-specific QoL domains (e.g., peripheral neuropathy). Additional modulating phenomena including response shift [29] and non-disease related factors, such as negative or positive psychological affect, underlying physical robustness, disposition for pain, and the physiological mechanisms for regulating fatigue were also unaccounted [30][35]. Although differences in nearly all scales by age and gender were not found, lack of access to primary data from EORTC's reference populations made it difficult to identify methods of adjusting for age and gender distributions; data were reported without adjustment.

Most of the comparisons in this analysis were similar to those found in clinical literature. This was a significant finding because physicians might assume that patients who participate in clinical trials do not fully represent patients undergoing care in community centers. CTCA patient population may be biased because they can travel 500 miles to get treated. Despite these potential biases in the study cohort, the responses to the QLQ-C30 instrument in a clinical setting were similar to the responses recorded in the EORTC research program [22]. This result indicates that the effect of cancer on patients' symptoms, functioning and evaluation of their overall quality of life is relatively independent of the clinical setting (research vs non-research).

There is extensive data showing that the use of QoL tools in the clinic improves patient-provider communication and patient satisfaction with care [36], [37]. The pervasive, everyday use of QoL tools in cancer clinics remains limited for many reasons. The current study provides support for expanding their use in areas relevant to both clinicians and patients. Including QoL patient reported health assessments in routine medical care would catalyze the discovery of relationships among length and quality of life outcomes, including patient symptoms, functioning, global health and survival [38]. It would enable patient differentiation into more personalized clinical subgroups and provide additional support for clinician and patient decision-making.

Supporting Information

File S1.

Contains the files: Table S1- Mean, median and standard deviations of QoL attributes for EORTC general population (7802), newly diagnosed (3775) and recurrent disease (4711) patients. Table S2- Mean, median and standard deviation of QoL attributes of patients with respect to Mortality < = 3-months Vs >3-months. Table S3- Mean, median and standard deviation of QoL attributes of patients with respect to Stage 1&2 vs 3&4. Table S4- Mean, median and standard deviation of QoL attributes of patients with respect to Comorbidities <3 vs > = 3. Table S5- Mean, median and standard deviation of QoL attributes of patients with respect to Gender and class of case. Table S6- Mean, median and standard deviation of QoL attributes of patients with respect to median Age and class of case. Table S7- Comparison of mean scores between EORTC published general population and newly diagnosed patients with early stage disease. Table S8- Confidence intervals of Patient sub-groups by Site of Origin. Table S9- Confidence intervals for EORTC General Population compared with newly diagnosed and recurrent patients. Table S10- QoL scale scores and differences between patient sub-groups by site of origin. Table S11- Summary of sub-group comparisons within population, disease severity and demographic characteristics.

https://doi.org/10.1371/journal.pone.0099445.s001

(ZIP)

Acknowledgments

Jody Bloom, Diane Ottersen and Yesenia Echevarria contributed significantly in managing research data.

Author Contributions

Conceived and designed the experiments: RMM JFG SBN DPB MM. Performed the experiments: RMM JFG SBN. Analyzed the data: RMM JFG SBN DPB MM. Contributed reagents/materials/analysis tools: RMM JFG SBN. Wrote the paper: RMM JFG SBN DPB MM.

References

  1. 1. Bottomley A (2002) The Cancer Patient and Quality of Life. The Oncologist 7: : 120–125. Available: http://theoncologist.alphamedpress.org/cgi/content/abstract/7/2/120. Accessed 19 January 2012.
  2. 2. Ferrans CE (2007) Differences in what quality-of-life instruments measure. Journal of the National Cancer Institute Monographs: 22–26. Available: http://www.ncbi.nlm.nih.gov/pubmed/17951227.
  3. 3. Quinten C, Maringwa J, Gotay CC, Martinelli F, Coens C, et al. (2011) Patient self-reports of symptoms and clinician ratings as predictors of overall cancer survival. Journal of the National Cancer Institute 103: 1851–1858 Available: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=3243678&tool=pmcentrez&rendertype=abstract.
  4. 4. Cocks K, King MT, Velikova G, Martyn St-James M, Fayers PM, et al. (2011) Evidence-based guidelines for determination of sample size and interpretation of the European Organisation for the Research and Treatment of Cancer Quality of Life Questionnaire Core 30. Journal of Clinical Oncology 29: 89–96 Available: http://www.ncbi.nlm.nih.gov/pubmed/21098316.
  5. 5. Halyard MY, Ferrans CE (2008) Quality-of-Life assessment for routine oncology clinical practice. The journal of supportive oncology 6: 221–233 Available: http://www.ncbi.nlm.nih.gov/pubmed/18551858.
  6. 6. Velikova G, Stark D, Selby P (1999) Quality of life instruments in oncology. European journal of cancer (Oxford, England: 1990) 35: : 1571–1580. Available: http://www.ncbi.nlm.nih.gov/pubmed/10673964. Accessed 2 August 2012.
  7. 7. Sloan JA (2003) Assessing the clinical significance of Quality of Life (QOL) measures. Society of Clinical Research Associates: 23–24. Available: http://www.socra.org/pdf/200311_AssessingClinSigQualOfLife.pdf.
  8. 8. Unger JM, Barlow WE, Martin DP, Ramsey SD, LeBlanc M, et al.. (2014) Comparison of Survival Outcomes Among Cancer Patients Treated In and Out of Clinical Trials. JNCI J Natl Cancer Inst.
  9. 9. Aaronson NK, Ahmedzai S, Bergman B, Bullinger M, Cull A, et al. (1993) The European Organization for Research and Treatment of Cancer QLQ-C30: a quality-of-life instrument for use in international clinical trials in oncology. Journal Of The National Cancer Institute 85: 365–376 Available: http://jnci.oxfordjournals.org/content/85/5/365.short.
  10. 10. Bjordal K, De Graeff A, Fayers PM, Hammerlid E, Van Pottelsberghe C, et al. (2000) A 12 country field study of the EORTC QLQ-C30 (version 3.0) and the head and neck cancer specific module (EORTC QLQ-H&N35) in head and neck patients. European Journal of Cancer 36: 1796–1807.
  11. 11. Osoba D, Rodrigues G, Myles J, Zee B, Pater J (1998) Interpreting the significance of changes in health-related quality-of-life scores. Journal of Clinical Oncology 16: 139–144 Available: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=PubMed&dopt=Citation&list_uids=9440735.
  12. 12. Cocks K, King MT, Velikova G, Fayers PM, Brown JM (2008) Quality, interpretation and presentation of European Organisation for Research and Treatment of Cancer quality of life questionnaire core 30 data in randomised controlled trials. European Journal of Cancer 44: 1793–1798 Available: http://www.ncbi.nlm.nih.gov/pubmed/18599286.
  13. 13. King MT (1996) The interpretation of scores from the EORTC quality of life questionnaire QLQ-C30. Quality of life research an international journal of quality of life aspects of treatment care and rehabilitation 5: 555–567 Available: http://www.ncbi.nlm.nih.gov/pubmed/8993101.
  14. 14. Osoba D, Aaronson N, Zee B, Sprangers M, Te Velde A (1997) Modification of the EORTC QLQ-C30 (version 2.0) based on content validity and reliability testing in large samples of patients with cancer. Quality of life research 6: 103–108 Available: http://www.ncbi.nlm.nih.gov/pubmed/9161109.
  15. 15. Bowling A (2001) Measuring disease: a review of disease-specific quality of life measurement scales. Sociology of Health and Illness 18: : 395 pp. Available: http://eprints.kingston.ac.uk/17298/.
  16. 16. Guyatt GH, Feeny DH, Patrick DL (1993) Measuring health-related quality of life. Annals of Internal Medicine 118: 622–629 Available: http://www.ncbi.nlm.nih.gov/pubmed/8452328.
  17. 17. Katz JN, Larson MG, Phillips CB, Fossel AH, Liang MH (1992) Comparative measurement sensitivity of short and longer health status instruments. Medical Care 30: 917–925 Available: http://www.ncbi.nlm.nih.gov/pubmed/1405797.
  18. 18. Norman GR, Sloan JA, Wyrwich KW (2003) Interpretation of changes in health-related quality of life: the remarkable universality of half a standard deviation. Medical Care 41: 582–592 Available: http://journals.lww.com/lww-medicalcare/Abstract/2003/05000/Interpretation_of_Changes_in_Health_related.4.aspx.
  19. 19. Pickard AS, Neary MP, Cella D (2010) Estimation of minimally important differences in EQ-5D utility and VAS scores in cancer. Health and Quality of Life Outcomes 8: 4 Available: http://ovidsp.ovid.com/ovidweb.cgi?T=JS&PAGE=reference&D=medl&NEWS=N&AN=18154669.
  20. 20. Cella D, Hahn EA, Dineen K (2002) Meaningful change in cancer-specific quality of life scores: differences between improvement and worsening. Quality of life research an international journal of quality of life aspects of treatment care and rehabilitation 11: 207–221 Available: http://www.ncbi.nlm.nih.gov/pubmed/12074259.
  21. 21. Maringwa J, Quinten C, King M, Ringash J, Osoba D, et al. (2011) Minimal important differences for interpreting health-related quality of life scores from the EORTC QLQ-C30 in lung cancer patients participating in randomized controlled trials. Supportive care in cancer official journal of the Multinational Association of Supportive Care in Cancer 19: 1753–1760 Available: http://aithon.ngcsn.net/netacgi/getref2.pl?ref=P-20886240.
  22. 22. Scott NW, Fayers PM, Aaronson NK, Bottomley A, Graeff A de, et al.. (2008) EORTC QLQ-C30 Reference Values. Available: http://groups.eortc.be/qol/downloads/reference_values_manual2008.pdf.
  23. 23. Van De Poll-Franse L V, Mols F, Gundy CM, Creutzberg CL, Nout RA, et al. (2011) Normative data for the EORTC QLQ-C30 and EORTC-sexuality items in the general Dutch population. European Journal of Cancer 47: 667–675.
  24. 24. Jordhoy MS, Fayers P, Loge JH, Saltnes T, Ahlner-Elmqvist M, et al. (2001) Quality of life in advanced cancer patients: the impact of sociodemographic and medical characteristics. British Journal of Cancer 85: 1478–1485 Available: http://dx.doi.org/10.1054/bjoc.2001.2116.
  25. 25. Tishelman C, Petersson L-M, Degner LF, Sprangers MAG (2007) Symptom prevalence, intensity, and distress in patients with inoperable lung cancer in relation to time of death. Journal of Clinical Oncology 25: 5381–5389 Available: http://www.ncbi.nlm.nih.gov/pubmed/18048819.
  26. 26. Lee YT (1983) Breast carcinoma: pattern of metastasis at autopsy. Journal of surgical oncology 23: 175–180.
  27. 27. Conroy T, Desseigne F, Ychou M, Bouché O, Guimbaud R, et al. (2011) FOLFIRINOX versus gemcitabine for metastatic pancreatic cancer. The New England Journal of Medicine 365: 1817–1825 Available: http://www.ncbi.nlm.nih.gov/pubmed/21561347.
  28. 28. Hjermstad MJ, Fayers PM, Bjordal K, Kaasa S (1998) Using reference data on quality of life—the importance of adjusting for age and gender, exemplified by the EORTC QLQ-C30 (+3). European Journal of Cancer 34: 1381–1389 Available: http://linkinghub.elsevier.com/retrieve/pii/S0959804998001361.
  29. 29. Visser MRM, Oort FJ, Sprangers MAG (2005) Methods to detect response shift in quality of life data: a convergent validity study. Quality of life research 14: 629–639 Available: http://www.ncbi.nlm.nih.gov/pubmed/16022057.
  30. 30. Cohen S, Pressman SD (2006) Positive Affect and Health. Current Directions in Psychological Science 15: 122–125 Available: http://cdp.sagepub.com/lookup/doi/10.1111/j.0963-7214.2006.00420.x.
  31. 31. Grutsch JF, Ferrans C, Wood PA, Du-Quiton J, Quiton DFT, et al. (2011) The association of quality of life with potentially remediable disruptions of circadian sleep/activity rhythms in patients with advanced lung cancer. BMC Cancer 11: 193 Available: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=3114794&tool=pmcentrez&rendertype=abstract.
  32. 32. Du-Quiton J, Wood PA, Burch JB, Grutsch JF, Gupta D, et al. (2010) Actigraphic assessment of daily sleep-activity pattern abnormalities reflects self-assessed depression and anxiety in outpatients with advanced non-small cell lung cancer. Psycho-Oncology 19: 180–189 Available: http://dx.doi.org/10.1002/pon.1539.
  33. 33. Gordon JS (2008) Mind-body medicine and cancer. Hematology/oncology clinics of North America 22: 683–708 Available: http://www.sciencedirect.com/science/article/B7RM3-4T0NT9M-C/2/0a344ee66b1376ccaaea5455bc42c51f.
  34. 34. Rabkin JG, McElhiney M, Moran P, Acree M, Folkman S (2009) Depression, distress and positive mood in late-stage cancer: a longitudinal study. Psycho-oncology 18: : 79–86. Available: http://www.ncbi.nlm.nih.gov/pubmed/18613295. Accessed 19 January 2012.
  35. 35. Sprangers MAG, Sloan JA, Barsevick A, Chauhan C, Dueck AC, et al. (2010) Scientific imperatives, clinical implications, and theoretical underpinnings for the investigation of the relationship between genetic variables and patient-reported quality-of-life outcomes. Quality of life research 19: 1395–1403 Available: http://www.ncbi.nlm.nih.gov/pubmed/20945161.
  36. 36. Lis CG, Rodeghier M, Gupta D (2009) Distribution and determinants of patient satisfaction in oncology: A review of the literature. Patient preference and adherence 3: 287–304.
  37. 37. Velikova G, Keding A, Harley C, Cocks K, Booth L, et al.. (2010) Patients report improvements in continuity of care when quality of life assessments are used routinely in oncology practice: Secondary outcomes of a randomised controlled trial. European Journal of Cancer. Vol. 46 . pp. 2381–2388.
  38. 38. Wilson IB, Cleary PD (1995) Linking Clinical Variables With Health-Related Quality of Life. The Journal Of The American Medical Association 273: 59–65 Available: http://jama.ama-assn.org/content/273/1/59.short.