The development and validation of the Cluster Headache Quality of life scale (CHQ)

Abstract

Background

Cluster headache (CH) is a rare, excruciating and highly disabling primary headache disorder. Using non cluster headache specific measures, previous studies have shown that CH has a significant negative impact on patients’ quality of life (QoL), but a CH-specific QoL scale is currently unavailable. Thus, the objective of this study was to develop and validate a CH-specific QoL scale.

Methods

Based on a literature review, semi-structured patient interviews and expert panel consultation, we produced a 54-item questionnaire, which was pre-tested in a sample of CH patients and subsequently reduced to 47 items. The revised scale was then administered to CH sufferers attending a tertiary headache clinic and those registered with a patient group. A total of 406 completed questionnaires were received. To assess test-retest reliability, a subsample (N = 56) completed the scale on a second occasion, two weeks after the first. Standard statistical methods were used to analyse the data for validity and reliability.

Results

Item reduction and exploratory factor analysis led to 28-items, grouped into four subscales labelled “restriction of activities of daily living”, “impact on mood and interpersonal relationships”, “pain and anxiety”, and “lack of vitality”. The final CH-specific QoL scale, the CHQ, demonstrated satisfactory internal consistency (Cronbach’s alpha > 0.9) and test-retest reliability (intraclass correlation coefficient > 0.8), with good internal construct validity between subscales (range 0.52–0.75) and convergent validity with other QoL measures.

Conclusions

We have developed and validated the first patient-reported outcome measure of QoL specifically for CH sufferers, which may be used to monitor QoL in clinical care and research.

Background

Quality of life (QoL) scales have increasingly emerged as an important clinical outcome measure for assessing the impact of a disorder and its treatment on patients’ wellbeing [3, 18]. Within the headache field, much of the interest in this area has been focused on migraine, due to its high prevalence. A number of disease-specific QoL instruments have been developed for migraine [11, 14, 17, 23]. Similar measures for other primary headache types, such as cluster headache, are not yet available.

Cluster headache (CH) is a rare, excruciating and highly disabling headache that is strictly lateralised, typically associated with prominent cranial autonomic features or a sense of restlessness or agitation [10, 12]. In CH, assessment of QoL is currently limited to use of generic scales, such as the SF-36, and headache disability instruments, which have shown significantly diminished scores compared to headache-free controls [2, 5, 7, 16, 21]. Moreover, a study found significant differences between CH patients in the ictal versus the interictal period, but no significant differences between CH patients and migraineurs [7]. The authors postulated that since the study used a migraine-specific measure, it might not have been able to truly capture the essential aspects of CH [7]. In light of this and the differences between the two headache entities, we aim to develop a CH-specific QoL tool, which may better reflect the true nature of the daily life impact of this highly disabling disorder. We report the development and validation of a disease-specific QoL instrument for CH.

Methods

Ethical approval for this study was obtained from The North West London Research Ethics Committee (Date of ethics approval: 26 July 2010, Ethics ID number: 10/H0722/43). Informed written consent was obtained from all participants prior to enrolment in the study. Data was collated in an electronic database and all statistical analyses were performed using SPSS-PASW software version 18. A three-step approach was employed in the development and validation of the scale: first item generation; second item reduction and scale development; and, finally scale validation and reliability testing.

Item generation

A comprehensive review of the literature was conducted and existing headache-specific QoL scales were studied to generate an overview of the areas of life impacted by CH. This was followed by an in-depth semi-structured interview of 24 episodic and chronic CH patients in 2010 (M:F 2.6:1, mean age 46.3 years), diagnosed according to the diagnostic criteria of the International Classification of Headache Disorders (ICHD-II) [12], who are registered with the headache clinic at The National Hospital for Neurology and Neurosurgery, London and were living in and around the Greater London area. The topics covered during the interview included pain characteristics, aspects of the patient’s life that were affected by their headaches, their support system, and their outlook on life. These processes allowed generation of a preliminary questionnaire, which was then discussed with a panel of experts with an interest in headache. Any ambiguous or similar items were eliminated or grouped together, before a final set of items were agreed upon. A 54-item questionnaire was subsequently drafted, each with a range of five possible answers on a Likert scale: never, occasionally, sometimes, often and always, addressing areas of life impacted by CH within the past month or during their last cluster bout. A visual analogue scale (VAS) was added to the end of the questionnaire to rate overall satisfaction with life (0 = extremely dissatisfied, 100 = extremely satisfied). Subsequently, a pilot study was conducted with 24 CH patients to assess the face validity and clarity, and the questionnaire was then adjusted accordingly and reduced to 47-items.

Item reduction and scale development

There were two sources of CH participants for this study: (i) Patients with a diagnosis of CH attending the headache clinic at The National Hospital for Neurology and Neurosurgery, London and (ii) an invitation letter to participate in the survey was posted out to CH participants via OUCH UK (The Organisation for the Understanding of Cluster Headache, United Kingdom). Those who responded to the invitation letter were contacted via telephone and had their headaches phenotyped via a telephone interview. Inclusion criteria for the study were those who had a clinical diagnosis of CH, whilst the exclusion criteria were those who had other major neurological, psychiatric or physical illness. A booklet of questionnaires, which included the 47-item CH-QoL questionnaire was then given or posted out to all participants who satisfied the ICHD-II diagnostic criteria for CH (n = 521) from 2011 to 2013. Details on demographics, headache history and characteristics were collected from the questionnaires. A number of other frequently utilised generic or headache specific QoL instruments were also included in the booklet to allow assessment of convergent validity of this new scale, including the SF-36 Health Survey Questionnaire, the EuroQoL (EQ-5D) Questionnaire and the Migraine-Specific Quality of Life Questionnaire Version 2.1 (MSQ v2.1).

The SF-36 Health Survey Questionnaire is a generic QoL measure with excellent reliability and validity [24]. It contains 36 self-administered items, measuring functions in eight domains; physical functioning (PF), role-physical (RP), bodily pain (BP), general health (GH), vitality (VT), social role functioning (SF), emotional role functioning (EF) and mental health (MH). The subscales are scored on a scale of 0 to 100, with higher scores indicating better QoL in the domain being measured [24].

The EuroQoL (EQ-5D) Questionnaire is a generic measure of current health status. It consists of five domains: mobility, self-care, usual activities, pain/discomfort and anxiety/depression. In addition, there is a visual analogue scale, with 0 being the worst imaginable and 100 being the best imaginable current health state [19].

The Migraine-Specific Quality of Life Questionnaire Version 2.1 (MSQ v2.1) is a 14-item measure specifically developed to assess the QoL in patients with migraine. The items are divided across three domains; role restrictive, role preventive and emotional functioning. This questionnaire has been shown to have good internal consistency and construct validity [17]. The total possible score ranges from 14 to 84, with higher scores indicating poorer QoL.

A total of 406 completed questionnaires were received, giving a response rate of 77.9 %. From this total, 36.5 % were recruited from the headache clinic and 63.5 % were recruited from OUCH UK. About fifty-nine percent of the responders had episodic CH and 41.1 % had chronic CH. The mean age of the study sample was 52.4 years (range 20.5–84.4). There were 68.2 % males and 31.8 % females, with a mean age of onset of CH of 33.0 years (range 8.0–69.0).

Intercorrelation between variables was performed on the data generated from the survey. Items that showed low intercorrelations (r < 0.1) were excluded as this demonstrated that they were poorly correlated with the underlying scale. On the other hand, any items that showed high intercorrelations (r > 0.7) [6] were examined and the least clinically sensible item was excluded, as theoretically items that correlated too highly are measuring the same underlying dimension [8].

Scale validation and reliability testing

Construct validity was assessed with an exploratory factor analysis to determine the key components of the 47-item questionnaire. Oblique rotation was used for the analysis, as we had reason to believe that the resulting factors would correlate with each other. An eigenvalue cut off point >1 was used to extract underlying factors. Concurrent validity was assessed by measuring the Pearson’s correlation of the underlying subscales of the CH-specific HRQoL questionnaire with the subscales of SF-36 and MSQ v2.1. Meanwhile, Spearman’s correlation test was employed to assess validity of the questionnaire and the EQ-5D, due to the ordinal nature of the latter.

A second copy of the 47-item questionnaire was sent out to 75 respondents (approximately 15 % of the main validation sample size) two weeks after the first completion of it to allow assessment of the test-retest reliability of the new scale. Fifty-six completed questionnaires were received (71.7 % response rate) for the assessment of test-retest reliability. The mean age of this subsample was 55.7 years (range 34.7–79.1). There were 66.1 % males and 33.9 % females, with a mean age of onset of CH of 36.4 years (range 12.0–66.0).

Results

Participants

There were no significant differences in the sociodemographic and headache characteristics of the participants based on the source of their recruitment, as shown in Table 1. Moreover, no significant differences were found in the CH-specific HRQoL scores between males and females.

Table 1 Sociodemographic and headache characteristics of the participants based on method of recruitment

Construct validity

The exploratory factor analysis produced five factors, consisting of 37 items. One factor with an eigenvalue of 1.11 (explaining 3.1 % of the variance) was removed as it only had one item loading onto it and therefore was considered insufficient to produce a meaningful subscale [22]. The remaining factors and items were then examined to determine if there was any scope for further reduction of the number of items to produce a more meaningful and user-friendly scale. Eight items were omitted as they failed to gain significant loading (>0.4) on any of the factors created. This resulted in a 28-item questionnaire (CHQ), which explained 56.1 % of the variance (Table 2). The Cronbach’s alpha was calculated and compared for the factors prior to, and after removal of these items, to ensure that it did not compromise the internal consistency of the scale [4]. Expert opinion was also sought throughout this process to ensure there was no removal of clinically relevant items.

Table 2 Results of the principal component factor analysis of the CHQ scale

Based on the results of the factor analysis, nine items were grouped onto a factor addressing various ‘Restrictions of activities of daily living’ (ADL), such as avoiding leaving the house, making plans and inability to complete duties at work. Twelve items described ‘Impact on mood and interpersonal relationships’, such as feelings of being dismissed by others and worthlessness, including any suicidal tendencies. Two items loaded on a ‘Pain and anxiety’ factor, which addressed the pain of the cluster headache and any associated anxiety such as dreading that the headache not going away. Finally, a ‘Lack of vitality’ (five items) factor addresses problems related to energy and cognition, for example difficulties in thinking clearly and concentration. There was good intercorrelation between the subscales (range 0.52–0.75) derived from the factor analysis, supporting internal construct validity. There was also a moderate correlation between the total score and the VAS (r = −0.57, p < 0.01). This negative correlation was expected as their scores ran in opposite direction (higher VAS indicates better HRQoL whereas higher total score indicates poorer HRQoL).

Internal consistency and test-retest reliability

The scale had a Cronbach’s coefficient alpha (α) of 0.95, which was well above the recommended criteria of 0.70. The internal consistency and corrected item to total correlations of the items to their resulting subscale is shown in Table 3. Test-retest reliability testing of the scales was performed on the data collected from respondents who completed the questionnaire on two occasions, which showed significant correlation between the two assessment occasions (intra class correlation coefficient was 0.87). Cronbach’s alpha was also satisfactory for the scales on both occasions (Table 4).

Table 3 Item to total correlations and Cronbach’s alpha for the CHQ scale

Table 4 Cronbach’s alpha and test-retest reliability at the first and second assessment occasions

Convergent validity

The scale was assessed for convergent validity by measuring correlation of the subscales with the relevant subscales of the EQ-5D, SF-36 and MSQ (Table 5). With regards to the EQ-5D, the CHQ subscales showed low to moderate correlations with all of the EQ-5D domains, except for the pain and anxiety subscale of CHQ and the mobility and self-care domains (EQ-5D). The highest correlation observed was between the ‘Impact on mood and interpersonal relationships’ subscale of the CHQ and anxiety/depression item of the EQ-5D (r _s  = 0.54, p < 0.01).

Table 5 Correlation coefficients (p values) between the CHQ subscales and the EQ-5D and SF-36 generic and MSQ v2.1 migraine-specific quality of life measures

Similarly, there were low to moderate correlations with the SF-36 and MSQ subscales. The ‘Restrictions of ADL’ factor of CHQ correlated significantly with the social role functioning (SF) (r = −0.47, p < 0.01) and emotional role functioning (RE) subscales (r = −0.41, p < 0.01). The ‘Impact on mood and interpersonal relationships’ subscale of the CHQ correlated highly with mental health (MH) (r = −0.67, p < 0.01) and moderately with SF (r = −0.52, p < 0.01), RE (r = −0.50, p < 0.01) and vitality (VT) (r = −0.49, p < 0.01) subscales. The ‘Lack of vitality’ subscale of the CHQ correlated moderately with VT (r = −0.43, p < 0.01) and RE (r = −0.39, p < 0.01). All the correlations were negative as the CHQ and SF-36 were scored in different directions. In relation to the MSQ, the CHQ subscales correlated significantly with the all domains. Furthermore, the ‘Impact on mood and interpersonal relationships’ subscale of the CHQ and emotional functioning domain of the MSQ were well correlated (r = 0.65, p < 0.01), supporting good convergent validity.

The mean scores of the CHQ in episodic CH patients were then compared to those of chronic CH patients. Patients with chronic CH had significantly greater impairment in their QoL compared to their episodic counterparts (61.6 ± 18.9 vs 56.2 ± 19.0, p = 0.010), further supporting good validity and sensitivity of the questionnaire to detect impairment specifically related to CH.

Discussion

Several studies have demonstrated that QoL is significantly impaired in patients with CH, more so in chronic sufferers, with considerable impact on daily living e.g., efficiency and ability to work and social functioning, with almost 20 % of patients losing their jobs secondary to the disorder [5–7, 13, 15, 20, 21]. However, these studies have all used either generic QoL scales such as the SF-36, or migraine-specific scales that may not necessarily be able to capture the true effects of CH, and may therefore be underestimating the actual impact of the disorder on QoL. Indeed, some instruments specifically ask about suffering in the past four weeks, thus ECH sufferers out of a bout would rate low scores on these scales, even though they may be severely impaired during a bout [9]. Hence, these measures may not provide a true reflection of the actual impairment. Moreover, issues that are specific to CH are not addressed through the use of these scales, for example suicidal tendencies, which is prevalent among CH sufferers. Circadian periodicity is another distinct feature in this disorder, with sufferers usually being woken up around the same time every night, at the onset of rapid eye movement (REM) sleep, which can have a major impact on patients with CH. We have therefore developed a questionnaire based on both patient and expert views of the disorder. To our knowledge, this is the first scale developed to measure QoL specifically in CH sufferers.

In the current study, we developed and validated a CH-specific QoL scale, the CHQ. Items for the scale were generated from an in-depth literature review and semi-structured patient interviews, allowing CH sufferers to express their views about the various aspects of their lives that they felt were affected by the disorder and should be highlighted in such a disease specific QoL scale. This was followed by a review by a panel of experts with an interest in headaches to include items that were considered clinically relevant. These steps allowed us to develop a scale that is based on both patient and clinician input, thus ensuring good content and face validity. Furthermore, following administration to a large sample of participants with CH, the scale has also been shown to have good construct validity, internal consistency and test-retest reliability. In terms of convergent validity, the subscale scores showed good correlation with those of other widely used QoL scales that have already been shown to have good validity and reliability, specifically the EQ-5D, SF-36 and MSQ. Moreover, the scale has been able to detect significantly greater impairment in QoL in chronic CH patients, compared to episodic CH patients, thus showing good sensitivity.

A limitation of this study was that about a third of our study population comprised patients attending a tertiary referral centre; hence medically intractable cases may be over-represented in our sample. Of the 148 patients recruited from the headache clinic, 64.2 % had chronic CH, which is significantly greater than is expected in the general population [1]. Thus our sample may not be totally representative of the CH population in the community. However, this bias enabled us to collect data from a fair proportion of chronic CH sufferers (42.9 %), who due to the recurring nature of their headaches are likely to be more disabled by this disorder, giving us a better picture of the extent of the impact on patients QoL. Since the development of the questionnaire involved both CH patients and a panel of experts, we strongly believe that the items included in our questionnaire were equally important for both ECH and CCH sufferers. Furthermore, despite the different methods of recruitment, it could be argued that those recruited via OUCH UK were also significantly affected by their CH to warrant them to seek help, as shown by the lack of significant differences in their headache characteristics from those recruited through the hospital, hence, supporting our decision to group them together.

Conclusions

We have developed the first objective measure of QoL specifically for CH sufferers, which we have intended to be brief and user-friendly as it takes about 10 min to complete the questionnaire. We hope that it can be used in the clinical setting to monitor QoL as part of patient care, as well as in clinical trials as a patient-reported outcome measure. The next stage in the validation of the CHQ will be an assessment of its sensitivity to capture change in QoL over time (e.g., in the active and remission phases in episodic CH) and following medical and surgical treatments of CH. Further studies will also need to be performed in other community populations as the development and validation of this scale was based solely on a sample of CH population in the United Kingdom. Future studies could also examine age or gender related differences in QoL in CH with the CHQ. Once the CHQ has been fully validated and its sensitivity to change established, it could serve as an appropriate measure for identifying the demographic (e.g., age, gender, socioeconomic status), clinical (e.g., severity of pain, frequency of episodes, distribution of pain), psychological (mood, anxiety), social (e.g., social support) and behavioural (e.g., ways of coping, avoidance) factors that predict QoL in CH. Such information would be valuable in steering clinical management to focus on aspects of the disease that would help enhance QoL of CH sufferers.