Skip to main content
SpringerLink
Log in

Test–retest reliability of HeartQoL and its comparability to the MacNew heart disease health-related quality of life questionnaire

  • Brief Communication
  • Published:
Quality of Life Research Aims and scope Submit manuscript

Abstract

Objectives

Heart Quality of Life (HeartQoL) is a new “hybrid” developed from the MacNew and two condition-specific questionnaires measuring health-related quality of life (HRQoL) in patients with ischemic heart disease (IHD). This study investigates test–retest reliability of HeartQoL (English version) according to international criteria (e.g., COSMIN, GRRAS). Findings on HeartQoL are compared to the published data on MacNew in view that both serve as the core IHD-specific HRQoL instrument.

Methods

Out of 105 patients with IHD, 76 completed self-administration of HeartQoL at the clinic followed by at home within a 2-week interval. In retest, patients responded using non-interview methods (phone messaging, email, fax, and post). Phone interviewing was reserved for non-respondents to reminder.

Results

Reliability of HeartQoL was good (intraclass correlation coefficients = 0.78–0.82), was supported in the Bland–Altman plot, and was comparable to five studies on MacNew of similar retest interval (MacNew-English = 0.70–0.75; translated MacNew = 0.72–0.91). Applicability of its standard error of measurement (0.20–0.25) and smallest detectable change (0.55–0.70) will depend on availability of normative data in future.

Conclusion

The reliability of HeartQoL is comparable to its parent instrument, the MacNew. The HeartQoL is a potentially reliable core IHD-specific HRQoL instrument in measuring group change.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

References

  1. Oldridge, N., Saner, H., McGee, H. M., & for the HeartQoL Study Investigators. (2005). The Euro Cardio-QoL Project. An international study to develop a core heart disease health-related quality of life questionnaire, the HeartQoL. European Journal of Cardiovascular Prevention & Rehabilitation, 12(2), 87–94.

    Article  Google Scholar 

  2. Oldridge, N., Höfer, S., McGee, H., Conroy, R., Doyle, F., Saner, H., & for the HeartQoL Study Investigators. (2014). The HeartQoL: Part I. Development of a new core health-related quality of life questionnaire for patients with ischemic heart disease. European Journal of Preventive Cardiology, 21(1), 90–97.

    Article  PubMed  Google Scholar 

  3. Oldridge, N., Höfer, S., McGee, H., Conroy, R., Doyle, F., Saner, H., & for the HeartQoL Study Investigators. (2014). The HeartQoL: Part II. Validation of a new core health-related quality of life questionnaire for patients with ischemic heart disease. European Journal of Preventive Cardiology, 21(1), 98–106.

    Article  PubMed  Google Scholar 

  4. Höfer, S., Saleem, A., Stone, J., Thomas, R., Tulloch, H., & Oldridge, N. (2012). The MacNew heart disease health-related quality of life questionnaire in patients with angina and patients with ischemic heart failure. Value in Health, 15, 143–150.

    Article  PubMed  Google Scholar 

  5. Paiva, C. E., Barroso, E. M., Carneseca, E. C., de Padua Souza, C., Dos Santos, F. T., Mendoza Lopez, R. V., et al. (2014). A critical analysis of test-retest reliability in instrument validation studies of cancer patients under palliative care: A systematic review. BMC Medical Research Methodology, 14(1), 8. doi:10.1186/1471-2288-14-8.

    Article  PubMed Central  PubMed  Google Scholar 

  6. Terwee, C. B., Mokkink, L. B., Knol, D. L., Ostelo, R. W. J. G., Bouter, L. M., & de Vet, H. C. W. (2012). Rating the methodological quality in systematic reviews of studies on measurement properties: A scoring system for the COSMIN checklist. Quality of Life Research, 21, 651–657.

    Article  PubMed Central  PubMed  Google Scholar 

  7. Kottner, J., Audige, L., Brorson, S., Donner, A., Gajewski, B. J., Hróbjartsson, A., et al. (2011). Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed. Journal of Clinical Epidemiology, 64, 96–106.

    Article  PubMed  Google Scholar 

  8. Polit, D. F. (2014). Getting serious about test-retest reliability: A critique of retest research and some recommendations. Quality of Life Research, 23(6), 1713–1720.

    Article  PubMed  Google Scholar 

  9. deVeta, H. C. W., Terwee, C. B., Mokkink, L. B., & Knol, D. L. (2011). Measurement in medicine: A practical guide. Cambridge: Cambridge University Press.

    Book  Google Scholar 

  10. Mokkink, L. B., Terwee, C. B., Patrick, D. L., Alonso, J., Stratford, P. W., Knol, D. L., et al. (2010). The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: An international Delphi study. Quality of Life Research, 19(4), 539–549.

    Article  PubMed Central  PubMed  Google Scholar 

  11. Schuck, P. (2004). Assessing reproducibility for interval data in health-related quality of life questionnaires: Which coefficient should be used? Quality of Life Research, 13, 571–586.

    Article  PubMed  Google Scholar 

  12. Weir, J. P. (2005). Quantifying test-retest reliability using the intraclass correlation coefficient and the SEM. Journal of Strength & Conditioning Research, 19(1), 231–240.

    Google Scholar 

  13. Zaki, R., Bulgiba, A., Ismail, R., & Ismail, N. A. (2012). Statistical methods used to test for agreement of medical instruments measuring continuous variables in method comparison studies: A systematic review. PLoS One, 7(5), e37908. doi:10.1371/journal.pone.0037908.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  14. Rankin, G., & Stokes, M. (1998). Reliability of assessment tools in rehabilitation: An illustration of appropriate statistical analyses. Clinical Rehabilitation, 12(3), 187–199.

    Article  CAS  PubMed  Google Scholar 

  15. de Veta, H. C. W., Terwee, C. B., Knol, D. L., & Bouter, L. M. (2006). When to use agreement versus reliability measures. Journal of Clinical Epidemiology, 59, 1033–1039.

    Article  Google Scholar 

  16. Atkinson, G., & Nevill, A. M. (1998). Statistical methods for assessing measurement error (reliability) in variables relevant to sports medicine. Sports Medicine, 26(4), 217–238.

    Article  CAS  PubMed  Google Scholar 

  17. Mokkink, L. B., Terwee, C. B., Patrick, D. L., Alonso, J., Stratford, P. W., Knol, D. L., et al. (2010). International consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes: Results of the COSMIN study. Journal of Clinical Epidemiology, 63(7), 737–745.

    Article  PubMed  Google Scholar 

  18. Zou, G. Y. (2012). Sample size formulas for estimating intraclass correlation coefficients with precision and assurance. Statistics in Medicine, 31, 3972–3981.

    Article  CAS  PubMed  Google Scholar 

  19. Marx, R. G., Menezes, A., Horovitz, L., Jones, E. C., & Warren, R. F. (2003). A comparison of two time intervals for test-retest reliability of health status instruments. Journal of Clinical Epidemiology, 56(8), 730–735.

    Article  PubMed  Google Scholar 

  20. Wiederkehr, S., Seux, M., Faure, C., & Fournie, X. (2012). Reminders help improving completion rate of home-administered lifestyle questionnaires. Value in Health, 15(7), A485.

    Article  Google Scholar 

  21. Keszei, A. P., Novak, M., & Streiner, D. L. (2010). Introduction to health measurement scales. Journal of Psychosomatic Research, 68, 319–323.

    Article  PubMed  Google Scholar 

  22. Cuixart, C. B., Sole, A. R., Miralda, G. P., Castello, P. C., Pelaez, I. M., Sopena, J. P., et al. (2000). Adaptation of the MacNew QLMI quality of life questionnaire after myocardial infarction to be used in the Spanish population. Medicina Clinica, 115(20), 768–771.

    Article  Google Scholar 

  23. Ribera, A., Permanyer-Miralda, G., Alonso, J., Cascant, P., Soriano, N., & Brotons, C. (2006). Is psychometric scoring of the McNew Quality of Life after Myocardial Infarction questionnaire superior to the clinimetric scoring? A comparison of the two approaches. Quality of Life Research: An International Journal of Quality of Life Aspects of Treatment, Care and Rehabilitation, 15(3), 357–365.

    Article  CAS  Google Scholar 

  24. Pavy, B., Iliou, M. C., Höfer, S., Verges-Patois, B., Corone, S., Aeberhard, P., et al. (2015). Validation of the French version of the MacNew heart disease health-related quality of life questionnaire. Archives of Cardiovascular Diseases, 108(2), 107–117. doi:10.1016/j.acvd.2014.09.006.

    Article  PubMed  Google Scholar 

  25. Alphin, S., Höfer, S., Perk, J., Slordahl, S., Zwisler, A.-D. O., Oldridge, N., et al. (2015). The MacNew heart disease health-related quality of life questionnaire: A scandinavian validation study. Social Indicators Research, 122(2), 519–537.

    Article  PubMed Central  PubMed  Google Scholar 

  26. Vandereyt, F., Dendale, P., Vanhees, L., Roosen, J., Hofer, S., & Oldridge, N. (2012). Psychometric properties of the Flemish version of the MacNew heart disease health-related quality of life questionnaire. Acta Cardiologica, 67(1), 31–39.

    PubMed  Google Scholar 

  27. Hiller, A., Helvik, A., Kaasa, S., & Slørdahl, S. A. (2010). Psychometric properties of the Norwegian MacNew heart disease health-related quality of life inventory. European Journal of Cardiovascular Nursing, 9(3), 146–152.

    Article  PubMed  Google Scholar 

  28. Daskapan, A., Hofer, S., Oldridge, N., Alkan, N., Muderrisoglu, H., & Tuzun, E. H. (2008). The validity and reliability of the Turkish version of the MacNew heart disease questionnaire in patients with angina. Journal of Evaluation in Clinical Practice, 14(2), 209–213.

    Article  PubMed  Google Scholar 

  29. Höfer, S., Benzer, W., Schüßler, G., von Steinbüchel, N., & Oldridge, N. B. (2003). Health-related quality of life in patients with coronary artery disease treated for angina: Validity and reliability of German translations of two specific questionnaires. Quality of Life Research, 12(2), 199–212.

    Article  PubMed  Google Scholar 

  30. Asadi-Lari, M., Javadi, H. R., Melville, M., Oldridge, N. B., & Gray, D. (2003). Adaptation of the MacNew quality of life questionnaire after myocardial infarction in an Iranian population. Health Quality of Life Outcomes, 1, 23. doi:10.1186/1477-7525-1-23.

    Article  PubMed Central  PubMed  Google Scholar 

  31. Yu, D. S. F., Thompson, D. R., Yu, C. M., & Oldridge, N. B. (2008). Validation of the Chinese version of the MacNew heart disease health-related quality of life questionnaire. Journal of Evaluation in Clinical Practice, 14(2), 326–335.

    Article  PubMed  Google Scholar 

  32. Leal, A., Paiva, C., Höfer, S., Amado, J., L., G., & Oldridge, N. (2005). Evaluative and discriminative properties of the Portuguese MacNew heart disease health-related quality of life questionnaire. Quality of Life Research, 14(10), 2335–2341.

    Article  Google Scholar 

Download references

Acknowledgments

The authors would like to thank Professor Neil Oldridge for the permission to use the HeartQoL, Professor Henrica C.W. de Vet for some advice on the data interpretation, and patients who participated in this study.

Author contributions

Study conception and design: WL Lee, K Chinna, KL Abdullah, IZ Abidin. Acquisition of data: WL Lee. Analysis and interpretation of data: WL Lee, K Chinna. Drafting of manuscript: WL Lee. Critical revision and final approval: WL Lee, K Chinna, A Bulgiba, KL Abdullah, IZ Abidin, Höfer S.

Funding

This research was funded by University of Malaya Research Fund Assistance (BK004-2011B) and University of Malaya/ Ministry of Higher Education (UM/MOHE) High Impact Research Grant (E000010-20001).

Author information

Authors and Affiliations

  1. Department of Nursing Science, Faculty of Medicine, University of Malaya, 50603, Kuala Lumpur, Malaysia

    Wan Ling Lee & Khatijah Lim Abdullah

  2. Department of Social and Preventive Medicine, Faculty of Medicine, Julius Centre University of Malaya, University of Malaya, 50603, Kuala Lumpur, Malaysia

    Karuthan Chinna & Awang Bulgiba

  3. Department of Medicine, Faculty of Medicine, University of Malaya, 50603, Kuala Lumpur, Malaysia

    Imran Zainal Abidin

  4. Department of Medical Psychology, Innsbruck Medical University, Schöpfstr. 23a, 6020, Innsbruck, Austria

    Stefan Höfer

Authors
  1. Wan Ling Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Karuthan Chinna
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Awang Bulgiba
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Khatijah Lim Abdullah
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Imran Zainal Abidin
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Stefan Höfer
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Wan Ling Lee.

Ethics declarations

Conflict of interest

Author Höfer S. is co-developer of HeartQoL and MacNew. Remaining authors have no competing interests to report.

Ethical approval

All procedures performed were in accordance with the ethical standards of the Medical Ethics Committee of University Malaya Medical Centre (Reference No: 996.45) and with the Declaration of Helsinki.

Informed consent

Informed consent was obtained from participants.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lee, W.L., Chinna, K., Bulgiba, A. et al. Test–retest reliability of HeartQoL and its comparability to the MacNew heart disease health-related quality of life questionnaire. Qual Life Res 25, 351–357 (2016). https://doi.org/10.1007/s11136-015-1097-1

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11136-015-1097-1

Keywords

Search

Navigation