Skip to main content
SpringerLink
Log in

More Happy or Less Unhappy? Comparison of the Balanced and Unbalanced Designs for the Response Scale of General Happiness

  • Research Paper
  • Published:
Journal of Happiness Studies Aims and scope Submit manuscript

Abstract

The single-item measure of general happiness has been widely used in questionnaires due to the advantages of easy implementation in surveys for comparison across time and culture. The balanced response scale that includes equal positive and negative response categories based on Likert-type response format has been commonly applied. However, the possibility of using an unbalanced response scale for happiness, for instance, more choices on the happy side, has not been fully examined. This study aims to explore the optimal number of response categories and the corresponding labels for general happiness by using telephone survey data in Taiwan. Six types of response scales with different combinations of response number and response labels were examined to distinguish both the intensity and direction of responses. A completely randomized experimental design using computer-assisted telephone interviewing system was conducted to collect data from representative samples aged 18 years or older. Individual characteristics among the six groups indicated that all of the sub-samples were similar in terms of gender, age, education, marital status, working status, and monthly income. Results of the graded response model suggested that a scale with at least three response categories on the positive side and no more than two on the negative side will be suitable for the single measure of general happiness. Findings of ordered logit regression on happiness were also in favor of an unbalanced response design. A discussion of the result is provided.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

References

  • Alwin, D. F. (1992). Information transmission in the survey interview: Number of response categories and the reliability of attitude measurement. Sociological Methodology, 22, 83–118.

    Article  Google Scholar 

  • Alwin, D. F. (1997). Feeling thermometers versus 7-point scales: Which are better? Sociological Methods & Research, 25, 318–340. doi:10.1177/0049124197025003003.

    Article  Google Scholar 

  • Alwin, D. F., & Krosnick, J. A. (1991). The reliability of survey attitude measurement: The influence of question and respondent attributes. Sociological Methods & Research, 20, 139–181. doi:10.1177/0049124191020001005.

    Article  Google Scholar 

  • Argyle, M. (1997). Is happiness a cause of health? Psychology and Health, 12, 769–781.

    Article  Google Scholar 

  • Bishop, G. F. (1987). Experiments with the middle response alternative in survey questions. Public Opinion Quarterly, 51, 220–232. doi:10.1086/269030.

    Article  Google Scholar 

  • Bjørnskov, C. (2010). How comparable are the Gallup world poll life satisfaction data? Journal of Happiness Studies, 11, 41–60. doi:10.1007/s10902-008-9121-6.

    Article  Google Scholar 

  • Chang, L. (1994). A psychometric evaluation of 4-point and 6-point Likert-type scales in relation to reliability and validity. Applied Psychological Measurement, 18, 205–215.

    Article  Google Scholar 

  • Chen, S. K., Hwang, F. M., & Lin, S. S. J. (2013). Satisfaction ratings of QOLPAV: Psychometric properties based on the graded response model. Social Indicators Research, 110, 367–383. doi:10.1007/s11205-011-9935-1.

    Article  Google Scholar 

  • Comrey, A. L. (1988). Factor-analytic methods of scale development in personality and clinical psychology. Journal of Consulting and Clinical Psychology, 56, 754–761. doi:10.1037/0022-006X.56.5.754.

    Article  Google Scholar 

  • Cummins, R. A. (2003). Normative life satisfaction: Measurement issues and a homeostatic model. Social Indicators Research, 64, 225–240. doi:10.1023/A:1024712527648.

    Article  Google Scholar 

  • Cummins, R. A., & Gullone, E. (2000). Why we should not use 5-point Likert scales: The case for subjective quality of life measurement. In Proceedings, second international conference on quality of life in cities (pp. 74–93). Singapore: National University of Singapore.

  • Dawes, J. (2008). Do data characteristics change according to the number of scale points used? An experiment using 5-point, 7-point and 10-point scales. International Journal of Market Research, 50, 61–77.

    Google Scholar 

  • Diener, E. (1984). Subjective well-being. Psychological Bulletin, 95, 542–575.

    Article  Google Scholar 

  • Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Mahwah, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Ferrer-i-Carbonell, A., & Frijters, P. (2004). How important is methodology for the estimates of the determinants of happiness? The Economic Journal, 114, 641–659.

    Article  Google Scholar 

  • Fordyce, M. W. (1988). A review of research on the happiness measures: A sixty second index of happiness and mental health. Social Indicators Research, 20, 355–381.

    Article  Google Scholar 

  • Fox, M. T., Sidani, S., & Streiner, D. (2007). Using standardized survey items with older adults hospitalized for chronic illness. Research in Nursing & Health, 3, 468–481. doi:10.1002/nur.20201.

    Article  Google Scholar 

  • Francis, J. D., & Busch, L. (1975). What we know about “I don’t knows. Public Opinion Quarterly, 39, 207–218.

    Article  Google Scholar 

  • Frijters, P., & Beatton, T. (2012). The mystery of the U-shaped relationship between happiness and age. Journal of Economic Behavior & Organization, 82, 525–542. doi:10.1016/j.jebo.2012.03.008.

    Article  Google Scholar 

  • Frisbie, D. A., & Brandenburg, D. C. (1979). Equivalence of questionnaire items with varying response formats. Journal of Educational Measurement, 16, 43–48. doi:10.1111/j.1745-3984.1979.tb00085.x.

    Article  Google Scholar 

  • Holbrook, A., Cho, Y. K., & Johnson, T. (2006). The impact of question and respondent characteristics on comprehension and mapping difficulties. Public Opinion Quarterly, 70, 565–595. doi:10.1093/poq/nfl027.

    Article  Google Scholar 

  • Hung, Y.-T. (2001). 戶中選樣之研究 (Respondent selection within household). Taipei: Wu Nan.

    Google Scholar 

  • Kalmijn, W. M., Arends, L. R., & Veenhoven, R. (2011). Happiness scale interval study: Methodological considerations. Social Indicators Research, 102, 497–515. doi:10.1007/s11205-010-9688-2.

    Article  Google Scholar 

  • Kroh, M. (2007). Measuring left–right political orientation: The choice of response format. Public Opinion Quarterly, 71, 204–220. doi:10.1093/poq/nfm009.

    Article  Google Scholar 

  • Lam, T. C. M., & Klockars, A. J. (1982). Anchor point effects on the equivalence of questionnaire items. Journal of Educational Measurement, 19, 317–322.

    Article  Google Scholar 

  • Liao, P.-S., Fu, Y.-C., & Yi, C.-C. (2005). Perceived quality of life in Taiwan and Hong Kong: An intra-culture comparison. Journal of Happiness Studies, 6(1), 43–67. doi:10.1007/s10902-004-1753-6.

    Article  Google Scholar 

  • Lim, H. E. (2008). The use of different happiness rating scales: Bias and comparison problem? Social Indicators Research, 87, 259–267.

    Article  Google Scholar 

  • Masters, J. R. (1974). The relationship between number of response categories and reliability of Likert-type questionnaires. Journal of Educational Measurement, 11, 49–53. doi:10.1111/j.1745-3984.1974.tb00970.

    Article  Google Scholar 

  • Mazaheri, M., & Theuns, P. (2009a). Effects of varying response formats on self-ratings of life-satisfaction. Social Indicators Research, 90, 381–395.

    Article  Google Scholar 

  • Mazaheri, M., & Theuns, P. (2009b). Structural equation modeling (SEM) for satisfaction and dissatisfaction ratings; multiple group invariance analysis across scales with different response format. Social Indicators Research, 91, 203–221.

    Article  Google Scholar 

  • Michalos, A. C., Zumbo, B. D., & Hubley, A. (2000). Health and the quality of life. Social Indicators Research, 51, 245–286.

    Article  Google Scholar 

  • Moors, G. (2007). Exploring the effect of a middle response category on response style in attitude measurement. Quality & Quantity, 42, 779–794. doi:10.1007/s11135-006-9067-x.

    Article  Google Scholar 

  • Preston, C. C., & Colman, A. M. (2000). Optimal number of response categories in rating scales: Reliability, validity, discriminating power, and respondent preferences. Acta Psychologica, 104(1), 1–15. doi:10.1016/s0001-6918(99)00050-5.

    Article  Google Scholar 

  • Raaijmakers, Q. A. W., van Hoof, A., Hart, H., Verbogt, T. F. M. A., & Vollebergh, W. A. M. (2000). Adolescents’ midpoint responses on Likert-type scale items: Neutral or missing values. International Journal of Public Opinion Research, 12, 208–216.

    Article  Google Scholar 

  • Reeve, B. B., & Fayers, P. (2005). Applying item response theory modeling for evaluating questionnaire item and scale properties. In P. Fayers & R. Hays (Eds.), Assessing quality of life in clinical trials (2nd ed., pp. 55–73). Oxford: Oxford University Press.

    Google Scholar 

  • Samejima, F. (1969). Estimation of latent trait ability using a response pattern of graded scores. Psychometrika Monograph, No. 17.

  • Samejima, F. (1997). Graded response model. In W. J. van der Linden & R. K. Hambleton (Eds.), Handbook of modern item response theory (pp. 85–100). NY: Springer.

    Chapter  Google Scholar 

  • Saris, W. E., & Gallhofer, I. N. (2007). Design, evaluation, and analysis of questionnaires for survey research. New Jersey: Wiley.

    Book  Google Scholar 

  • Schaeffer, N. C., & Charng, H.-W. (1991). Two experiments in simplifying response categories: Intensity ratings and behavioral frequencies. Sociological Perspectives, 34, 165–182.

    Article  Google Scholar 

  • Schaeffer, N. C., & Presser, S. (2003). The science of asking questions. Annual Review of Sociology, 29, 65–88. doi:10.1146/annurev.soc.29.110702.110112.

    Article  Google Scholar 

  • Schuman, H., & Presser, S. (1981). Questions and answers in attitude surveys. New York: Academic Press.

    Google Scholar 

  • Tourangeau, R., Raslnski, K. A., & Bradburn, N. (1991). Measuring happiness in surveys: A test of the subtraction hypothesis. Public Opinion Quarterly, 55, 255–266.

    Article  Google Scholar 

  • Tsou, M., & Liu, J. (2001). Happiness and domain satisfaction in Taiwan. Journal of Happiness Studies, 2, 269–288.

    Article  Google Scholar 

  • Veenhoven, R. (1993). Happiness in nations. Rotterdam: Risbo.

    Google Scholar 

  • Veenhoven, R. (1996). Developments in satisfaction research. Social Indicators Research, 37, 1–45.

    Article  Google Scholar 

  • Wedell, D. H., & Parducci, A. (1988). The category effect in social judgment: Experimental ratings of happiness. Journal of Personality and Social Psychology, 55, 341–356.

    Article  Google Scholar 

  • Weng, L.-J. (2004). Impact of the number of response categories and anchor labels on coefficient alpha and test–retest reliability. Educational and Psychological Measurement, 60, 956–972. doi:10.1177/0013164404268674.

    Article  Google Scholar 

  • Wildt, A. R., & Mazis, M. B. (1978). Determinants of scale response: Label versus position. Journal of Marketing Research, 15, 261–267.

    Article  Google Scholar 

Download references

Acknowledgments

This study is sponsored by the National Science Council, Taiwan (NSC 98-2628-H-001-010-SS2). The author thanks Willem E. Saris and anonymous reviewers for their helpful comments on an earlier version. Please direct all correspondence to the author.

Author information

Authors and Affiliations

  1. Academia Sinica, Taipei, Taiwan, ROC

    Pei-shan Liao

Authors
  1. Pei-shan Liao
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Pei-shan Liao.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Liao, Ps. More Happy or Less Unhappy? Comparison of the Balanced and Unbalanced Designs for the Response Scale of General Happiness. J Happiness Stud 15, 1407–1423 (2014). https://doi.org/10.1007/s10902-013-9484-1

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10902-013-9484-1

Keywords

Search

Navigation