Abstract
The Perceived Stress Scale (PSS) is a widely used measure of psychological stress and has demonstrated robust psychometric properties in adult populations. However, its validity and reliability in younger populations has not been investigated. This study aimed to confirm the factor structure and estimate the internal consistency of the 10-item PSS among youth with mental illness; assess its validity; and, investigate whether the PSS can differentiate between youth with internalizing and externalizing disorders. Data come from a clinical sample of 67 youth currently receiving services for their mental health. Confirmatory factor analysis was used to replicate the factor structure of the PSS. Correlations were used to examine construct validity and Mann–Whitney U tests to compare PSS scores across mental illnesses. The two-factor (helplessness and self-efficacy) structure of the PSS was confirmed and internal consistency reliability was high (α = 0.88). There was solid evidence of convergent validity with measures of family functioning (r = 0.34), disability (r = 0.72), health-related quality of life (r = 0.37 to 0.60), and self-concept (r = 0.30 to 0.74). There was no difference in PSS scores across age or sex. Higher PSS scores were found for youth with internalizing disorders, but no difference for those with versus without externalizing disorders. Because of the relatively small sample size, further research is needed in larger and more diverse samples, as well as additional research to determine clinically relevant thresholds within the PSS to facilitate its routine use in clinical and public health settings.
Highlights
-
Psychometrics of the PSS have not been tested in youth with mental illness.
-
PSS has a two-factor structure (Helplessness and Self-efficacy).
-
Convergent validity shown with disability, quality of life, and self-concept.
-
PSS differentiates between youth with internalizing vs. externalizing disorders.
Similar content being viewed by others
References
Arif, A. et al. (2021). Stress and coping strategies in parents of children with special needs. JPMA, 71(5), 1369–1372.
American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders: DSM 5. 5th ed. Washington: American Psychiatric Association.
Beets, M. W. et al. (2010). Effects of yoga on stress, depression, and health-related quality of life in a nonclinical, bi-ethnic sample of adolescents: a pilot study. Hispanic Health Care International, 8(1), 47.
Bi, Y., Ma, L., Yuan, F., & Zhang, B. (2016). Self-esteem, perceived stress, and gender during adolescence: interactive links to different types of interpersonal relationships. Journal of Psychology, 150(1), 36–57.
Boyle, M. H., Duncan, L., Georgiades, K., Bennett, K., Gonzalez, A., Van Lieshout, R. J., & Janus, M. (2017). Classifying child and adolescent psychiatric disorder by problem checklists and standardized interviews. International Journal of Methods Psychiatric Research, 26(4), e1544.
Brehm, J. M. et al. (2015). Stress and bronchodilator response in children with asthma. American Journal of Respiratory and Critical Care Medicine, 192(1), 47–56.
Brown, T. A. (2015). Confirmatory factor analysis for applied research. 2nd ed. New York, NY: The Guilford Press.
Byles, J., Byrne, C., Boyle, M. H., & Offord, D. R. (1988). Ontario Child Health Study: reliability and validity of the general functioning subscale of the McMaster Family Assessment Device. Family Process, 27(1), 97–104.
Chiu, Y. H., Lu, F. J. H., Lin, J. H., Nien, C. L., Hsu, Y. W., & Liu, H. Y. (2016). Psychometric properties of the Perceived Stress Scale (PSS): measurement invariance between athletes and non-athletes and construct validity. PeerJ, 4, e2790.
Choi, C., & Ferro, M. A. (2018). Comparing self-concept among youth currently receiving inpatient versus outpatient mental health services. Journal of the Canadian Academy of Child and Adolescent Psychiatry, 27(1), 69–74.
Coelho, R. W., et al. (2012). Use of multimodal imagery with precompetitive anxiety and stress of elite tennis players. Perceptual and Motor Skills, 114(2), 419–428.
Cohen, S., Kamarck, T. & Mermelstein, R. (1983). A global measure of perceived stress. Journal of Health and Social Behavior, 24(4), 385–396.
Cohen, S. & Williamson, G. D. Perceived stress in a probability sample of the United States. In S. Spacapan S. Oskamp, (eds.) 1988). The social psychology of health: Claremont Symposium on applied social psychology. (pp. 31–67). Newbury Park: Sage.
Dao-Tran, T. H., Anderson, D., & Seib, C. (2017). The Vietnamese version of the Perceived Stress Scale (PSS-10): Translation equivalence and psychometric properties among older women. BMC Psychiatry, 17(1), 53.
Duncan, L., Boyle, M., Ferro, M. A., Georgiades, K., Van Lieshout, R. J., Bennett, K., & Szatmari, P. (2018). Psychometric evaluation of the Mini International Neuropsychiatric Interview for Children and Adolescents (MINI-KID). Psychological Assess, 30(7), 916–928.
Efron, B., & Tibshirani, R. (1986). Bootstrap methods for standard errors, confidence intervals, and other measures of statistical accuracy. Statistical Science, 1(1), 54–77.
Ferro, M. A., & Boyle, M. H. (2013). Longitudinal invariance of measurement and structure of global self-concept: a population-based study examining trajectories among adolescents with and without chronic illness. Journal of Pediatric Psychology, 38(4), 425–437.
Ferro, M. A. & Boyle, M. H. (2015). The impact of chronic physical illness, maternal depressive symptoms, family functioning, and self-esteem on symptoms of anxiety and depression in children. Journal of Abnormal Child Psychology, 43(1), 177–187.
Ferro, M. A., Landgraf, J. M. & Speechley, K. N. (2013). Factor structure of the Child Health Questionnaire Parent Form-50 and predictors of health-related quality of life in children with epilepsy. Quality of Life Research, 22(8), 2201–2211.
Ferro, M. A., Lipman, E. L., Van Lieshout, R. J., Boyle, M. H., Gorter, J. W., MacMillan, H. L., & Georgiades, K. (2019). Mental-physical multimorbidity in youth: associations with individual, family, and health service use outcomes. Child Psychiatry & Human Development, 50(3), 400–410.
Ferro, M. A., & Tang, J. (2017). Psychometric properties of the self-perception profile for children in children with chronic illness. Journal of the Canadian Academy of Child and Adolescent Psychiatry, 26(2), 119–124.
Ferro, M. A., Otto, C., & Ravens-Sieberer, U. (2022). Measuring health-related quality of life in young children with physical illness: psychometric properties of the parent-reported KIDSCREEN-27. Quality of Life Research, 31(50), 1509–1520.
Ferro, M. A., Qureshi, S. A., Shanahan, L., Otto, C., & Ravens-Sieberer, U. (2021). Health-related quality of life in children with and without physical-mental multimorbidity. Quality of Life Research, 30(12), 3449–3461.
Finkelstein, D. M. et al. (2006). Social status, stress, and adolescent smoking. Journal of Adolescent Health, 39(5), 678–685.
Flake, E. M. et al. (2009). The psychosocial effects of deployment on military children. Journal of Developmental & Behavioral Pediatrics, 30(4), 271–278.
Franklin, M. et al. (2020). Association of the built environment with childhood psychosocial stress. JAMA, 3(10), e2017634.
Georgiades, K., Duncan, L., Wang, L., Comeau, J. & Boyle, M. H. Ontario Child Health Study, T. (2019). Six-month prevalence of mental disorders and service contacts among children and youth in Ontario: evidence from the 2014 Ontario child health study. The Canadian Journal of Psychiatry, 64(4), 246–255.
González-Hernández, J. et al. (2019). Perfectionism and stress control in adolescents: Differences and relations according to the intensity of sports practice. Journal of Human Sport and Exercise, 14(1), 195–206.
Goodman, E. et al. (2005). Social disadvantage and adolescent stress. Journal of Adolescent Health, 37(6), 484–492.
Goodman, E. et al. (2007). Socioeconomic disparities in insulin resistance: results from the Princeton School District Study. Psychosomatic Medicine, 69(1), 61–67.
Harter, S. (2012). Self-Perception Profile for Adolescents: Manual and Questionnaires. Denver: University of Denver.
Herrero, J. et al. (2006). The relationships of adolescent school-related deviant behaviour and victimization with psychological distress: testing a general model of the mediational role of parents and teachers across groups of gender and age. Journal of Adolescence, 29(5), 671–690.
Hewitt, P. L., Flett, G. L. & Mosher, S. W. (1992). The perceived stress scale - factor structure and relation to depression symptoms in a psychiatric sample. Journal of Psychopathology and Behavioral Assessment, 14(3), 247–257.
Kaya, C., Tansey, T. N., Melekoglu, M., Cakiroglu, O., & Chan, F. (2019). Psychometric evaluation of Turkish version of the Perceived Stress Scale with Turkish college students. Journal of Mental Health, 28(2), 161–167.
Kechter, A. et al. (2019). Factors in the Perceived Stress Scale differentially associate with mindfulness disposition and executive function among early adolescents. Journal of Child and Family Studies, 28(3), 814–821.
Kennedy, C. et al. (2004). Disaster at a distance: impact of 9.11.01 televised news coverage on mothers’ and children’s health. Journal of Pediatric Nursing, 19(5), 329–339.
Khafagy, G. et al. (2020). Perceived Stress Scale among adolescents with polycystic ovary syndrome. International Journal of Women Health Nursing, 12, 1253
Kimber, M., Rehm, J., & Ferro, M. A. (2015). Measurement invariance of the WHODAS 2.0 in a population-based sample of youth. PLoS One, 10(11), e0142385.
Klein, E. M., Brahler, E., Dreier, M., Reinecke, L., Muller, K. W., Schmutzer, G.,… Beutel, M. E. (2016). The German version of the Perceived Stress Scale - psychometric characteristics in a representative German community sample. BMC Psychiatry, 16.
Lazarus, R. S. (1966). Psychological stress and the coping process. New York: McGraw-Hill.
Lazarus, R. S., & Folkman, S. (1994). Stress, appraising, and coping. New York: McGraw-Hill.
Lee, E. H. (2012). Review of the psychometric evidence of the perceived stress scale. Asian Nursing Research (Korean Society of Nursing Science), 6(4), 121–127.
Lei, P. W., & Shiverdecker, L. K. (2019). Performance of estimators for confirmatory factor analysis of ordinal variables with missing data. Structural Equation Modeling-a Multidisciplinary Journal.
Lesage, F. X., Berjot, S. & Deschamps, F. (2012). Psychometric properties of the French versions of the Perceived Stress Scale. International Journal of Occupational Medicine and Environmental Health, 25(2), 178–184.
Li, C. H. (2016). Confirmatory factor analysis with ordinal data: Comparing robust maximum likelihood and diagonally weighted least squares. Behavior Research Methods, 48(3), 936–949.
Lindholdt, L., Labriola, M., Andersen, J. H., Kjeldsen, M. Z., Obel, C., & Lund, T. (2022). Perceived stress among adolescents as a marker for future mental disorders: a prospective cohort study. Scandinavian Journal of Public Health, 50(3), 412–417.
Liu, X. et al. (2020). Factor structure of the 10-item perceived stress scale and measurement invariance across genders among Chinese adolescents. Frontiers in Psychology, 11, 537
Liu, X., Zhao, Y., Li, J., Dai, J., Wang, X. & Wang, S. (2020). Factor structure of the 10-item perceived stress scale and measurement invariance across genders among Chinese adolescents. Frontiers in Psychology, 11, 537
Lu, W., Bian, Q., Wang, W., Wu, X., Wang, Z., & Zhao, M. (2017). Chinese version of the Perceived Stress Scale-10: A psychometric study in Chinese university students. PLoS One, 12(12), e0189543.
Luria, C. J. et al. (2020). Association between asthma symptom scores and perceived stress and trait anxiety in adolescents with asthma. Allergy and Asthma Proceedings, 41, 3
McDonald, E., Whitney, S., Horricks, L., Lipman, E. L., & Ferro, M. A. (2021). Parent-child agreement on the Mini International Neuropsychiatric Interview for Children and Adolescents (MINI-KID). Journal of the Canadian Academy of Child and Adolescent, 30(4), 264–272.
McGlumphy, K. C. et al. (2018). Perceived stress predicts lower physical activity in African-American boys, but not girls. American Journal of Health Behavior, 42(2), 93–105.
Michaelides, M. P., Christodoulou, A., Kkeli, N., Karekla, M., & Panayiotou, G. (2016). Factorial structure of the perceived stress scale and implications for scoring. European Review of Applied Psychology-Revue Europeenne De Psychologie Appliquee, 66(6), 309–316.
Mills, S. D., Azizoddin, D., Racaza, G. Z., Wallace, D. J., Weisman, M. H., & Nicassio, P. M. (2017). The psychometric properties of the Perceived Stress Scale-10 among patients with systemic lupus erythematosus. Lupus, 26(11), 1218–1223.
Mitchell, A. M., Crane, P. A. & Kim, Y. (2008). Perceived stress in survivors of suicide: psychometric properties of the Perceived Stress Scale. Research in Nursing & Health, 31(6), 576–585.
Müller, K. W. et al. (2018). Insights into aspects behind internet-related disorders in adolescents: the interplay of personality and symptoms of adjustment disorders. Journal of Adolescent Health, 62(2), 234–240.
Muthén, L. K., & Muthén, B. O. (2017). Mplus user’s guide. 8th ed. Los Angeles: Muthén & Muthén.
Nielsen, M. G., Ornbol, E., Vestergaard, M., Bech, P., Larsen, F. B., Lasgaard, M. & Christensen, K. S. (2016). The construct validity of the Perceived Stress Scale. Journal of Psychosomatic Research, 84, 22–30.
Nielsen, T., & Dammeyer, J. (2019). Measuring higher education students’ perceived stress: An IRT-based construct validity study of the PSS-10. Studies in Educational Evaluation, 63, 17–25.
Nordin, M. & Nordin, S. (2013). Psychometric evaluation and normative data of the Swedish version of the 10-item perceived stress scale. Scandinavian Journal of Psychology, 54(6), 502–507.
Olajubu, A. O. et al. (2021). Stress and resilience among pregnant teenagers in Ile-Ife, Nigeria. European Journal of Midwifery, 5(Mar), 9
Oltean, I. I. & Ferro, M. A. (2019). Agreement of child and parent-proxy reported health-related quality of life in children with mental disorder. Quality of Life Research, 28(3), 703–712.
Oltean, I. I., Perlman, C., Meyer, S. & Ferro, M. A. (2020). Child mental health disorder and mental health service use: role of family functioning. Journal of Child and Family Studies, 29(9), 2602–2613.
Orucu, M. C., & Demir, A. (2009). Psychometric evaluation of perceived stress scale for Turkish university students. Stress and Health, 25(1), 103–109.
Park, S. H., Song, Y. J. C., Demetriou, E. A., Pepper, K. L., Norton, A., Thomas, E. E., & Guastella, A. J. (2019). Disability, functioning, and quality of life among treatment-seeking young autistic adults and its relation to depression, anxiety, and stress. Autism, 23(7), 1675–1686.
Pearlin, L. I. (1999). The Stress Process Model revisited. In C. S. Aneshensel & J. C. Phelan (Eds.), Handbook of the Sociology of Mental Health. New York: Kluwer Academic/Phenum Publishers.
Pearlin, L. I., Lieberman, M. A., Menaghan, E. G. & Mullan, J. T. (1981). The stress process. Journal of Health and Social Behavior, 22(4), 337–356.
Pearlin, L. I., Schieman, S., Fazio, E. M. & Meersman, S. C. (2005). Stress, health, and the life course: some conceptual perspectives. Journal of Health and Social Behavior, 46(2), 205–219.
Perera, M. J., Brintz, C. E., Penedo, F. J., Gallo, L. C., Gonzalez, P., Gouskova, N., & Llabre, M. M. (2017). Factor structure of the perceived stress scale-10 (PSS) across English and Spanish language responders in the HCHS/SOL sociocultural ancillary study. Psychological Assessment, 29(3), 320–328.
Pierce, B. et al. (2017). A summer health program for African-American high school students in Baltimore, Maryland: community partnership for integrative health. Explore, 13(3), 186–197.
Portella, A. K. et al. (2020). Predicted DRD4 prefrontal gene expression moderates snack intake and stress perception in response to the environment in adolescents. PloS One, 15(6), e0234601.
Prado-Gascó, V. et al. (2019). Perceived stress and reference ranges of hair cortisol in healthy adolescents. PloS One, 14(4), e0214856.
Preyde, M. et al. (2018). The health and well-being of children and adolescents accessing in-patient psychiatry: a brief report. Journal of the Canadian Academy of Child and Adolescent Psychiatry, 27(3), 191
Qadeer, R. A. & Ferro, M. A. (2018). Child–parent agreement on health-related quality of life in children with newly diagnosed chronic health conditions: a longitudinal study. International Journal of Adolescence and Youth, 23(1), 99–108.
Rajab, A. M. et al. (2020). Gaming addiction and perceived stress among Saudi adolescents. Addictive Behaviors Reports, 11, 100261
Ravens-Sieberer, U., Herdman, M., Devine, J., Otto, C., Bullinger, M., Rose, M. & Klasen, F. (2014). The European KIDSCREEN approach to measure quality of life and well-being in children: development, current application, and future advances. Quality of Life Research, 23(3), 791–803.
Reed, M. (2021). Family functioning and health-related quality of life in parents of children with mental illness. (MSc). Canada: University of Waterloo.
Reis, D., Lehr, D., Heber, E., & Ebert, D. D. (2019). The German version of the perceived stress scale (PSS-10): evaluation of dimensionality, validity, and measurement invariance with exploratory and confirmatory bifactor modeling. Assessment, 26(7), 1246–1259.
Reis, R. S., Hino, A. A. & Anez, C. R. (2010). Perceived stress scale: reliability and validity study in Brazil. Journal of Health Psychology, 15(1), 107–114.
Remor, E. (2006). Psychometric properties of a European Spanish version of the perceived stress scale (PSS). Spanish Journal of Psychology, 9(1), 86–93.
Riberio, I. J. S., Pereira, R. A., Freire, I. V., de Oliveira, B. G., Casotti, C. A. & Boery, E. N. (2018). Stress and quality of life among university students: a systematic literature review. Health Professions Education, 4(2), 70–77.
Roberti, J. W., Harrington, L. N., & Storch, E. A. (2006). Further psychometric support for the 10-item version of the Perceived Stress Scale. Journal of College Counseling, 9(2), 135–147.
Robitail, S., Ravens-Sieberer, U., Simeoni, M. C., Rajmil, L., Bruil, J., Power, M. & Group, K. (2007). Testing the structural and cross-cultural validity of the KIDSCREEN-27 quality of life questionnaire. Quality of Life Research, 16(8), 1335–1345.
Saxena, K. et al. (2020). An evaluation of yoga and meditation to improve attention, hyperactivity, and stress in high-school students. Journal of Alternative and Complementary Medicine, 26(8), 701–707.
Seo, J. E., Ahn, J. A., Hayman, L. L., & Kim, C. J. (2018). The association between perceived stress and quality of life in university students: the parallel mediating role of depressive symptoms and health-promoting behaviors. Asian Nursing Research, 12(3), 190–196.
Sheehan, D. V., Sheehan, K. H., Shytle, R. D., Janavs, J., Bannon, Y., Rogers, J. E. & Wilkinson, B. (2010). Reliability and validity of the Mini International Neuropsychiatric Interview for Children and Adolescents (MINI-KID). Journal of Clinical Psychiatry, 71(3), 313–326.
Sheidow, A. J., Henry, D. B., Tolan, P. H., & Strachan, M. K. (2014). The role of stress exposure and family functioning in internalizing outcomes of urban families. Journal of Child and Family Studies, 23(8), 1351–1365.
Simon, A. E. et al. (2003). Examining the relationship between pubertal stage, adolescent health behaviours and stress. Psychological Medicine, 33(8), 1369–1379.
Skaalvik, E. M., & Bong, M. (2003). Self-concept and self-efficacy revisited. In H. W. Marsh, R. G. Craven & D. M. McInerney (Eds.), International Advances in Self-Research (Vol. 1). Greenwich: Information Age Publishing.
Spieth, L. E. & Harris, C. V. (1996). Assessment of health-related quality of life in children and adolescents: an integrative review. Journal of Pediatric Psychology, 21(2), 175–193.
Steele, R. G. et al. (2004). Patterns of maternal distress among children with cancer and their association with child emotional and somatic distress. Journal of Pediatric Psychology, 29(7), 507–517.
Thai, T. T. et al. (2021). Perceived stress and coping strategies in high school gifted students in Ho Chi Minh City, Vietnam. International Journal of Mental Health, 50(2), 98–112.
Thompson, R. A. (2014). Stress and child development. Future of Children, 24(1), 41–59.
Tompke, B. K. & Ferro, M. A. (2021). Measurement invariance and informant discrepancies of the KIDSCREEN-27 in children with mental disorder. Applied Research in Quality of Life, 16(4), 891–910.
Tompke, B. K., Tang, J., Oltean, I. I., Buchan, M. C., Reaume, S. V., & Ferro, M. A. (2020). Measurement invariance of the WHODAS 2.0 across youth with and without physical or mental conditions. Assessment, 27(7), 1490–1501.
Üstün, T. B., Kostanjsek, N., Chatterji, S., & Rehm, J. (2010). Measuring health and disability: manual for WHO Disability Assessment Schedule: WHODAS 2.0. Geneva: World Health Organization.
Valenzuela, J. M. et al. (2006). Insulin pump therapy and health-related quality of life in children and adolescents with type 1 diabetes. Journal of Pediatric Psychology, 31(6), 650–660.
Willemen, A. M. et al. (2008). Change in psychopathology in referred children: the role of life events and perceived stress. Journal of Child Psychology and Psychiatry, 49(11), 1175–1183.
Wiriyakijja, P., Porter, S., Fedele, S., Hodgson, T., McMillan, R., Shephard, M., & Riordain, R. N. (2020). Validation of the HADS and PSS-10 and psychological status in patients with oral lichen planus. Oral Diseases, 26(1), 96–110.
Wolf, E. J., Harrington, K. M., Clark, S. L., & Miller, M. W. (2013). Sample size requirements for structural equation models: an evaluation of power, bias, and solution propriety. Educational and Psychological Measurement, 73(6), 913–934.
Wu, S. M., & Amtmann, D. (2013). Psychometic evaluation of the Perceived Stress Scale in multiple sclerosis. ISRN Rehab, 2013, 608356.
Wyrwich, K. W., Tierney, W. M., & Wolinsky, F. D. (1999). Further evidence supporting an SEM-based criterion for identifying meaningful intra-individual changes in health-related quality of life. Journal of Clinical Epidemiology, 52(9), 861–873.
Yarcheski, A. et al. (2011). Stress, hope, and loneliness in young adolescents. Psychological Reports, 108(3), 919–922.
Young, D. et al. (2017). Avoidant coping moderates the relationship between stress and depressive emotional eating in adolescents. Eating and Weight Disorders, 22(4), 683–691.
Zelman, J. J., & Ferro, M. A. (2018). Psychometric properties of the Parental Stress Scale in families of children with chronic physical conditions. Family Relations, 67(Apr 2018), 240–252.
Funding
Data used in this manuscript come from a study funded by Hamilton Health Sciences (NIF-14363). Dr. Ferro holds the Canada Research Chair in Youth Mental Health and is supported by an Early Researcher Award from the Ministry of Research, Innovation and Science.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The authors declare no competing interests.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Whitney, S., Luther, A.W.M. & Ferro, M.A. Psychometric Properties of the Perceived Stress Scale in Youth with Mental Illness. J Child Fam Stud 31, 2801–2812 (2022). https://doi.org/10.1007/s10826-022-02387-x
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10826-022-02387-x