Abstract
Perceived improvement has been proposed as an important patient-reported outcome measure in mental health services evaluation. One advantage of this measure is that it can indicate whether other outcome measures, as pre-post differences in symptoms, correspond to a noticeable impact in patients’ lives, as assessed by themselves. This study investigated the association between observer and self-reported symptomatic changes and perceived improvement by patients treated in two Brazilian outpatient mental health services. Significant and positive correlations were found between perceived improvement scores and both pre-post differences, obtained in observer-reported and patient-reported symptom scores. Nevertheless, scores of perceived improvement showed to be more correlated to patient-reported than to the observer-rated symptomatic change score. In addition, a greater correlation was found between perceived improvement scores and post-treatment symptom scores, compared to pre-treatment. These results suggest that an improvement in symptom severity, measured by pre-post differences scores, corresponds to the patient perception that he is actually better than before. However, the correlations found were moderate, suggesting that other factors may also be related to perceived improvement and must be investigated in further studies.
Similar content being viewed by others
References
Hansson L: Outcome assessment in psychiatric service evaluation. Social Psychiatry and Psychiatric Epidemiology 36:244–248, 2001
Smith GR, Manderscheid RW, Flynn LM et al.: Principles for assessment of patient outcomes in mental health care. Psychiatric Services 48(8):1033–1036, 1997
World Health Organization. WHO-AIMS report on mental health system in Brazil. World Health Organization, Ministry of Health, Brasília, Brazil, 2007. http://www.who.int/mental_health/evidence/who_aims_report_brazil.pdf. Accessed 25 August 2011
McCabe R, Saidi M, Priebe S: Patient-reported outcomes in schizophrenia. British Journal of Psychiatry 191:21–28, 2007
Mercier L, Landry M, Corbiere M, et al.: Measuring clients perception as outcome measurement. In: Roberts AR, Yeager KR (Eds) Evidence-based practice manual: research and outcome measures in health and human services. Newyork, Oxford University Press, pp. 904–909, 2004
Perreault M, White ND, Fabrès E, et al.: Relationship between perceived improvement and treatment satisfaction among clients of a methadone maintenance program. Evaluation and Program Planning 33:410–417, 2010
Sechrest L, McKnight P, McKnight K: Calibration of measures for psychotherapy outcome studies. American Psychologist 51:1065–1071, 1996
Garfield SL, Prager RA, Bergin AE: Evaluation of outcome in psychotherapy. Journal of Consulting and Clinical Psychology 37:307–313, 1971
Ankuta GY, Abeles N: Client satisfaction, clinical significance and meaningful change in psychotherapy. Professional Psychology: Research and Practice 24:70–74, 1993
Lunnen KM, Ogles BM: A multiperspective, multivariable evaluation of reliable change. Journal of Consulting and Clinical Psychology 66:400–410, 1998
Ries RK, Jaffe C, Comtois KA, et al.: Treatment satisfaction compared with outcome in severe dual disorders. Community Mental Health Journal 35:213–221, 1999
Rohland BM: Self-report of improvement following hospitalization for electroconvulsive therapy: Relationship to functional status and service use. Administration and Policy in Mental Health 28:193–203, 2001
Nielsen SL, Smart DW, Isakson RL, et al.: The consumer reports effectveness score: What did consumers report? Journal of Counselling Psychology 51:25–37, 2004
Beretta V, De Roten Y, Drapeau M, et al.: Clinical significance and perceived change in four sessions of brief psychodynamic intervention: Characteristics of early responders. Psychology and Psychotherapy: Theory, Research and Practice 78:347–362, 2005
Eisen S, Ranganathan G, Seal P, et al.: Measuring clinically meaningful change following mental health treatment. Journal of Behavioral Health Services and Research 34:272–289, 2004
Jung SI, Nunes MLT, Eizirik CL: Avaliação de resultados da psicoterapia psicanalítica. Revista de Psiquiatria do Rio Grande do Sul 29:184–196, 2007
Jensen HH, Mortensen EL, Lotz M: The association between retrospective outcome evaluations and pre-post-treatment changes in psychodynamic group-psychotherapy. Scandinavian Journal of Psychology 49:339–343, 2008
Kupper Z, Tschacher W: Lack of concordance between subjective improvement and symptom change in psychotic episodes. British Journal of Clinical Psychology 47:75–93, 2008
Lunnen KM, Ogles BM, Pappas LN: A multiperspective comparison of satisfaction, symptomatic change, perceived change and end-point functioning. Professional Psychology: Research and Practice, 39:145–152, 2008
Demyttenaere K, Desaiah D, Petit C, et al.: Patient-assessed versus physician assessed disease severity and outcome in patients with nonspecific pain associated with major depressive disorder. Primary Care Companion Journal of Clinical Psychiatry 11:8–15, 2009
Karpenko V: Clinically significant symptom change in adolescents receiving outpatient community mental health services: Does it relate to satisfaction, perceived change, therapeutic alliance, and improvement in presenting problems? Doctoral dissertation, Department of Psychology and the College of Arts and Sciences, Ohio University, Ohio, USA, 2010. http://etd.ohiolink.edu/send-pdf.cgi/Karpenko%20Veronika.pdf?ohiou1273609072. Accessed 20 July 2011
Larsen DL, Attkinson CC, Hargreaves WA, et al.: Assessment of client/patient satisfaction: Development of a general scale. Evaluation and Program Planning 2:197–207, 1979
Organização Mundial de Saúde: CID-10: Classificação Internacional de Doenças e Problemas Relacionados à Saúde. 10th edn. São Paulo, EDUSP, 1998
Zuardi AW, Loureiro SR, Rodrigues CRC, et al.: Estudo da estrutura fatorial, fidedignidade e validade da tradução e adaptação para o português da Escala de Avaliação Psiquiátrica Breve (BPRS) Modificada. Revista da Associação Brasileira de Psiquiatria: Asociacion Psiquiatrica de la America Latina 16:63–68, 1994
Crippa JAS, Sanches RF, Hallak JEC, et al.: Factor structure of Bech’s version of the brief psychiatric rating scale in Brazilian patients. Brazilian Journal of Medical and Biological Research 35:1209–1213, 2002
Bech P, Kastrup M, Rafaelsen OJ: Mini-compendium of rating scales for states of anxiety, depression, mania, and schizophrenia with corresponding DSMIII syndromes. Acta Psychiatrica Scandinavica 326:7–37, 1986
Rhoades HM, Overall, JE: The semistructured BPRS interview and rating guide. Psychopharmacology Bulletin 24:101–104, 1988
Crippa JAS, Sanches RF, Hallak JEC, et al.: A structured interview guide increases Brief Psychiatric Rating Scale reliability in raters with low clinical experience. Acta Psychiatrica Scandinavica 103:465–470, 2001
Derogatis, LR: Symptom Checklist-90-R (SCL-90-R): Administration, Scoring, and Procedures Manual. Mineapolis: National Computer Systems, 1994
Laloni DT: SCL-90-R: adaptação, precisão e validade. Doctoral dissertation, Pontifícia Universidade Católica, Campinas, SP, Brasil, 2001. http://www.bibliotecadigital.puccampinas.edu.br/tde_busca/arquivo.php?codArquivo=294. Accessed 15 July 2011
Bandeira M, Andrade, MCR, Costa, CS, et al.: Percepção dos pacientes sobre o tratamento em serviços de saúde mental: validação da Escala de Mudança Percebida. Psicologia. Reflexão e Crítica 24:236–244, 2011
Guillemin F, Bombardier C, Beaton D: Cross-cultural adaptation of health-related quality of life measures: Literature review and proposed guidelines. Journal of Clinical Epidemiology 46:1417–1432, 1993
Russo J, Roy-Byrne P, Jaffe C, et al.: The relationship of patient-administered outcome assessments to quality of life and physician rating: Validity of the BASIS-32. Journal of Mental Health Administration 24:200–214, 1997
Guyatt GH, Norman GR, Juniper EF, et al.: A critical look at transition ratings. Journal of Clinical Epidemiology 55:900–908, 2002
Conway M, Ross M: Getting what you want by revising what you had. Journal of personality and social psychology 47:738–748, 1984
Jacobson NS, Truax P: Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology 59:12–19, 1991
Seligman MEP: The effectiveness of psychotherapy: The Consumer Reports study. American Psychologist 51:965–974, 1995
Hasler G, Moergeli H, Schnyder U: Outcomes of psychiatric treatment: What is relevant for our patients? Comprehensive Psychiatry 45:199–205, 2004
Acknowledgments
This research was funded by Universidade Federal de São João del-Rei and Fundação de Amparo à Pesquisa do Estado de Minas Gerais [Foundation of Research Support in the State of Minas Gerais]—FAPEMIG. The first author’s training at Douglas Institute and McGill University, which included the preparation of this manuscript, was funded by FAPEMIG, grant number ECT—00041-11.
Conflict of interest
The authors declare that they have no conflict of interest.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Andrade, M.C.R., Bandeira, M., Perreault, M. et al. The Relationship Between Symptomatic Changes and Perceived Improvement Among Patients Treated in Brazilian Community Mental Health Services. Psychiatr Q 83, 361–370 (2012). https://doi.org/10.1007/s11126-012-9206-6
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11126-012-9206-6