Skip to main content
SpringerLink
Log in

Measuring cognitive change in older adults: reliable change indices for the SIDAM

  • ORIGINAL COMMUNICATION
  • Published:
Journal of Neurology Aims and scope Submit manuscript

Abstract

Background

In clinical settings, neuropsychological tests and screening instruments are often used to measure cognitive change over time. However, the interpretation of changes in test scores is often difficult. For most instruments there is no information how much change occurs normally in cognitively healthy individuals.

Aim

To examine what is a reliable change for a widely used screening instrument for cognitive impairment and dementia.

Methods

A Sample of 119 cognitively normal elderly individuals aged 75 and over participated in the Leipzig Longitudinal Study of the Aged (LEILA 75+). All participants have been tested six times at 1.5 year intervals with the test part of the SIDAM over a mean period of 7.1 years. Reliable change indices (RCI) were computed for a common confidence interval (90%). It is demonstrated how to compute RCI for individual patients.

Results

In repeated assessments with 1.5 year intervals, a change in SIDAM score of at least 4 to 7 points (dependent on which of the six assessments were compared) indicates a reliable change at the 90% confidence level. Smaller changes can be interpreted only with high uncertainty.

Conclusion

The interpretation of changes in test scores in older adults should account for potential practice effect, normal decline and regression to the mean.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Bird CM, Papadopoulou K, Ricciardelli P, Rossor MN, Cipolotti L (2004) Monitoring cognitive changes: psychometric properties of six cognitive tests. Br J Clin Psychol. 43(2):197–210

    Article  PubMed  Google Scholar 

  2. Busse A, Aurich C, Zaudig M, Riedel-Heller S, Matschinger H, Angermeyer MC (2002) Age- and education-specific reference values for the cognitive test of the SIDAM (Structured interview for the diagnosis of dementia of the Alzheimer type, multi-infarct dementia and dementias of other etiology according to ICD-10 and DSM-IV)] Z Gerontol Geriatr 35(6):565–574

    Article  PubMed  CAS  Google Scholar 

  3. Chelune GJ, Naugle RI, Lüders H, Sedlak J, Awad IA (1993) Individual change after epilepsy surgery: Practice effects and base-rate information. Neuropsychology 7(1):41–52

    Article  Google Scholar 

  4. Collie A, Maruff P, Makdissi M, McStephen M, Darby DG, McCrory P (2004) Statistical procedures for determining the extent of cognitive change following concussion. Br J Sports Med 38(3):273–278

    Article  PubMed  CAS  Google Scholar 

  5. Dikmen SS, Heaton RK, Grant I, Temkin NR (1999) Test-retest reliability and practice effects of expanded Halstead-Reitan Neuropsychological Test Battery. J Int Neuropsychol Soc 5(4):346–356

    Article  PubMed  CAS  Google Scholar 

  6. Duff K, Beglinger LJ, Schoenberg MR, Patton DE, Mold J, Scott JG, Adams RL (2005) Test-retest stability and practice effects of the RBANS in a community dwelling elderly sample. J Clin Exp Neuropsychol 27(5):565–575

    PubMed  Google Scholar 

  7. Duff K, Schoenberg MR, Patton D, Paulsen JS, Bayless JD, Mold J, Scott JG, Adams RL (2005) Regression-based formulas for predicting change in RBANS subtests with older adults. Arch Clin Neuropsychol 20(3):281–290

    Article  PubMed  Google Scholar 

  8. Folstein MF, Folstein SE, McHugh PR (1975) “Mini-mental state”. A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res 12:189–198

    Article  PubMed  CAS  Google Scholar 

  9. Frerichs RJ, Tuokko HA (2005) A comparison of methods for measuring cognitive change in older adults. Arch Clin Neuropsychol 20(3):321–333

    Article  PubMed  Google Scholar 

  10. Frerichs RJ, Tuokko HA (2005) Reliable change scores and their relation to perceived change in memory: Implications for the diagnosis of mild cognitive impairment. Arch Clin Neuropsychol 2006 Jan; 21(1):109–115

    Google Scholar 

  11. Heaton RK, Temkin N, Dikmen S, Avitable N, Taylor MJ, Marcotte TD, Grant I (2001) Detecting change: A comparison of three neuropsychological methods, using normal and clinical samples. Arch Clin Neuropsychol 16(1):75–91

    Article  PubMed  CAS  Google Scholar 

  12. Hopp GA, Dixon RA, Grut M, Backman L (1997) Longitudinal and psychometric profiles of two cognitive status tests in very old adults. J Clin Psychol 53(7):673–686

    Article  PubMed  CAS  Google Scholar 

  13. Hsu LM (1999) Caveats concerning comparisons of change rates obtained with five methods of identifying significant client changes: comment on Speer and Greenbaum (1995). J Consult Clin Psychol 67(4):594–598

    Article  PubMed  CAS  Google Scholar 

  14. Isella V, Atzeni L, Iurlaro S, Villa ML, Russo A, Forapani E, Frattola L, Appollonio IM (2003) Assessing clinically relevant cognitive decline: preliminary data on a new method. Neurol Sci 24(4):236–241

    Article  PubMed  CAS  Google Scholar 

  15. Iverson GL (1998) Interpretation of Mini-Mental State Examination scores in community-dwelling elderly and geriatric neuropsychiatry patients. Int J Geriatr Psychiatry 13(10):661–666

    Article  PubMed  CAS  Google Scholar 

  16. Iverson GL (2001) Interpreting change on the WAIS-III/WMS-III in clinical samples. Arch Clin Neuropsychol 16(2):183–191

    Article  PubMed  CAS  Google Scholar 

  17. Ivnik RJ, Smith GE, Lucas JA, Petersen RC, Boeve BF, Kokmen E, Tangalos EG (1999) Testing normal older people three or four times at 1- to 2-year intervals: defining normal variance. Neuropsychology 13(1):121–127

    Article  PubMed  CAS  Google Scholar 

  18. Ivnik RJ, Smith GE, Petersen RC, Boeve BF, Kokmen E, Tangalos EG (2000) Diagnostic accuracy of four approaches to interpreting neuropsychological test data. Neuropsychology 14(2):163–177

    Article  PubMed  CAS  Google Scholar 

  19. Jacqmin-Gadda H, Fabrigoule C, Commenges D, Dartigues JF (1997) A 5-year longitudinal study of the Mini-Mental State Examination in normal aging. Am J Epidemiol 145(6):498–506

    PubMed  CAS  Google Scholar 

  20. Levine AJ, Miller EN, Becker JT, Selnes OA, Cohen BA (2004) Normative data for determining significance of test-retest differences on eight common neuropsychological instruments. Clin Neuropsychol. 18(3):373–384

    Article  PubMed  Google Scholar 

  21. Maassen GH (2005) Reliable change assessment in sport concussion research: a comment on the proposal and reviews of Collie et al. Br J Sports Med 39(8):483–487; discussion 487–488

    Article  PubMed  CAS  Google Scholar 

  22. Martin R, Sawrie S, Gilliam F, Mackey M, Faught E, Knowlton R, Kuzniekcy R (2002) Determining reliable cognitive change after epilepsy surgery: development of reliable change indices and standardized regression-based change norms for the WMS-III and WAIS-III. Epilepsia 43(12):1551–1558

    Article  PubMed  Google Scholar 

  23. Mitrushina M, Satz P (1991) Reliability and validity of the Mini-Mental State Exam in neurologically intact elderly. J Clin Psychol 47(4):537–543

    PubMed  CAS  Google Scholar 

  24. Patton DE, Duff K, Schoenberg MR, Mold J, Scott JG, Adams RL (2005) Base rates of longitudinal RBANS discrepancies at one- and two-year intervals in community-dwelling older adults. Clin Neuropsychol 19(1):27–44

    PubMed  Google Scholar 

  25. Reischies FM, Helmchen H (2002) Normales und pathologisches kognitives Altern. In: Beyreuther, K., Einhäupl, K., Förstl, H. Kurz, A. Demenzen. Grundlagen und Klinik. Stuttgart: Thieme-Verlag, 1–14

  26. Riedel-Heller SG, Matschinger H, Schork A, Angermeyer MC (2000) Recruitment procedures and their impact on the prevalence of dementia. Neuroepidemiology 19:130–140

    Article  PubMed  CAS  Google Scholar 

  27. Salinsky MC, Storzbach D, Dodrill CB, Binder LM (2001) Test-retest bias, reliability, and regression equations for neuropsychological measures repeated over a 12–16-week period. J Int Neuropsychol Soc 7(5):597–605

    Article  PubMed  CAS  Google Scholar 

  28. Sawrie SM, Marson DC, Boothe AL, Harrell LE (1999) A method for assessing clinically relevant individual cognitive change in older adult populations. J Gerontol B Psychol Sci Soc Sci 54(2):116–124

    Google Scholar 

  29. Schneekloth U & Potthoff P. Hilfe- und Pflegebedürftige in privaten Haushalten. Bericht zur Repräsentativerhebung im Forschungsprojekt “Möglichkeiten und Grenzen selbständiger Lebensführung”, im Auftrag des Bundesministeriums für Familie und Senioren (Bd. 20.2 - Schriftenreihe des BMFuS). Stuttgart: Kohlhammer. 1993

  30. Schmand B, Lindeboom J, Launer L, Dinkgreve M, Hooijer C, Jonker C (1995) What is a significant score change on the Mini-Mental State examination? Int J Geriatr Psych 10:411–414

    Article  Google Scholar 

  31. Sliwinski M, Lipton RB, Buschke H, Stewart W (1996) The effects of preclinical dementia on estimates of normal cognitive functioning in aging. J Gerontol B Psychol Sci Soc Sci 51(4):P217–25

    PubMed  CAS  Google Scholar 

  32. Temkin NR, Heaton RK, Grant I, Dikmen SS (1999) Detecting significant change in neuropsychological test performance: a comparison of four models. J Int Neuropsychol Soc 5(4):357–369

    Article  PubMed  CAS  Google Scholar 

  33. Tombaugh TN (2005) Test-retest reliable coefficients and 5-year change scores for the MMSE and 3MS. Arch Clin Neuropsychol 20(4):485–503

    Article  PubMed  Google Scholar 

  34. Zaudig M, Mittelhammer J, Hiller W, Pauls A, Thora C, Morinigo A, Mombour W (1991) SIDAM-A structured interview for the diagnosis of dementia of the Alzheimer type, multi-infarct dementia and dementias of other aetiology according to ICD-10 and DSM-III-R. Psychol Med 21:225–236

    Article  PubMed  CAS  Google Scholar 

Download references

Acknowledgement

This work was supported by the Interdisziplinäres Zentrum für Klinische Forschung (IZKF) Leipzig [Interdisciplinary Centre for Clinical Research Leipzig] at the Faculty of Medicine, University of Leipzig (project C07).

Author information

Authors and Affiliations

  1. Dept. of Psychiatry, Research Department of Evaluation and Epidemiology, University of Leipzig, Johannisallee 20, 04317, Leipzig, Germany

    Anke Hensel, Matthias C. Angermeyer & Steffi G. Riedel-Heller

  2. Psychosomatic Clinic Windach, Schützenstraße 100, 86949, Windach, Germany

    Michael Zaudig

Authors
  1. Anke Hensel
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Matthias C. Angermeyer
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Michael Zaudig
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Steffi G. Riedel-Heller
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Anke Hensel.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Hensel, A., Angermeyer, M.C., Zaudig, M. et al. Measuring cognitive change in older adults: reliable change indices for the SIDAM. J Neurol 254, 91–98 (2007). https://doi.org/10.1007/s00415-006-0290-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00415-006-0290-0

Keywords

Search

Navigation