Figures
Abstract
Objective
Cognitive deficits are common after aneurysmal subarachnoid haemorrhage (aSAH), and clinical evaluation is important for their management. Our hypothesis was that the Montreal Cognitive Assessment (MoCa) is superior to the Mini-Mental State Examination (MMSE) in screening for cognitive domain deficit in aSAH patients.
Methods
We carried out a prospective observational and diagnostic accuracy study on Hong Kong aSAH patients aged 21 to 75 years who had been admitted within 96 hours of ictus. The domain-specific neuropsychological assessment battery, the MoCA and MMSE were administered 2–4 weeks and 1 year after ictus. A cognitive domain deficit was defined as a cognitive domain z score <−1.65 (below the fifth percentile). Cognitive impairment was defined as two or more cognitive domain deficits. The study is registered at ClinicalTrials.gov of the US National Institutes of Health (NCT01038193).
Results
Both the MoCA and the MMSE were successful in differentiating between patients with and without cognitive domain deficits and cognitive impairment at both assessment periods. At 1 year post-ictus, the MoCA produced higher area under the curve scores for cognitive impairment than the MMSE (MoCA, 0.92; 95% CI, 0.83 to 0.97 versus MMSE, 0.77; 95% CI, 0.66 to 0.83, p = 0.009).
Citation: Wong GKC, Lam SW, Wong A, Ngai K, Poon WS, Mok V (2013) Comparison of Montreal Cognitive Assessment and Mini-Mental State Examination in Evaluating Cognitive Domain Deficit Following Aneurysmal Subarachnoid Haemorrhage. PLoS ONE 8(4): e59946. https://doi.org/10.1371/journal.pone.0059946
Editor: Sonia Brucki, University Of São Paulo, Brazil
Received: November 16, 2012; Accepted: February 19, 2013; Published: April 3, 2013
Copyright: © 2013 Wong et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: These authors have no support or funding to report.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Although aneurysmal subarachnoid haemorrhage (aSAH) accounts for only 3% of strokes, its profound consequences and unique window for intervention justify its classification as a separate entity [1]. Estimated independence in activities of daily living varies between 36% and 60% after aSAH [2], [3], and patients exhibit varying degrees of cognitive dysfunction [4], [5], [6]. Identifying cognitive dysfunction in aSAH patients is of paramount importance in patient management (i.e. medical treatment, cognitive rehabilitation and social arrangements).
A systematic review of aSAH cognitive dysfunction showed the main cognitive domain impairments to include memory, executive function and language, the prevalence of which ranges from 0% to 76% [3], [7]. The most common cognitive screening assessment tool used in neurosurgical clinics is the Mini-Mental State Examination (MMSE), which is quick (5–10 min) and easy to administer in a clinic setting. However, the MMSE was originally designed to screen for Alzheimer’s disease, and thus does not encompass all of the cognitive deficits that might occur following a stroke. It is particularly weak in its ability to measure executive functions, such as abstract thinking, judgment, problem solving and perception, all of which are relevant to the type of dementia associated with vascular disease. More recently, the Montreal Cognitive Assessment (MoCA) has also been used to screening for poststroke cognitive impairment [8]. The MoCA places greater emphasis on frontal executive function and attention tasks than does the more commonly used MMSE, and it may be more sensitive for the detection of non-Alzheimer’s disease dementia [9], [10]. Dong et al. further extended MoCA’s application during acute admission to predict vascular cognitive impairment 3–6 months after stroke [11]. Schweizer et al. subsequently found that when applied to 32 aSAH patients at a mean time of 29 months after aSAH, the MoCA was more sensitive to specific neurocognitive test scores than the MMSE, although they did not assess cognitive domain deficits [6]. The MoCA has also been shown to correlate with functional outcomes in aSAH patients at 3 months [12]. Godefroy et al., however, found that as a screening assessment for cognitive impairment, MoCA was not superior to MMSE with adjusted cut-off scores in subacute stroke patients [13].
Clinical disability and handicap scales are insensitive to poor neuropsychological outcomes. Accordingly, there is a well-recognised need to develop tests that are sensitive to the subtle but disabling effects of aSAH. The objective of the study reported herein was to collect additional data on evaluations of post-aSAH cognitive impairment and the theoretical advantages of using the MoCA in aSAH patients. Accordingly, we assessed the diagnostic accuracy of MoCA scores relative to the more commonly used MMSE scores in detecting post-aSAH cognitive impairment in the subacute and chronic phases of aSAH (i.e. 2–4 weeks and 1 year after ictus).
Methods
This prospective observational four-centre study was carried out in Hong Kong. It is registered at ClinicalTrials.gov of the US National Institutes of Health (NCT01038193), and was approved by the Joint CUHK-NTEC Clinical Research Ethics Committee. It conformed to the Declaration of Helsinki, and written informed consent was obtained from all of the participants or their next of kin.
The patient inclusion criteria were: 1) spontaneous subarachnoid haemorrhage with angiography-confirmed aetiology of intracranial aneurysms; 2) hospital admission within 96 hours of ictus; 3) between 21 and 75 years of age; 4) speaker of Chinese (Cantonese); and 5) willing and able to provide informed consent (or availability of a person authorised to do so). The exclusion criteria were: a) a history of previous cerebrovascular or neurological disease other than unruptured intracranial aneurysm; b) a history of neurosurgery before ictus; and c) inability to cooperate in cognitive assessments (unable to obey commands).
Assessments were conducted 2–4 weeks (subacute phase) and 1 year (chronic phase) after ictus by one of two research assistants (psychology graduates) trained by a post-doctoral research psychologist. The cognitive assessments were carried out in a single session or in two sessions on consecutive days. The MMSE was administered before the cognitive domain-specific neuropsychological tests and the MoCA.
Montreal Cognitive Assessment
The MoCA [9], [12] is a one-page, 30-point test that usually takes 15 minutes or less to administer and includes six subtests: visuospatial/executive functions, naming, attention, abstraction, recall and orientation [9], [12]. One point is added for participants with less than 12 years of education. The cut-off for mild cognitive impairment is 24/25 [9]. We recently reported the application of the Hong Kong version of MoCA in aSAH and neurosurgical patients following traumatic and spontaneous intracerebral haemorrhage [12], [14].
Mini-Mental State Examination Chinese (Cantonese) Version
The MMSE [15] comprises seven sections (naming, orientation, registration, attention and calculation, recall, praxia, and language). Its maximum total score is 30, and the test can usually be completed in 10 minutes or less. The Cantonese version has been validated in a population of dementia patients, for whom the optimal cut-off was 19/20 [16].
The battery of cognitive assessments used in this study was previously applied in a local Chinese population [17]. Its selection was based on (a) its efficacy in previous cognitive studies in local Chinese patients and standard cognitive tests validated in a Cantonese-speaking population, and (b) its balanced range of tests covering verbal and visuospatial memory, attention and working memory, executive functions, psychomotor speed and language. This battery included the following.
Verbal Memory Domain
i.) Hong Kong List Learning Test (HKLLT) [18].
The HKLLT is based on the California Verbal Learning Test, which is regularly used in vascular cognitive impairment studies. It is a verbal learning and memory test that consists of two 16-word lists with three learning trials: immediate recall, 10-minute delayed recall and 30-minute delayed recall and recognition. The HKLLT has been validated in both normal and pathological local populations [18].
Visuospatial Skill and Memory Domain
i.) The Rey Osterrieth Complex Figure Test.
The Rey Osterrieth Complex Figure Test is commonly used to assess visuospatial construction skills and visuospatial memory [19].
Attention and Working Memory Domain
i.) The verbal and visual digit span forward and backward tests from the Chinese Wechsler Memory Scale-Third Edition [20] are used to evaluate simple attention and working memory.
Verbal and visual spans have been used as donor scales for composite psychometric measures.
Executive Function and Psychomotor Speed Domain
i.) Symbol-Digit Modalities Test [21].
This brief, easy-to-administer, timed coding test is a variant of the Digit-Symbol Coding Task in the Wechsler Adult Intelligence Scale-Third Edition.
ii.) Color Trails Test (CTT).
This test originates from the Trail Making Test (TMT), which is used in the timed assessment of psychomotor speed and executive functions. As it features coloured numbers rather than the English alphabet, the CTT is considered to be an acceptable cultural substitute for the original TMT and has been shown to have similar psychometric properties [22].
Language Domain
i.) modified Boston Naming Test (mBNT) [24].
The Boston Naming Test is the most frequently used confrontation naming test in assessing language. In this study, we used the mBNT, a validated modified version that contains 15 stimuli appropriate for use in Chinese cultures [18].
Cognitive domain scores were computed by averaging the z scores of the respective test measures derived from established age- and education-matched norms. A cognitive domain deficit was defined as a cognitive domain z score <−1.65 (below the fifth percentile). Cognitive impairment was defined as two or more cognitive domain deficits [25].
Statistical Analysis
Statistical analyses were generated using SPSS for Windows Version 15.0 (SPSS Inc., Chicago, IL, USA) and MedCalc Version 12.2.1.0. Categorical data are presented herein as numbers (percentages) and numerical data as medians and interquartile ranges (IQR), unless otherwise specified. In the assessments of cognitive impairment, a difference with a P value of less than 0.05 was regarded as statistically significant. For the secondary analyses of individual domain deficits, a difference with a P value of less than 0.01 (to account for multiple comparisons) was regarded as statistically significant.
Receiver operating characteristic (ROC) curves were constructed to examine the ability to distinguish post-aSAH cognitive impairment and the five individual domain deficits (the verbal memory, visuospatial skill and memory, attention and working memory, executive function and psychomotor speed, and language domains) at both 2–4 weeks and 1 year. The area under the curve (AUC) was calculated for each of the aforementioned ROC curves with a 95% confidence interval (95% CI). The AUC represents the probability that the score of a normal sample will be higher than that of an abnormal sample when one sample is drawn from a truly normal population and the other from a truly abnormal population. The statistical significances of the differences between the correspondingly paired MoCA and MMSE AUCs of cognitive impairment and the five individual domain deficits were then assessed using the nonparametric approach adopted by Delong et al. [26]. For the MoCA and MMSE ROC curves for cognitive impairment at 2–4 weeks and 1 year, cut-off values were derived at the ROC coordinate points, where both sensitivity and specificity were optimised using the maximised Youden Index (J) [27]. The Youden Index is defined as sensitivity (true positive)+specificity (true negative) –1 [28]. Complete separation of the marker values for abnormal and normal populations results in J = 1, whereas their complete overlap produces 0. The discriminant indices (sensitivity, specificity, positive and negative predictive values, and diagnostic accuracy [% correctly classified]) of cognitive impairment at the optimal cut-offs were calculated for MoCA and the MMSE at the two assessment points.
The reproducibility of the assessments was not assessed because it was not the focus of the study, and would have been impractical considering the study’s design (possible rehearsal effects and additional inconvenience to patients and their families).
Results
Seventy-four and 80 patients completed all of the cognitive assessments at 2–4 weeks and 1 year, respectively. The patient profiles are presented in Tables 1 and 2. No adverse events were reported in relation to the assessments.
Table 3 shows that both the MoCA and the MMSE were able to differentiate between patients with and without cognitive domain deficits and cognitive impairment. At 2–4 weeks, the two screening methods produced similar AUCs for both cognitive domain deficits and cognitive impairment (Table 4 and Figure 1). At 1 year, the MoCA achieved significantly higher AUCs than the MMSE for cognitive impairment, although not for single domain deficits (Table 5 and Figure 2).
In screening for cognitive impairment defined as two or more cognitive domain deficits, the optimal cut-offs for the MoCA and MMSE were ≤18 and ≤24, respectively, at 2–4 weeks and ≤22 and ≤24, respectively, at 1 year (Table 3), with diagnostic accuracy (% correctly classified) ranging from 80% to 92%.
Discussion
The results of this study demonstrate the accuracy of the MoCA in the diagnosis of post-aSAH cognitive domain deficits and cognitive impairment at both the subacute and chronic stages. Further, they show the MoCA to be superior to the MMSE in diagnosing post-aSAH cognitive impairment at the chronic stage.
Godefroy et al. recently assessed 95 patients (infarct: n = 88; haemorrhage: n = 7) to compare the efficacy of the MoCA and MMSE in detecting poststroke cognitive impairment, as determined by a neuropsychological battery, at a mean of 24 days poststroke [13]. Both demonstrated good ability to discriminate between impaired and nonimpaired cognitive status (AUCs >0.88). The MoCA performed similarly to the MMSE at an adjusted cut-off score of ≤20. These researchers’ results were similar to our observations in aSAH patients in the subacute phase.
Schweizer et al. reported the first case series using the MoCA in aSAH patients. They recruited 32 aSAH patients with favourable neurological outcomes (31 good recoveries and 1 moderate disability on the Glasgow Outcome Scale) [6]. Neurocognitive assessments were performed at least 6 months after aSAH. They found that the MMSE total score did not correlate with any neurocognitive test score except the Boston Naming Test score for language. The MoCA total score, in contrast, was correlated with the Wisconsin Card Sorting test score for executive function, Boston Naming Test score for language and California Verbal Learning test score for verbal learning and memory. They did not evaluate the relationship between the MoCA and cognitive domain deficits. The results of the current study confirm the suggested superiority of the MoCA over the MMSE in screening post-aSAH cognitive domain deficit and cognitive impairment at 1 year using a domain-specific neuropsychological assessment battery.
Our optimal cut-offs (≤18 at 2–4 weeks and ≤24 at 1 year) were lower than the original cut-off (≤25) proposed by Nasreddine et al. [9]. One major difference between the two studies is that we were screening for cognitive impairment characterised by two or more cognitive domain deficits, whereas their focus was mild cognitive impairment. It is also possible that different language versions of the screening tools may yield different cut-off scores for the same disease entity [29] and that the nature of the disease may differ across studies.
It is not known why the MoCA performed better than the MMSE in detecting cognitive impairment at the chronic stage but not the subacute stage in this study. We speculate that diffuse brain injuries significantly overshadow focal brain injuries in the manifestation of cognitive impairment at the subacute stage, whereas the reverse occurs at the chronic stage. It is recommended that biomarker studies be considered in future to investigate this interesting phenomenon.
Passier et al. recently reported domain-based cognitive functioning at 3 months post-aSAH to be the most relevant independent predictor of health-related quality of life at 1 year post-aSAH [30]. They also concluded that it is important to screen all patients because reduced health-related quality of life is not limited to patients discharged to a rehabilitation facility. The urgency of the need to find an optimal screening test for aSAH patients cannot be understated.
MoCA’s feasibility has also been evaluated in a stroke clinical trial [31]. Of those patients who survived to 3 months, the MoCA was completed by 87% of those with mild stroke, 79% with moderate stroke and 67% with severe stroke on admission. The MoCA scale was shown to have a high degree of internal consistency, with all items loading onto a single factor that accounted for nearly half the variance. These findings further support the clinical and research application of the MoCA as a screening test for cognitive impairment in aSAH patients.
Limitations of This Study
This study had several limitations. First, although the domain-based neuropsychological battery we used has been validated in a Chinese population with established norms, it is possible that it was insufficiently sensitive and comprehensive to measure subtle cognitive changes in patients with milder occurrences of the disease [32]. Second, the cognitive domain was treated as a unitary construct rather than as a collection of different cognitive abilities. Third, undergoing the battery of cognitive assessments in addition to the MMSE and MoCA is tiring, and fatigue may have affected patients’ performance, although to compensate we offered a 5- to 10-minute rest in the middle of the assessment sessions or divided the assessments over two consecutive days. Finally, the study’s aim was to assess the cognitive profile of aSAH patients, and thus its results may not be applicable to other stroke subtypes.
Author Contributions
Study supervision: WSP GKCW. Conceived and designed the experiments: GKCW AW VM. Performed the experiments: SWL KN AW. Analyzed the data: GKCW. Contributed reagents/materials/analysis tools: GKW SWL KN. Wrote the paper: GKCW.
References
- 1. Chau PH, Woo J, Goggins WB, Tse YK, Chan KC, et al. (2011) Trends in stroke incidence in Hong Kong differ by stroke subtype. Cerebrovasc Dis. 31: 138–146.
- 2. Rinkel GJ, Algra A (2011) Long-term outcomes of patients with aneurysmal subarachnoid haemorrhage. Lancet Neurol. 10: 349–356.
- 3. Al-Khindi T, Macdonald RL, Schweizer TA (2010) Cognitive and functional outcome after aneurysmal subarachnoid hemorrhage. Stroke. 41: e519–e536.
- 4. Wong GK, Wong R, Mok VC, Fan DS, Leung G, et al. (2009) Clinical study on cognitive dysfunction after spontaneous subarachnoid haemorrhage: patient profiles and relationship to cholinergic dysfunction. Acta Neurochir. 151: 1601–1607.
- 5. Wong GK, Wong A, Mok V, Wong A, Poon WS (2010) Natural history and medical treatment of cognitive dysfunction after spontaneous subarachnoid haemorrhage: review of current literature with respect to aneurysm treatment. J Neurol Sci. 299: 5–8.
- 6. Schweizer TA, Al-Khindi T, Macdonald RL (2012) Mini-mental State Examination versus Montreal Cognitive Assessment: rapid assessment tools for cognitive and functional outcome after aneurysmal subarachnoid hemorrhage. J Neurol Sci. 316: 137–140.
- 7. Mayer SA, Kreiter KT, Copeland D, Bernardini GL, Bates JE, et al. (2002) Global and domain-specific cognitive impairment and outcome after subarachnoid hemorrhage. Neurology. 59: 1750–1758.
- 8. Pendlebury ST, Cuthbertson FC, Welch JV, Mehta Z, Rothwell PM (2010) Underestimation of cognitive impairment by Mini-Mental State Examination versus the Montreal Cognitive Assessment in patients with transient ischemic attack and stroke. A population-based study. Stroke. 41: 1290–1293.
- 9. Nasreddine ZS, Phillips NA, Bedirian V, Charbonneau S, Whitehead V, et al. (2005) The Montreal Cognitive Assessment, MoCA: a brief screening tool for mild cognitive impairment. J Am Geriatr Soc. 53: 695–699.
- 10. Zadikoff C, Fox SH, Tang-Wai DF, Thomsen T, de Bie RM, et al. (2008) A comparison of the Mini Mental State Exam to the Montreal Cognitive Assessment in identifying cognitive deficits in Parkinson’s disease. Movement Disorders. 23: 297–299.
- 11. Dong YH, Venketasubramanian N, Chan BP, Sharma VK, Slavin MJ (2012) Brief screening tests during acute admission in patients with mild stroke are predictive of vascular cognitive impairment 3–6 months after stroke. J Neurol Neurosurg Psychiatry. 83: 580–585.
- 12. Wong GK, Lam S, Ngai K, Wong A, Mok V, et al. (2012) Evaluation of cognitive impairment by the Montreal Cognitive Assessment in patients with aneurysmal subarachnoid hemorrhage: prevalence, risk factors, and correlations with 3-month outcomes. J Neurol Neurosurg Psychiatry. 83: 1112–1117.
- 13. Godefroy O, Fickl A, Roussel M, Auribault C, Bugnicourt JM, et al. (2011) Is the Montreal Cognitive Assessment superior to the Mini-Mental State Examination to detect poststroke cognitive impairment? A study with neuropsychological evaluation. Stroke. 42: 1712–1716.
- 14. Wong GK, Wong R, Poon WS (2011) Cognitive outcome and activity of daily living for neurosurgical patients with intrinsic brain lesions: a 1-year prevalence study. Hong Kong J Occup Ther. 21: 27–32.
- 15. Crum RM, Anthony JC, Bassett SS, Folstein MF (1993) Population-based norms for the Mini-Mental State Examination by age and education level. JAMA. 269: 2386–2391.
- 16. Chiu HFK, Kee HC, Chung WS, Kwong PK (1994) Reliability and validity of the Cantonese version of Mini-mental State Examination – a preliminary study. J Hong Kong Coll Psychiatry. 4: 25–28.
- 17. Wong GK, Ngai K, Wong A, Lam SW, Mok VC, et al. (2012) Long-term cognitive dysfunction in patients with traumatic subarachnoid hemorrhage: prevalence and risk factors. Acta Neurochir. 154: 105–111.
- 18.
Chan AS, Kwok I (1999) Hong Kong List Learning Test: manual and preliminary norm. Hong Kong: Department of Psychological and Clinical Psychology Center.
- 19.
Wechsler D (2005) Wechsler Memory Scale III (Chinese): manual. Taiwan: Psychological Corporation.
- 20. Rey A (1941) L’examen psychologique dans les cas d’encephalopathie traumatique. Arch de Psychologie. 28: 296–302.
- 21.
Smith A (1982) Symbol Digit Modalities Test (SDMT) Manual. Revised ed. Los Angeles: Western Psychological Services.
- 22. Lee TM, Chan CC (2000) Are trail making and color trails tests of equivalent constructs? J Clin Exp Neuropsychol. 22(4): 529–34.
- 23. Chan A, Ho S, Poon WS (2002) Neuropsychological sequalae of patients treated with microsurgical clipping or endovascular embolization for anterior communicating artery aneurysm. Eur Neurol. 47(1): 37–44.
- 24. Tham W, Auchus AP, Thong M, Goh ML, Chang HM, et al. (2002) Progression of cognitive impairment after stroke: one year results from a longitudinal study of Singaporean stroke patients. J Neurol Sci. 203–204: 49–52.
- 25. Scott RB, Eccles F, Molyneux AJ, Kerr RS, Rothwell PM, et al. (2010) Improved cognitive outcomes with endovascular coiling of ruptured intracranial aneurysms: Neuropsychological outcomes from the International Subarachnoid Aneurysm Trial. Stroke. 41: 1743–1747.
- 26. DeLong ER, DeLong DM, Clarke-Pearson DL (1988) Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics. 44: 837–845.
- 27. Fluss R, Faraggi D, Reiser B (2005) Estimation of the Youden Index and its associated cutoff point. Biom J. 47: 458–472.
- 28. Youden WJ (1950) Index for rating diagnostic tests. Cancer. 3: 32–35.
- 29.
Tsai CF, Lee WJ, Wang SJ, Shia BC, Nasreddine Z, et al.. (2011) Psychometrics of the Montreal Cognitive Assessment (MoCA) and its subscale validation of the Taiwanese version of the MoCA and an item response theory analysis. Int Psychogeriatr. 2011 Dec 12: 1–8 [Epub ahead of print].
- 30. Passier PE, Visser-Meily JM, van Zandovoort MJ, Rinkel GJ, Lindeman E, et al. (2012) Predictors of long-term health-related quality of life in patients with aneurysmal subarachnoid hemorrhage. Neurorehabilitation. 2012 30: 137–145.
- 31. Cumming TB, Bernhardt J, Linden T (2011) The Montreal Cognitive Assessment. Short cognitive evaluation in a large stroke trial. Stroke. 42: 2642–2644.
- 32. Scott RB, Eccles F, Lloyd A, Carpenter K (2008) From multidimensional neuropsychological outcomes to a cognitive complication rate: the International Aneurysm Trial. Trials. 9: 13.