Skip to main content
Download PDF

Effectiveness and costs of phototest in dementia and cognitive impairment screening

BMC Neurology volume 11, Article number: 92 (2011) Cite this article

Abstract

Background

To assess and compare the effectiveness and costs of Phototest, Mini Mental State Examination (MMSE), and Memory Impairment Screen (MIS) to screen for dementia (DEM) and cognitive impairment (CI).

Methods

A phase III study was conducted over one year in consecutive patients with suspicion of CI or DEM at four Primary Care (PC) centers. After undergoing all screening tests at the PC center, participants were extensively evaluated by researchers blinded to screening test results in a Cognitive-Behavioral Neurology Unit (CBNU). The gold standard diagnosis was established by consensus of expert neurologists. Effectiveness was assessed by the proportion of correct diagnoses (diagnostic accuracy [DA]) and by the kappa index of concordance between test results and gold standard diagnoses. Costs were based on public prices and hospital accounts.

Results

The study included 140 subjects (48 with DEM, 37 with CI without DEM, and 55 without CI). The MIS could not be applied to 23 illiterate subjects (16.4%). For DEM, the maximum effectiveness of the MMSE was obtained with different cutoff points as a function of educational level [k = 0.31 (95% Confidence interval [95%CI], 0.19-0.43), DA = 0.60 (95%CI, 0.52-0.68)], and that of the MIS with a cutoff of 3/4 [k = 0.63 (95%CI, 0.48-0.78), DA = 0.83 (95%CI, 0.80-0.92)]. Effectiveness of the Phototest [k = 0.71 (95%CI, 0.59-0.83), DA = 0.87 (95%CI, 0.80-0.92)] was similar to that of the MIS and higher than that of the MMSE. Costs were higher with MMSE (275.9 ± 193.3€ [mean ± sd euros]) than with Phototest (208.2 ± 196.8€) or MIS (201.3 ± 193.4€), whose costs did not significantly differ. For CI, the effectiveness did not significantly differ between MIS [k = 0.59 (95%CI, 0.45-0.74), DA = 0.79 (95%CI, 0.64-0.97)] and Phototest [k = 0.58 (95%CI, 0.45-0.74), DA = 0.78 (95%CI, 0.64-0.95)] and was lowest for the MMSE [k = 0.27 (95%CI, 0.09-0.45), DA = 0.69 (95%CI, 0.56-0.84)]. Costs were higher for MMSE (393.4 ± 121.8€) than for Phototest (287.0 ± 197.4€) or MIS (300.1 ± 165.6€), whose costs did not significantly differ.

Conclusion

MMSE is not an effective instrument in our setting. For both DEM and CI, the Phototest and MIS are more effective and less costly, with no difference between them. However, MIS could not be applied to the appreciable percentage of our population who were illiterate.

Peer Review reports

Background

There is currently no evidence to support screening for cognitive impairment (CI) or dementia (DEM) in asymptomatic subjects. However, most clinical practice guidelines recommend maintaining an alert attitude and using screening tests in suspected cases for the early identification of these patients in primary care (PC) [1–3].

Short cognitive tests are considered more appropriate screening instruments for CI and DEM [4]. The Mini Mental State Examination (MMSE) [5] is the most widely used but has various drawbacks [4, 5], being long and complex and requiring the ability to read and perform tasks with paper and pencil. Other shortcomings include: non-normal distribution of results, ceiling effect, high influence of socio-educational variables, and modest reliability [6] and validity, especially for CI [7]. These limitations have greater impact in populations with a low educational level, for which its use has been contraindicated by many authors [8, 9]. The absence of a standardized version is an additional problem in Spain, where there are multiple versions that differ in words to be recalled, sentences to be repeated, drawings to be copied, and the order of items [10]. The lack of consensus on cutoff points led some authors [11] to recommend different cutoff scores as a function of literacy and educational level (17/18 for illiterates, 20/21 for individuals without completed primary schooling; 23/24 for individuals with primary schooling or higher), while the NORMACODEM group [12] proposed applying a single cutoff value of 24/25 points and correcting the score according to age and educational level. A further limitation of the MMSE in our setting is that it has not been studied in Spain for CI. Despite these drawbacks, MMSE remains the most widely accepted reference test and has even been used to regulate treatment with anticholinesterases.

Various instruments have been developed to overcome the limitations of the MMSE, reducing the complexity, application time, and influence of socio-educational variables and improving the performance for CI. Instruments recommended for use in PC [5, 13, 14] include the General Practitioner Assessment of Cognition (GPCOG) [15], Mini-Cog [16], and Memory Impairment Screen (MIS) [17]. Mini-Cog and GPCOG have not been validated in Spain and are not suitable for use in people with a low educational level because they require the use of paper and pencil. There have been three studies in Spain on the MIS [18–20], which evaluates free recall of 4-word and recall facilitated by semantic cues and includes a distracting task during the 2-minute interval between reading and recall. The MIS requires the ability to read and cannot be applied to illiterates. All three Spanish studies were conducted in hospital populations, except for a wide convenience sample of volunteers that served as controls in one study [20]. There was no consensus on cutoff values, with the first two studies recommending a cutoff score of 4/5 for DEM [19, 20] but the third recommending 3/4 for DEM and 4/5 for CI [18].

The Phototest (Additional File 1, http://www.fototest.es) [21, 22] is a very simple and short instrument (< 3 minutes) that can be applied to illiterates and assesses multiple cognitive fields (language, executive function, episodic memory). It comprises three parts: a naming task with six color photographs of common objects in prototypic position (Figure 1); a verbal fluency test (names of people) demonstrated to be uninfluenced by educational level [23], and, finally, free recall and recall facilitated by cues using the 6 objects in the naming test. There are 2 parallel versions of the test. Version A is usually applied in Spain, but version B (Additional File 2) is more suitable in English-speaking countries because the first two objects in version A are virtually homophonous in English (cards, car). Phototest results are normally distributed and are not influenced by educational level [24]. It has shown good test-retest and interobserver reliability [24], and various studies have reported that cutoff scores of 26/27 and 28/29 points give adequate discriminative validity for DEM and CI, respectively [22, 25, 26].

Figure 1
figure 1

Phototest laminated sheet (version A).

Full size image

The objective of this study was to assess the effectiveness and associated costs of utilizing the Phototest, MMSE, and MIS as screening tests for DEM and CI in PC.

Methods

Design

Phase III study of diagnostic test assessment [27] with a paired design (all screening tests were applied to all subjects), with complete verification (all subjects underwent the standard diagnostic procedure) [28].

Setting

Four PC centers in the Metropolitan District of North Granada Area (Southern Spain).

Study population

Consecutive patients attended in PC from February 1 2008 to January 31 2009 who aroused suspicion of CI or DEM.

Inclusion criteria

Inclusion criteria were: suspicion of CI or DEM, based on subjective complaints of memory loss or cognitive alteration, similar complaints made by a relative or informer, or observation by physicians of suspicious signs or symptoms. Exclusion criteria were previous enrolment in this study or previous diagnosis of CI or DEM. There were no age limits, and sensory or motor deficits or other previous conditions were not reasons for exclusion.

Procedure

All three screening tests were applied in a balanced manner to all participants. Regardless of their test results, all subsequently visited the Cognitive Behavioral Neurology Unit (CBNU) of the Neurology Department of Virgen de las Nieves University Hospital, Granada for behavioral tests (Spanish adaptation of the NPI [29]), functional tests (Barthel index [30], Lawton-Brody scale [31], and Pfeffer's FAQ [32]), and a detailed neuropsychological examination (orientation, executive attention/function [digit span, similarities, verbal fluency], verbal memory [word list], language [abbreviated Boston naming test [33], comprehension of instructions, semantic verbal fluency], visual-spatial functions [drawing, copying], calculation, and motor praxis). All of these tests were conducted by researchers (SLA, MEG) blinded to the PC results. None of the screening tests applied in PC were administered in the CBNU evaluation. The maximum time interval between assessments in the PC center and CBNU was two weeks. Two expert neurologists in cognitive-behavioral neurology (CCP, BME) provided the gold standard diagnosis by consensus, based on the CBNU evaluations and a detailed clinical assessment; they classified subjects as: Non-CI (NoCI), CI non-DEM (CInD) (criteria for mild cognitive impairment of the Spanish Neurology Society Neurology and Behavior Study Group [34]), or DEM (DSM-IVR criteria [35]); any lack of consensus was resolved by the decision of a third neurologist (RVC). All three experts were blinded to the PC screening test results.

Statistical analysis

The effectiveness of the screening tests was assessed by establishing the Sensitivity (Sn) and Specificity (Sp), diagnostic accuracy (DA = proportion of correct diagnoses), and the kappa index of diagnostic concordance between the screening test result, considering recommended cutoff points, and the gold standard diagnosis [36]. Effectiveness was calculated for DEM versus non-DEM (NoCI + CInD) and for CI (DEM + CInD) versus NoCI. MMSE results for DEM diagnosis were independently assessed following the recommendations of Escribano-Aparicio et al [11] and the NORMACODEM study [12], separately analyzing crude scores and scores corrected by age and educational level. Because there are no formal recommendations for CI diagnosis, we applied the 26/27 cutoff point used in a recent Spanish study [37]. MIS results were analyzed using two different cutoff points for DEM, 3/4 [18] and 4/5 [19, 20], and a single cutoff score of 4/5 for CI [18]. Phototest results were analyzed using a cutoff value of 26/27 for DEM and 28/29 for CI [22].

The cost analysis was based on the perspective of our healthcare organization and took no account of the direct costs of patients/carers, indirect or intangible costs, or of the effects of diagnostic delay or false negatives (FNs). For each test, we considered the minimum costs required to reach the correct diagnosis for each condition. Hence, true negatives (TNs) only incurred the cost of the PC consultation, whereas true positives (TPs) and false positives (FPs) also incurred the costs of the CBNU study (professionals [neurologist, neuropsychologist, nurse] and of the minimum complementary tests recommended by the Spanish Neurology Society [analytical, cranial CT-scan]), and FNs required at least two PC consultations plus the CBNU evaluation. The cost of the PC consultation was taken from published rates and prices of the Andalusian public healthcare system (Order of October 14 2005). The costs of examinations in the CBNU were based on the hospital's financial accounts (Table 1). Calculations were performed for each instrument on the minimum cost for the whole sample, cost per correct diagnosis, and average cost per subject.

Table 1 Minimum costs of diagnostic study
Full size table

SPSS version 15.0 (SPSS Inc., Chicago, IL) was used for the data analyses, comparing qualitative variables with the chi-square test or comparison of proportions and quantitative variables with an ANOVA, applying the Bonferroni test in post-hoc analysis. Effectiveness was compared among instruments by using the McNemar test for related samples, and costs were compared with a t-test for related samples. P < 0.05 was considered significant, and 95% confidence intervals were calculated for all study variables.

Formal aspects

The study was approved by the Ethics and Research Committee of the Virgen de las Nieves University Hospital, and written informed consent was obtained from all participants. The study design and report writing complied with the STARD recommendations for diagnostic test studies [38] and the recommendations of the Food and Drug Administration for reporting diagnostic study results [36].

Results

Sample characteristics

The four PC centers in the study serve a population of 66,713 people, of whom around 16.7% are ≥65 years old [39]. During the study period, PC physicians reported suspicion of CI or DEM in 156 patients, due to subjective complaints in 70 cases (44.9%), third-party complaints in 76 (48.7%), and initial detection by the physicians themselves in 10 (6.4%) cases. Out of the 156 patients enrolled in the study, 16 were excluded: 3 did not give consent and 2 withdrew during the study; 4 were lost to the follow-up; and 5 were not fully evaluated, due to sequelae of stroke or traumatic brain injury and/or sensory impairment (amaurosis, anacusis), a protocol violation, and a recording error. Out of the 140 patients completing the study, 48 (34.3%) had DEM, 37 (26.4%) CInD, while 55 (39.3%) had neither CI nor DEM (NoCI) (Figure 2).

Figure 2
figure 2

Flow diagram of study participants. PC: Primary Care; CBNU: Cognitive Behavioral Neurology Unit; DEM: Dementia; CInD: Cognitive impairment without dementia; NoCI: No cognitive impairment.

Full size image

Table 2 shows the socio-demographic characteristics and screening test results of the participants, stratified by cognitive diagnosis. Stratifications by "age" and "years of education" were done for score corrections according to NORMACODEM recommendations [12], and "educational level" categories were those used by Escribano-Aparicio et al [11] to define different recommended cutoff points.

Table 2 Socio-demographic characteristics and screening test results by diagnostic group
Full size table

The age of the study sample was 72.5 ± 11.3 yrs (mean ± sd), and 72.1% were female; 20 (14.3%) were illiterate and 52 (37.1%) had not completed primary schooling. There was no significant gender difference among diagnostic groups, but subjects with DEM were older and had a lower educational level than those with CInD or NoCI (p < 0.0001 for all comparisons). The groups significantly differed in test results in the order NoCI > CInD > DEM (p < 0.0001 for all comparisons) with the exception of the corrected MMSE score, in which the difference between NoCI and CInD groups did not reach significance (p = 0.08).

Effectiveness and cost for DEM

For DEM (Table 3), the diagnostic concordance and accuracy of MMSE were low (k = 0.30 [95% Confidence Interval (95%CI), 0.16 to 0.44]; DA = 0.59 [95%CI, 0.46 to 0.73]) when NORMACODEM study criteria were used [12]) and were not improved when scores were corrected by age and educational level (k = 0.29 [95%CI, 0.15 to 0.43]; DA = 0.58 [95%CI, 0.46 to 0.72]). The diagnostic concordance and accuracy were improved but remained moderate (k = 0.50 [95%CI, 0.36 to 0.64]; DA = 0.74 [95%CI, 0.60 to 0.89]) when the recommendations of Escribano-Aparicio et al [11] for populations with low educational level were followed.

Table 3 Effectiveness and cost of the screening tests for dementia
Full size table

MIS could not be applied to 23 subjects (16.4% of the sample), due to illiteracy (20) or minimum reading capacity associated with visual deficit (3). Among the 117 tested with MIS, a good diagnostic concordance (k = 0.63 [95%CI, 0.48 to 0.78]; DA = 0.83 [95%CI, 0.67 to 1.0]) was obtained with a DEM cutoff score of 3/4, non-significantly better than the concordance obtained with a cutoff of 4/5 (k = 0.54 [95%CI, 0.38 to 0.69]; DA = 0.78 [95%CI, 0.73 to 1.0]); the result was superior with either cutoff score to any of the results obtained with MMSE. The diagnostic concordance of Phototest was substantial (k = 0.70 [95%CI, 0.57 to 0.83]; DA = 0.86 [95%CI, 0.72 to 1.00]), did not significantly differ from that of MIS, and was significantly superior to that of MMSE.

Sn and Sp values of Phototest (Sn = 0.81 [95%CI, 0.67 to 0.91], Sp = 0.89 [95%CI, 0.81 to 0.95]) did not significantly differ from those of MIS with the cutoff point of 3/4 (Sn = 0.93 [95%CI, 0.78 to 0.99], χ2 = 1.78, ns; Sp = 0.80 [95%CI, 0.71 to 0.88, χ2 = 2.11, ns]) but differed from those of MMSE (Sn = 0.96 [95%CI, 0.86 to 0.99], χ2 = 4.0, p < 0.05; Sp = 0.62 [95%CI, 0.51 to 0.72], χ2 = 15.6, p < 0.001) (Table 4).

Table 4 Comparison of the effectiveness of screening tests for dementia, considering the most favorable MMSE and MIS approaches
Full size table

The mean cost of applying Phototest (208.2 ± 196.8 €) did not significantly differ from that of the optimal MIS approach (201.3 ± 193.4 €, t = 1.58, ns) but was significantly lower versus the optimal MMSE approach (275.9 ± 193.3 €, t = 4.2, p < 0.05), as depicted in Figure 3.

Figure 3
figure 3

Cost per correct diagnosis for dementia. MMSE: MiniMental State Examination. MMSEc: MMSE with corrected scores. MIS: Memory Impairment Screen. CD: correct diagnoses. *Cutoff points: 17/18: illiterates; 20/21: literate but did not complete primary schooling; 23/24: primary schooling or higher #Results for the 117 subjects who completed the MIS

Full size image

Effectiveness and cost in CI

For all instruments, the predictive validity was lower for CI than for DEM (Table 5). No difference was found between results obtained with MIS (k = 0.59 [95%CI, 0.45 to 0.74]; DA = 0.79 [95%CI, 0.64 to 0.97]) and Phototest (k = 0.58 [95%CI, 0.45 to 0.74]; DA = 0.78 [95%CI, 0.64 to 0.95]), and both results were significantly higher versus MMSE, using both crude scores (k = 0.24 [95%CI, 0.06 to 0.43]; DA = 0.69 [95%CI, 0.55 to 0.84]) and scores corrected by age and educational level (k = 0.27 [95%CI, 0.09 to 0.45]; DA = 0.69 [95%CI, 0.56 to 0.84]), which did not significantly differ between them.

Table 5 Effectiveness and cost of screening tests for cognitive impairment
Full size table

Sn and Sp values did not significantly differ between MIS (S = 0.73 [95%CI, 0.61 to 0.94]; Sp = 0.87 [95%CI, 0.75 to 0.94]) and Phototest (S = 0.69 [95%CI, 0.58 to 0.79], χ2 = 1.23, ns; Sp = 0.93 [95%CI, 0.82 to 0.98], χ2 = 0.31, ns) and were significantly lower for MMSE (Table 6).

Table 6 Comparison of the effectiveness of screening tests for cognitive impairment (most favorable alternatives for MMSE and MIS)
Full size table

The mean cost of MMSE (398.7 ± 114.2 €) was significantly higher than the cost of MIS (287.0 ± 197.4 €; t = 6.01, p < 0.0001) and Phototest (300.1 ± 195.6 €; t = 6.26, p < 0.0001), which did not significantly differ between them (t = 0.47, ns), as depicted in Figure 4.

Figure 4
figure 4

Cost per correct diagnosis for cognitive impairment. MMSE: MiniMental State Examination. MMSEc: MMSE with corrected scores. MIS: Memory Impairment Screen. CD: correct diagnosis. *Cutoff points: 17/18: illiterates; 20/21: literate but did not complete primary schooling; 23/24: primary schooling or higher. #Results for the 117 subjects who completed the MIS

Full size image

Discussion

This study of CI and DEM screening test assessment in an urban population with a low educational level shows that MMSE is not very useful for DEM screening, despite its widespread utilization. Its results were improved by adopting the correction criteria proposed by Escribano-Aparicio et al for populations with low educational level, but they remained significantly inferior to those obtained with Phototest and MIS.

Phototest, a short instrument that is rapid and easy to use, showed a substantial diagnostic concordance for DEM, correctly classifying 86% of the study sample, similar to the percentage obtained using MIS with a cutoff score of 3/4. However, unlike Phototest, MIS requires reading ability and could not be applied to an appreciable proportion of our study population (16.4%).

Although all instruments were significantly less useful for CI than for DEM, Phototest correctly classified 78% of patients as CI or non-CI, a similar percentage to that obtained with MIS. MMSE was the least useful instrument to screen for CI.

To our knowledge, this is the first study of CI and DEM screening tests to evaluate the costs associated with utilization of the test instruments. MMSE was associated with significantly higher costs for both DEM and CI, with no significant difference in the costs of Phototest and MIS. Considering the whole study sample, there was a difference between Phototest and the optimal MMSE approach of 13,807.3 € for CI screening and 9,468 € for DEM. Extrapolation of this difference to the whole population served by the unit (i.e., around 500,000 versus 66,713 subjects) indicates that the use of Phototest instead of MMSE would yield savings of around 70,000-135,000 € per year at present prices. Although the present study is not strictly a cost-effectiveness analysis [40], it can be concluded from our data on effectiveness and costs that Phototest is the best option for CI and DEM screening, offering higher effectiveness at lower cost in comparison to MMSE and allowing the assessments of all subjects, unlike MIS. This is valuable information for the efficient allocation of resources when these are limited [41].

The fact that MIS cannot be used with illiterates may appear irrelevant given the tendency to an improvement in educational level and the aim of universal literacy [42]. However, illiteracy remains a worldwide problem, with over 750 million illiterates in 2010 [43], and it is not limited to underdeveloped countries, affecting 3% of adults in the USA. i.e., around 7 million people [44]. Account must also be taken of the increasing frequency of "relative illiteracy" derived from emigration and tourism [45], resulting in large numbers of people who are literate in their mother tongue and can express themselves verbally in the language of their country of residence but have inadequate reading skills in the new language for assessment with instruments that require this ability. This situation is considered to affect 2% of adults in the USA, i.e., around four million people [44]. In short, instruments that do not require reading skills remain necessary to assess the whole population.

The main strengths of this study are the prospective, consecutive, and systematic nature of the recruitment, the long study period, the virtual absence of exclusion criteria, and the low loss index. As a result, the study sample is a faithful reflection of the diagnostic challenges faced under routine clinical conditions in this field of care, making the study naturalistic and pragmatic and allowing robust results that can be considered effectiveness rather than efficacy estimators. Furthermore, the main biases in diagnostic test assessment studies [46] were avoided by the fact that all subjects underwent all screening tests, all received a gold standard diagnosis, regardless of their screening test results, and the screening test results and gold standard diagnoses were all evaluated in a blinded and independent manner.

One study limitation is that it may not be possible to extrapolate the results, especially those for the MMSE, to more educated populations. The low specificity of MMSE was undoubtedly due to the low educational level of our sample. This shortcoming is avoided by the Phototest, whose results are not affected by educational level [24]. The present results for the overall usefulness of the Phototest are virtually identical to those obtained in a previous multicenter study (FOTOTRANS study) conducted under routine clinical conditions, which used the same cutoff points and found a sensitivity of 0.88 and specificity of 0.87 for DEM, and sensitivity of 0.68 and specificity of 0.89 for CI [25, 26]. In the FOTOTRANS study, the diagnostic accuracy of the Phototest was similar to that of the Eurotest [47], another valid and reliable cognitive test applicable to illiterates and developed by our group [48, 49]. However, the Eurotest requires 7 minutes to complete and is therefore less useful in PC, in which time constraints are crucial [50].

The present results found for MIS with a cutoff point of 3/4 are also very similar to the findings by Perez-Martinez et al in a prospective clinical sample with low educational level (Sn = 0.93, Sp = 0.73) [18] but differ from those reported in two other studies (Sn = 0.74, Sp = 0.96, and Sn = 0.84, Sp = 0.94, respectively) [19, 20]. In these two studies, the specificity was higher than the sensitivity, possibly because of the different cutoff point used (4/5), the cross-sectional design of the studies, and the higher overall educational level of the samples, which did not include subjects with CI, facilitating the discrimination between DEM and non-DEM and therefore overestimating the diagnostic usefulness.

Although our sample size may appear to be a limitation, it allowed the precise estimation of proportions (6-8%). Furthermore, the use of a one-year recruitment period allowed seasonal biases to be avoided and ensured greater sample representativeness.

Finally, our economic analysis was simplistic and basic and cannot strictly be considered a cost-effectiveness study [40]. Nevertheless, our approach to minimum costing was real and pragmatic and allowed differential costs to be established among the different screening test options. Our data should facilitate decision-making to improve the assignment of resources. In this regard, our results suggest that MMSE is not suitable for use in our setting and that MIS and Phototest are preferable due to their lower cost and higher effectiveness. The Phototest can be especially recommended because, unlike the MIS, it can be completed by all subjects, including the illiterate.

Conclusions

In this prospective phase III study of diagnostic test assessment in a population with low educational level, we assessed, in a blinded and independent manner, the effectiveness and cost of CI and DEM screening using three tests: MMSE and MIS, the most widely used tests in PC, and Phototest, a short, easily applied test that can be used in illiterates and whose results are not influenced by educational level. MMSE proved to be the least effective and most expensive option, with a low diagnostic usefulness. The effectiveness of MIS and Phototest was substantially higher than that of MMSE, and their associated costs were lower. However, MIS could not be applied to illiterates, whereas Phototest could be used with the whole sample. The application in PC of Phototest rather than MMSE to screen for CI and DEM in our setting would improve the effectiveness of the screening, reduce the workload of healthcare professionals, and lower the associated costs, permitting a better distribution of resources.

References

  1. Petersen RC, Stevens JC, Ganguli M, Tangalos EG, Cummings JL, DeKosky ST: Practice parameter: early detection of dementia: mild cognitive impairment (an evidence-based review). Report of the Quality Standards Subcommittee of the American Academy of Neurology. Neurology. 2001, 56 (9): 1133-1142.

    Article  CAS  PubMed  Google Scholar 

  2. Boustani M, Peterson B, Hanson L, Harris R, Lohr KN: Screening for dementia in primary care: a summary of the evidence for the U.S. Preventive Services Task Force. Annals of internal medicine. 2003, 138 (11): 927-937.

    Article  PubMed  Google Scholar 

  3. National Collaboration Centre for Mental Health: Dementia. A NICE-SCIE Guideline on supporting people with dementia and their carers in health and social care. National Clinical Practice Guideline Number 42. 2007, The British Psychological Society & The Royal College of Psychiatrists

    Google Scholar 

  4. Carnero Pardo C: Test de screening en demencia. Neurología conductual: fundamentos teoricos y practicos. Edited by: Manubens Bertran J, Berthier Torres M, Barquero Jiménez S. 2002, Barcelona: Pulso Ediciones SL

    Google Scholar 

  5. Ismail Z, Rajji TK, Shulman KI: Brief cognitive screening instruments: an update. Int J Geriatr Psychiatry. 2010, 25 (2): 111-120. 10.1002/gps.2306.

    Article  PubMed  Google Scholar 

  6. Hensel A, Angermeyer MC, Riedel-Heller SG: Measuring cognitive change in older adults: reliable change indices for the Mini-Mental State Examination. J Neurol Neurosurg Psychiatry. 2007, 78 (12): 1298-1303. 10.1136/jnnp.2006.109074.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  7. Mitchell AJ: A meta-analysis of the accuracy of the mini-mental state examination in the detection of dementia and mild cognitive impairment. J Psychiatr Res. 2009, 43 (4): 411-431. 10.1016/j.jpsychires.2008.04.014.

    Article  PubMed  Google Scholar 

  8. Rosselli D, Ardila A, Pradilla G, Morillo L, Bautista L, Rey O, Camacho M: [The Mini-Mental State Examination as a selected diagnostic test for dementia: a Colombian population study. GENECO]. Revista de neurologia. 2000, 30 (5): 428-432.

    CAS  PubMed  Google Scholar 

  9. Scazufca M, Almeida OP, Vallada HP, Tasse WA, Menezes PR: Limitations of the Mini-Mental State Examination for screening dementia in a community with low socioeconomic status: results from the Sao Paulo Ageing & Health Study. Eur Arch Psychiatry Clin Neurosci. 2009, 259 (1): 8-15. 10.1007/s00406-008-0827-6.

    Article  PubMed  Google Scholar 

  10. Gimenez-Roldan S, Novillo MJ, Navarro E, Dobato JL, Gimenez-Zuccarelli M: [Mini-mental state examination: proposal of protocol to be used]. Revista de neurologia. 1997, 25 (140): 576-583.

    CAS  PubMed  Google Scholar 

  11. Escribano-Aparicio MV, Perez-Dively M, Garcia-Garcia FJ, Perez-Martin A, Romero L, Ferrer F, Martin-Correa E, Sanchez-Ayala MI: Validacion del MMSE de Folstein en una poblacion española de bajo nivel educativo. Rev Esp Geriatr Gerontol. 1999, 34: 319-326.

    Google Scholar 

  12. Blesa R, Pujol M, Aguilar M, Santacruz P, Bertran-Serra I, Hernandez G, Sol JM, Pena-Casanova J: Clinical validity of the 'mini-mental state' for Spanish speaking communities. Neuropsychologia. 2001, 39 (11): 1150-1157. 10.1016/S0028-3932(01)00055-0.

    Article  CAS  PubMed  Google Scholar 

  13. Brodaty H, Low LF, Gibson L, Burns K: What is the best dementia screening instrument for general practitioners to use?. Am J Geriatr Psychiatry. 2006, 14 (5): 391-400. 10.1097/01.JGP.0000216181.20416.b2.

    Article  PubMed  Google Scholar 

  14. Milne A, Culverwell A, Guss R, Tuppen J, Whelton R: Screening for dementia in primary care: a review of the use, efficacy and quality of measures. Int Psychogeriatr. 2008, 20 (5): 911-926.

    Article  CAS  PubMed  Google Scholar 

  15. Brodaty H, Pond D, Kemp NM, Luscombe G, Harding L, Berman K, Huppert FA: The GPCOG: a new screening test for dementia designed for general practice. J Am Geriatr Soc. 2002, 50 (3): 530-534. 10.1046/j.1532-5415.2002.50122.x.

    Article  PubMed  Google Scholar 

  16. Borson S, Scanlan J, Brush M, Vitaliano P, Dokmak A: The mini-cog: a cognitive 'vital signs' measure for dementia screening in multi-lingual elderly. Int J Geriatr Psychiatry. 2000, 15 (11): 1021-1027. 10.1002/1099-1166(200011)15:11<1021::AID-GPS234>3.0.CO;2-6.

    Article  CAS  PubMed  Google Scholar 

  17. Buschke H, Kuslansky G, Katz M, Stewart WF, Sliwinski MJ, Eckholdt HM, Lipton RB: Screening for dementia with the memory impairment screen. Neurology. 1999, 52 (2): 231-238.

    Article  CAS  PubMed  Google Scholar 

  18. Perez-Martinez DA, Baztan JJ, Gonzalez-Becerra M, Socorro A: [Evaluation of the diagnostic value of a Spanish adaptation of the Buschke Memory Impairment Screen in the detection of dementia and cognitive impairment]. Revista de neurologia. 2005, 40 (11): 644-648.

    CAS  PubMed  Google Scholar 

  19. Bohm P, Pena-Casanova J, Gramunt N, Manero RM, Terron C, Quinones-Ubeda S: [Spanish version of the Memory Impairment Screen (MIS): normative data and discriminant validity]. Neurologia. 2005, 20 (8): 402-411.

    CAS  PubMed  Google Scholar 

  20. Barrero-Hernandez FJ, Vives-Montero F, Morales-Gordo B: [Evaluation of the Spanish version of the Memory Impairment Screen]. Revista de neurologia. 2006, 43 (1): 15-19.

    CAS  PubMed  Google Scholar 

  21. Carnero-Pardo C, Montoro-Rios MT: [The photo test]. Rev Neurol. 2004, 39 (9): 801-806.

    CAS  PubMed  Google Scholar 

  22. Carnero-Pardo C, Saez-Zea C, Montiel Navarro L, Del Saz P, Feria Vilar I, Pérez Navarro MJ, Ruiz Gimenez J, Vilchez Carrillo R, Montoro Rios MT: [Diagnostic accuracy of the Phototest for cognitive impairment and dementia]. Neurologia. 2007, 22 (10): 860-869.

    CAS  PubMed  Google Scholar 

  23. Saez-Zea C, Carnero-Pardo C, Gurpegui M: [Names of persons: a verbal fluency test without socioeducational influences]. Neurologia. 2008, 23 (6): 356-360.

    CAS  PubMed  Google Scholar 

  24. Carnero-Pardo C, Saez-Zea C, Montiel-Navarro L, Feria-Vilar I, Gurpegui M: Normative and reliability study of fototest. Neurologia. 2011, 26 (1): 20-25.

    Article  CAS  PubMed  Google Scholar 

  25. Carnero-Pardo C, Saez-Zea C, de la Vega Cotarelo R, Gurpegui M, in behalf of FOTOTRANS group: Estudio Fototrans. Estudio multicentrico sobre la validez del Fototest en condiciones de practica clinica. Neurologia.

  26. Saez-Zea C: Utilidad diagnostica, fiabilidad y validez del Fototest en la deteccion de deterioro cognitivo y demencia. 2009, Doctoral thesis. Granada University, Neuroscience Institute "Federico Olóriz"

    Google Scholar 

  27. Sackett DL, Haynes RB: The architecture of diagnostic research. BMJ. 2002, 324 (7336): 539-541. 10.1136/bmj.324.7336.539.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  28. Bossuyt PM, Irwig L, Craig J, Glasziou P: Comparative accuracy: assessing new tests against existing diagnostic pathways. BMJ. 2006, 332 (7549): 1089-1092. 10.1136/bmj.332.7549.1089.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Boada M, Cejudo JC, Tarraga L, Lopez OL, Kaufer D: [Neuropsychiatric inventory questionnaire (NPI-Q): Spanish validation of an abridged form of the Neuropsychiatric Inventory (NPI)]. Neurologia. 2002, 17 (6): 317-323.

    CAS  PubMed  Google Scholar 

  30. Mahoney FI, Barthel DW: Functional Evaluation: The Barthel Index. Md State Med J. 1965, 14: 61-65.

    CAS  PubMed  Google Scholar 

  31. Lawton MP, Brody EM: Assessment of older people: self-maintaining and instrumental activities of daily living. Gerontologist. 1969, 9 (3): 179-186. 10.1093/geront/9.3_Part_1.179.

    Article  CAS  PubMed  Google Scholar 

  32. Pfeffer RI, Kurosaki TT, Harrah CH, Chance JM, Filos S: Measurement of functional activities in older adults in the community. J Gerontol. 1982, 37 (3): 323-329.

    Article  CAS  PubMed  Google Scholar 

  33. Calero MD, Arnedo ML, Navarro E, Ruiz-Pedrosa M, Carnero C: Usefulness of a 15-item version of the Boston Naming Test in neuropsychological assessment of low-educational elders with dementia. J Gerontol B Psychol Sci Soc Sci. 2002, 57 (2): P187-191.

    Article  PubMed  Google Scholar 

  34. Robles A, Del Ser T, Alom J, Pena-Casanova J: [Proposal of criteria for clinical diagnosis of mild cognitive impairment, dementia and Alzheimer's disease]. Neurologia. 2002, 17 (1): 17-32.

    CAS  PubMed  Google Scholar 

  35. American Psychiatric Association: Diagnostic and Statistical Manual of Mental Disorders (4th ed., text revision) DSM-IV-TR. 2000, Washington DC: American Psychiatric Association

    Google Scholar 

  36. Statistical guidance on reporting results from studies evaluating diagnostic test. 2003, U. S. Department of Health and Human Services, Food and Drug Administration, Center for Devices and Radiological Health, Diagnostic Devices Branch, Division of Bioestatistic, Office of Surveillance and Biometrics

  37. Rami L, Bosch B, Valls-Pedret C, Caprile C, Sanchez-Valle Diaz R, Molinuevo JL: [Discriminatory validity and association of the mini-mental test (MMSE) and the memory alteration test (M@T) with a neuropsychological battery in patients with amnestic mild cognitive impairment and Alzheimer's disease]. Revista de neurologia. 2009, 49 (4): 169-174.

    CAS  PubMed  Google Scholar 

  38. Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig LM, Lijmer JG, Moher D, Rennie D, de Vet HC: Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative. BMJ. 2003, 326 (7379): 41-44. 10.1136/bmj.326.7379.41.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Censo de Poblacion. 2001, Instituto de Estadistica de Andalucia: Consejeria de Economia, Innovacion y Ciencia

  40. Gold MR, Siegel JE, Russell LB, Weinstein MC: Cost-effectiveness in health and medicine. 1996, New York: Oxford University Press

    Google Scholar 

  41. Oliver A, Healey A, Donaldson C: Choosing the method to match the perspective: economic assessment and its implications for health-services efficiency. The Lancet. 2002, 359 (9319): 1771-1774. 10.1016/S0140-6736(02)08664-6.

    Article  Google Scholar 

  42. EPT report team: The Dakar framework for action. Education for all: meeting our collective commitments. 2000, UNESCO

    Google Scholar 

  43. EPT monitoring report team: Report 2010. Reaching the marginalized. Education for all global monitoring report. 2010, Paris: UNESCO

    Google Scholar 

  44. Kutner M, Greenberg E, Jin Y, Boyle B, Hsu Y, Dunleavy E: Literacy in Every Life: Results from the 2003 National Assessment of adult literacy (NCES 2007-480). 2007, U.S. Department of Education. Washington, DC: National Center for Education Statistic

    Google Scholar 

  45. Carnero Pardo C: Analfabetismo, bajo nivel educativo y muestras normativas para pruebas neuropsicologicas. Neurologia. 2005, 20 (1): 49-

    CAS  PubMed  Google Scholar 

  46. Whiting P, Rutjes AW, Reitsma JB, Bossuyt PM, Kleijnen J: The development of QUADAS: a tool for the quality assessment of studies of diagnostic accuracy included in systematic reviews. BMC Med Res Methodol. 2003, 3: 25-10.1186/1471-2288-3-25.

    Article  PubMed  PubMed Central  Google Scholar 

  47. Carnero-Pardo C, Montoro-Rios MT: [Preliminary evaluation of a new screening test for dementia (Eurotest)]. Revista de neurologia. 2004, 38 (3): 201-209.

    CAS  PubMed  Google Scholar 

  48. Carnero-Pardo C, Gurpegui M, Sanchez-Cantalejo E, Frank A, Mola S, Barquero MS, Montoro-Rios MT: Diagnostic accuracy of the Eurotest for dementia: a naturalistic, multicenter phase II study. BMC neurology. 2006, 6: 15-10.1186/1471-2377-6-15.

    Article  PubMed  PubMed Central  Google Scholar 

  49. Carnero-Pardo C, Gurpegui M, Sanchez-Cantalejo E, Gomez-Camello A, Guardado-Santervas P, Montoro- Rios MT: [Reliability assessment of the EUROTEST]. Neurologia. 2007, 22 (3): 153-158.

    CAS  PubMed  Google Scholar 

  50. Deveugele M, Derese A, van den Brink-Muinen A, Bensing J, De Maeseneer J: Consultation length in general practice: cross sectional study in six European countries. BMJ. 2002, 325 (7362): 472-10.1136/bmj.325.7362.472.

    Article  PubMed  PubMed Central  Google Scholar 

Pre-publication history

Download references

Acknowledgements

The study was funded by the Agencia de Evaluacion de Tecnologias Sanitarias, Instituto de Salud Carlos III (Expdte PI06/90034). The funding source had no role in the study design, data collection, analysis, or interpretation or in the writing of the report.

The authors are grateful to F. Padilla Ruiz, S. Cárdenas Viedma, M. Melguizo Jimenez, and M. Alonso Rodenas, directors of the participating centers, and all primary care professionals involved in the study. The authors also thank R. de la Vega Cotarelo for reviewing the manuscript and contributing invaluable advice and R. Davies for editorial assistance, including the translation.

Author information

Authors and Affiliations

  1. Cognitive Behavioral Neurology Unit, Service of Neurology, Virgen de las Nieves University Hospital, Carretera de Jaen s/n, 18013, Granada, Spain

    Cristobal Carnero-Pardo, Samuel Lopez-Alcalde, Maria Espinosa-Garcia, Carmen Saez-Zea & Rosa Vilchez-Carrillo

  2. FIDYAN Neurocenter, Mozart s/n, Edf. Zafiro, 18004, Granada, Spain

    Cristobal Carnero-Pardo & Maria Espinosa-Garcia

  3. Service of Neurology, La Mancha Center Hospital Complex, Alcazar de San Juan, 13600, Ciudad Real, Spain

    Beatriz Espejo-Martinez

  4. Departament of Psychobiology, School of Psychology, University of Jaen, Campus Las Lagunillas s/n, 23071, Jaen, Spain

    Carmen Saez-Zea

  5. Management Control Section, Virgen de las Nieves University Hospital, Carretera de Jaen s/n, 18013, Granada, Spain

    Elisa Hernandez-Torres & Jose L Navarro-Espigares

Authors
  1. Cristobal Carnero-Pardo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Beatriz Espejo-Martinez
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Samuel Lopez-Alcalde
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Maria Espinosa-Garcia
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Carmen Saez-Zea
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Rosa Vilchez-Carrillo
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Elisa Hernandez-Torres
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Jose L Navarro-Espigares
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Cristobal Carnero-Pardo.

Additional information

Competing interests

C. Carnero-Pardo is the creator of the Phototest and Eurotest.

Authors' contributions

CCP formulated the study design, led the data collection, carried out the analyses, interpreted the results, and wrote the first draft of the manuscript. EHT and JLNE discussed the study design, calculated costs, assisted with the data analyses and results interpretation. BEM, SLA, MEG, CSZ, and RVC discussed the study design, collected data and commented on results. All authors read and approved the final manuscript.

Electronic supplementary material

Additional file 1: Phototest. Form with instructions for the application and correction of the Phototest. (PDF 12 KB)

12883_2011_495_MOESM2_ESM.JPEG

Additional file 2: Phototest laminated sheet (version B). Laminated sheet with stimulus images in the version for English-speaking countries. (JPEG 46 KB)

Authors’ original submitted files for images

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Carnero-Pardo, C., Espejo-Martinez, B., Lopez-Alcalde, S. et al. Effectiveness and costs of phototest in dementia and cognitive impairment screening. BMC Neurol 11, 92 (2011). https://doi.org/10.1186/1471-2377-11-92

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1471-2377-11-92

Keywords

BMC Neurology

ISSN: 1471-2377

Contact us