Abstract
The Conners’ Continuous Performance Test – Second Edition (CPT-II) has demonstrated utility as a performance validity test (PVT). Early research also identified several benefits of repeat administration. This study was designed to evaluate the potential of repeat administrations of the CPT-II to enhance its clinical utility in detecting ADHD or non-credible responding. Data were collected from a consecutive case sequence of 100 patients (MAge = 41.5; MEducation = 13.8) referred for neuropsychological assessment. Performance validity was psychometrically defined using a combination of free-standing and embedded PVTs. The CPT-II was administered twice to all patients: once in the morning and once at the end of the testing appointment. Data supported previously identified validity cutoffs for the CPT-II, with the notable exception of Commission errors. Patients with ADHD were less likely to fail validity cutoffs than those without ADHD, suggesting that ADHD alone does not explain failure on PVTs. At Time 1, the CPT-II was insensitive to a clinical diagnosis of ADHD; at Time 2, only one significant contrast emerged. Self-report measures more effectively differentiated between patients with and without ADHD. Test-retest reliability was generally higher in patients with valid performance (0.33-0.83) compared to those with invalid performance (0.38-0.77), with notable variation across scales. Two sets of CPT-II scores increased confidence in the ADHD diagnosis and the remainder of the neurocognitive profile. The CPT-II is self-administered and automatically scored, making routine double administration more practical than might first be thought.
Similar content being viewed by others
References
Abeare, C., Messa, I., Whitfield, C., Zuccato, B., Casey, J., & Erdodi, L. (2019). Performance validity in collegiate football athletes at baseline neurocognitive testing. Journal of Head Trauma Rehabilitation, 34(4), 20–31. https://doi.org/10.1097/HTR.0000000000000451
Abeare, K., Romero, K., Cutler, L., Sirianni, C. D., & Erdodi, L. A. (2021). Flipping the script: Measuring both performance validity and cognitive ability with the forced choice Recognition Trial of the RCFT. Perceptual and Motor Skills, 128(4), 1373–1408. https://doi.org/10.1177/00315125211019704
Armistead-Jehle, P., Cooper, D. B., & Vanderploeg, R. D. (2016). The role of performance validity tests in the assessment of cognitive functioning after military concussion: A replication and extension. Applied Neuropsychology: Adult, 23(4), 264–273. https://doi.org/10.1080/23279095.2015.1055564
Arnold, G., Boone, K. B., Lu, P., Dean, A., Wen, J., Nitch, S., & McPherson, S. (2005). Sensitivity and specificity of finger tapping test scores for the detection of suspect effort. The Clinical Neuropsychologist, 19(1), 105–120. https://doi.org/10.1080/13854040490888567
Ashendorf, L. (2019). Rey Auditory Verbal Learning Test and Rey-Osterrieth Complex figure test performance validity indices in a VA Polytrauma sample. The Clinical neuropsychologist, 33(8), 1388–1402. https://doi.org/10.1080/13854046.2018.1543454
Ashendorf, L., Clark, E. L., & Humphreys, C. T. (2021). The Rey 15-Item memory test in US veterans. Journal of Clinical and Experimental Neuropsychology, 43(3), 324–331. https://doi.org/10.1080/13803395.2021.1932761
Ashendorf, L., Clark, E. L., & Sugarman, M. A. (2017). Performance validity and processing speed in a VA Polytrauma sample. The Clinical Neuropsychologist, 31(5), 857–866. https://doi.org/10.1080/13854046.2017.1285961
Axelrod, B. N., Fichtenberg, N. L., Millis, S. R., & Wertheimer, J. C. (2006). Detecting incomplete effort with Digit Span from the Wechsler Adult Intelligence Scale-Third Edition. The Clinical Neuropsychologist, 20(3), 513–523. https://doi.org/10.1080/13854040590967117
Axelrod, B. N., Meyers, J. E., & Davis, J. J. (2014). Finger tapping test performance as a measure of performance validity. The Clinical neuropsychologist, 28(5), 876–888. https://doi.org/10.1080/13854046.2014.907583
Babikian, T., Boone, K. B., Lu, P., & Arnold, G. (2006). Sensitivity and specificity of various digit span scores in the detection of suspect effort. The Clinical Neuropsychologist, 20(1), 145–159. https://doi.org/10.1080/13854040590947362
Baggio, S., Hasler, R., Giacomini, V., El-Masri, H., Weibel, S., Perroud, N., & Deiber, M. P. (2020). Does the continuous performance test predict ADHD symptoms severity and ADHD presentation in adults? Journal of Attention Disorders, 24(6), 840–848. https://doi.org/10.1177/1087054718822060
Balint, S., Czobor, P., Komlosi, S., Meszaros, A., Simon, V., & Bitter, I. (2009). Attention deficit hyperactivity disorder (ADHD): Gender- and age-related differences in neurocogntion. Psychological Medicine, 39, 1337–1345.
Beck, A. T., & Steer, R. A. (1993). Beck anxiety Inventory Manual. San Antonio, TX: Psychological Corporation.
Beck, A. T., Steer, R. A., & Brown, G. K. (1996). Beck Depression Inventory – Second Edition. San Antonio, TX: Psychological Corporation.
Berger, C., Lev, A., Braw, Y., Elbaum, T., Wagner, M., & Rassovsky, Y. (2021). Detection of feigned ADHD using the MOXO-d-CPT. Journal of Attention Disorders, 25(7), 1032–1047. https://doi.org/10.1177/1087054719864656
Berger, I., Slobodin, O., & Cassuto, H. (2017). Usefulness and validity of continuous performance tests in the diagnosis of attention-deficit hyperactivity disorder children. Archives of Clinical Neuropsychology, 32(1), 81–93. https://doi.org/10.1093/arclin/acw101
Bigler, E. D. (2014). Effort, symptom validity testing, performance validity testing and traumatic brain injury. Brain Injury, 28(13–14), 1623–1638. https://doi.org/10.3109/02699052.2014.947627
Bigler, E. D. (2015). Neuroimaging as a biomarker in symptom validity and performance validity testing. Brain Imaging and Behavior, 9(3), 421–444. https://doi.org/10.1007/s11682-015-9409-1
Blaskewitz, N., Merten, T., & Brockhaus, R. (2009). Detection of suboptimal effort with the Rey Complex figure test and Recognition Trial. Applied Neuropsychology, 16(1), 54–61. https://doi.org/10.1080/09084280802644227
Bluschke, A., Zink, N., Mückschel, M., Roessner, V., & Beste, C. (2021). A novel approach to intra-individual performance variability in ADHD. European Child & Adolescent Psychiatry, 30(5), 733–745. https://doi.org/10.1007/s00787-020-01555-y
Boone, K. B. (2009). The need for continuous and comprehensive sampling of effort/response bias during neuropsychological examination. The Clinical Neuropsychologist, 23(4), 729–741. https://doi.org/10.1080/13854040802427803
Boone, K. B. (2013). Clinical practice of forensic neuropsychology. New York, NY: Guilford.
Boonstra, A. M., Oosterlaan, J., Sergeant, J. A., & Buitelaar, J. K. (2005). Executive functioning in adult ADHD: A meta-analytic review. Psychological Medicine, 35(8), 1097–1108. https://doi.org/10.1017/s003329170500499x
Bordoff, B. (2017). The challenges and limitations of diagnosing and pharmacologically treating ADHD in university students. Psychological Injury and Law, 10(2), 114–120.
Bortnik, K. E., & Dean, A. C. (2021). Performance validity testing in patients with dementia. In K. B. Boone (Ed.), Assessment of feigned cognitive impairment: A neuropsychological perspective (2nd ed., pp. 481–503). The Guilford Press.
Boucher, C., May, N., Shahein, A., Roth, R. M., & Erdodi, L. A. (2023). Examining the effect of repeat administration, alternate versions and performance validity on letter fluency tests in a mixed clinical sample. Psychology and neuroscience. Advance online publication.
Busse, M., & Whiteside, D. (2012). Detecting suboptimal cognitive effort: Classification accuracy of the Conner’s continuous performance Test-II, brief test of attention, and trail making test. The Clinical Neuropsychologist, 26(4), 675–687. https://doi.org/10.1080/13854046.2012.679623
Castellanos, F. X., Sonuga-Barke, E. J., Milham, M. P., & Tannock, R. (2006). Characterizing cognition in ADHD: Beyond executive dysfunction. Trends in Cognitive Sciences, 10(3), 117–123.
Chafetz, M. D. (2022). Deception is different: Negative validity test findings do not provide “evidence” for “good effort. The Clinical Neuropsychologist, 36(6), 1244–1264. https://doi.org/10.1080/13854046.2020.1840633
Conners, C. K. (2004). Conners’ continuous performance test II. Toronto, Canada: Multi-Health Systems, Inc.
Conners, C. K. (2014). Conners’ continuous performance test – 3rd Edition (CPT-3) manual. Toronto, ON: Multi-Health Systems.
Crişan, I., Sava, F. A., Maricuţoiu, L. P., Ciumăgeanu, M. D., Axinia, O., Gîrniceanu, L., & Ciotlăuş, L. (2021). Evaluation of various detection strategies in the assessment of noncredible memory performance: Results of two experimental studies. Assessment. Advance online publication. https://doi.org/10.1177/10731911211040105
Curtis, K. L., Greve, K. W., Bianchini, K. J., & Brennan, A. (2006). California Verbal Learning Test indicators of Malingered Neurocognitive Dysfunction: Sensitivity and specificity in traumatic brain injury. Assessment, 13(1), 46–61. https://doi.org/10.1177/1073191105285210
Dandachi-FitzGerald, B., Duits, A. A., Leentjens, A. F. G., Verhey, F. R. J., & Ponds, R. W. H. M. (2020a). Performance and symptom validity assessment in patients with apathy and cognitive impairment. Journal of the International Neuropsychological Society, 26, 314–321. https://doi.org/10.1017/S1355617719001139
Dandachi-FitzGerald, B., Merckelbach, H., Boskovic, I., & Jelicic, M. (2020b). Do you know people who feign? Proxy respondents about feigned symptoms. Psychological Injury and Law, 13, 225–234. https://doi.org/10.1007/s12207-020-09387-6
Davis, J. J. (2014). Further consideration of Advanced Clinical Solutions Word choice: Comparison to the Recognition Memory Test-words and classification accuracy in a clinical sample. The Clinical Neuropsychologist, 28(8), 1278–1294. https://doi.org/10.1080/13854046.2014.975844
Dean, A. C., Victor, T. L., Boone, K. B., Philpott, L. M., & Hess, R. A. (2009). Dementia and effort test performance. The Clinical Neuropsychologist, 23(1), 133–152. https://doi.org/10.1080/13854040701819050
Delis, D. C., Kaplan, E., & Kramer, J. (2001). Delis-Kaplan executive function system. San Antonio, TX: Psychological Corporation.
Delis, D. C., Kramer, J. H., Kaplan, E., & Ober, B. A. (2000). California Verbal Learning Test (2nd ed.). San Antonio, TX: Psychological Corporation.
Eglit, G., Jurick, S. M., Delis, D. C., Filoteo, J. V., Bondi, M. W., & Jak, A. J. (2020). Utility of the D-KEFS Color Word Interference Test as an embedded measure of performance validity. The Clinical Neuropsychologist, 34(2), 332–352. https://doi.org/10.1080/13854046.2019.1643923
Erdodi, L. A. (2021). Five shades of gray: Conceptual and methodological issues around multivariate models of performance validity. Neurorehabilitation, 49(2), 179–213. https://doi.org/10.3233/NRE-218020
Erdodi, L. A. (2022). Multivariate Models of Performance Validity: The Erdodi Index captures the dual nature of non-credible responding (continuous and categorical). Assessment, 10731911221101910, https://doi.org/10.1177/10731911221101910. Advance online publication.
Erdodi, L. A., & Abeare, C. A. (2020). Stronger together: The Wechsler Adult Intelligence Scale-Fourth Edition as a Multivariate Performance Validity Test in patients with traumatic brain Injury. Archives of clinical Neuropsychology, 35(2), 188–204. https://doi.org/10.1093/arclin/acz032
Erdodi, L. A., Abeare, C. A., Lichtenstein, J. D., Tyson, B. T., Kucharski, B., Zuccato, B. G., & Roth, R. M. (2017a). Wechsler Adult Intelligence Scale-Fourth Edition (WAIS-IV) processing speed scores as measures of noncredible responding: The third generation of embedded performance validity indicators. Psychological Assessment, 29(2), 148–157. 10.1037/pas0000319.
Erdodi, L. A., Kirsch, N. L., Lajiness-O’Neill, R., Vingilis, E., & Medoff, B. (2014a). Comparing the Recognition Memory Test and the Word Choice Test in a Mixed Clinical Sample: Are They Equivalent?. Psychological Injury. and Law 7, 255–263 (2014a). https://doi.org/10.1007/s12207-014-9197-8
Erdodi, L. A., & Lajiness-O’Neill, R. (2014). Time-related changes in Conners’ CPT-II scores: A replication study. Applied neuropsychology Adult, 21(1), 43–50. https://doi.org/10.1080/09084282.2012.724036
Erdodi, L. A., Lajiness-O’Neill, R., & Saules, K. K. (2010). Order of Conners’ CPT-II administration within a cognitive test battery influences ADHD indices. Journal of attention disorders, 14(1), 43–51. https://doi.org/10.1177/1087054709347199
Erdodi, L. A., & Lichtenstein, J. D. (2017). Invalid before impaired: An emerging paradox of embedded validity indicators. The Clinical Neuropsychologist, 31(6–7), 1029–1046. https://doi.org/10.1080/13854046.2017.1323119
Erdodi, L. A., & Lichtenstein, J. D. (2021). Information processing speed tests as performance validity tests. In K. B. Boone (Ed.), Assessment of feigned cognitive impairment: A neuropsychological perspective (pp. 218–247). The Guilford Press.
Erdodi, L. A., Pelletier, C. L., & Roth, R. M. (2018a). Elevations on select Conners’ CPT-II scales indicate noncredible responding in adults with traumatic brain injury. Applied Neuropsychology: Adult, 25(1), 19–28. 10.1080/23279095.2016.1232262.
Erdodi, L. A., Roth, R. M., Kirsch, N. L., Lajiness-O’Neill, R., & Medoff, B. (2014b). Aggregating validity indicators embedded in conners‘ CPT-II outperforms individual cutoffs at separating valid from invalid performance in adults with traumatic brain injury. Archives of Clinical Neuropsychology, 29(5), 456–466. 10.1093/arclin/acu02.
Erdodi, L. A., Sabelli, A. G., An, K. Y., Hastings, M., McCoy, C., & Abeare, C. A. (2020). Introducing a Five-Variable Psychiatric Screener based on the Visual Analog Scale (V-5). Psychology & Neuroscience, 13(2), 219–239. https://doi.org/10.1037/pne0000201
Erdodi, L. A., Sagar, S., Seke, K., Zuccato, B. G., Schwartz, E. S., & Roth, R. M. (2018b). The Stroop test as a measure of performance validity in adults clinically referred for neuropsychological assessment. Psychological Assessment, 30(6), 755–766. https://doi.org/10.1037/pas0000525
Erdodi, L. A., Taylor, B., Sabelli, A., Malleck, M., Kirsch, N. L., & Abeare, C. A. (2019). Demographically adjusted validity cutoffs in the finger tapping test are superior to raw score cutoffs. Psychological Injury and Law, 12(2), 113–126. https://doi.org/10.1007/s12207-019-09352-y
Erdodi, L. A., Tyson, B. T., Shahein, A. G., Lichtenstein, J. D., Abeare, C. A., Pelletier, C. L., Zuccato, B. G., Kucharski, B., & Roth, R. M. (2017b). The power of timing: Adding a time-to-completion cutoff to the Word Choice Test and Recognition Memory Test improves classification accuracy. Journal of Clinical and Experimental Neuropsychology, 39(4), 369–383. https://doi.org/10.1080/13803395.2016.1230181
Etherton, J. L., Bianchini, K. J., Heinly, M. T., & Greve, K. W. (2006). Pain, malingering, and performance on the WAIS-III Processing Speed Index. Journal of Clinical and Experimental Neuropsychology, 28, 1218–1237. https://doi.org/10.1080/13803390500346595
Frazier, T. W., Demaree, H. A., & Youngstrom, E. A. (2004). Meta-analysis of intellectual and neuropsychological test performance in attention-deficit/hyperactivity disorder. Neuropsychology, 18(3), 543–555. https://doi.org/10.1037/0894-4105.18.3.543
Gervais, R. O., Russell, A. S., Green, P., Allen, L. M., Ferrari, R., & Pieschl, S. D. (2001). Effort testing in patients with fibromyalgia and disability incentives. The Journal of Rheumatology, 28(8), 1892–1899.
Giromini, L., Young, G., & Sellbom, M. (2022). Assessing negative response bias using self-report measures: New articles, new issues. Psychological Injury and Law, 15(1), 1–21. https://doi.org/10.1007/s12207-022-09444-2
Gonzalez-Gadea, M. L., Baez, S., Torralva, T., Castellanos, F. X., Rattazzi, A., Bein, V., & Ibanez, A. (2013). Cognitive variability in adults with ADHD and AS: Disentangling the roles of executive functions and social cognition. Research in Developmental Disabilities, 34(2), 817–830.
Green, P., Rohling, M., Lees-Haley, L., P. P., & Allen, L. M. (2001). Effort has a greater effect on test scores than severe brain injury in compensation claimants. Brain Injury, 15(12), 1045–1060.
Greve, K. W., Heinly, M. T., Bianchini, K. J., & Love, J. M. (2009a). Malingering detection with the Wisconsin Card sorting test in mild traumatic brain injury. The Clinical Neuropsychologist, 23(2), 343–362. https://doi.org/10.1080/13854040802054169
Greve, K. W., Ord, J. S., Bianchini, K. J., & Curtis, K. L. (2009b). Prevalence of malingering in patients with chronic pain referred for psychologic evaluation in a medico-legal context. Archives of Physical Medicine and Rehabilitation, 90(7), 1117–1126. https://doi.org/10.1016/j.apmr.2009b.01.018
Guilmette, T. J., Sweet, J. J., Hebben, N., Koltai, D., Mahone, E. M., Spiegler, B. J., Stucky, K., & Westerveld, M. (2020). & Conference Participants American Academy of Clinical Neuropsychology consensus conference statement on uniform labeling of performance test scores. The Clinical Neuropsychologist, 34(3), 437–453. https://doi.org/10.1080/13854046.2020.1722244
Harrison, A. G. (2017). Clinical, ethical and forensic implications of a flexible threshold for LD and ADHD in postsecondary settings. Psychological Injury and Law, 10, 138–150.
Harrison, A. G., & Armstrong, I. (2022). Accommodation decision-making for postsecondary students with ADHD: Treating the able as disabled. Psychological Injury and Law. Advance online publication. https://doi.org/10.1007/s12207-022-09461-1
Harrison, A. G., & Edwards, M. J. (2010). Symptom exaggeration in post-secondary students: Preliminary base rates in a canadian sample. Applied Neuropsychology, 17(2), 135–143. https://doi.org/10.1080/09084281003715642
Heaton, R. K., Chelune, G. J., Talley, J. L., Kay, G. G., & Curtis, G. (1993). Wisconsin Card sorting test (WCST) manual revised and expanded. Odessa, FL: Psychological Assessment Resources.
Heinly, M. T., Greve, K. W., Bianchini, K. J., Love, J. M., & Brennan, A. (2005). WAIS digit span-based indicators of malingered neurocognitive dysfunction: Classification accuracy in traumatic brain injury. Assessment, 12(4), 429–444. https://doi.org/10.1177/1073191105281099
Hervey, A. S., Epstein, J. N., & Curry, J. F. (2004). Neuropsychology of adults with attention-deficit/hyperactivity disorder: A meta-analytic review. Neuropsychology, 18, 485–503.
Holcomb, M. J., Roth, R. M., Tyson, B. T., & Erdodi, L. A. (2022b). Critical item (CR) analysis expands the classification accuracy of performance validity tests based on the forced choice paradigm—Replicating previously introduced CR cutoffs within the Word Choice Test. Neuropsychology Advance online publication. https://doi.org/10.1037/neu0000834
Holcomb, M., Pyne, S., Cutler, L., Oikle, D. A., & Erdodi, L. A. (2022a). Take their word for it: The Inventory of Problems provides valuable information on both symptom and performance validity. Journal of Personality Assessment. Advance online publication. https://doi.org/10.1080/00223891.2022a.2114358
Hurtubise, J. L., Scavone, A., Sagar, S., & Erdodi, L. A. (2017). Psychometric markers of genuine and feigned neurodevelopmental disorders in the context of applying for academic accommodations. Psychological Injury and Law, 10(2), 121–137. https://doi.org/10.1007/s12207-017-9287-5
Jodzio, K., & Biechowska, D. (2010). Wisconsin card sorting test as a measure of executive function impairments in stroke patients. Applied Neuropsychology, 17(4), 267–277. https://doi.org/10.1080/09084282.2010.525104
Jones, E. F., Pritchard, A., Jacobson, L. A., Mahone, E. M., & Zabel, T. A. (2021). How much testing can a kid take? Feasibility of collecting pediatric patient experience ratings of neuropsychological and psychological assessment. Applied Neuropsychology: Child, 11(4), 610–617. https://doi.org/10.1080/21622965.2021.1917410
Kim, M. S., Boone, K. B., Victor, T., Marion, S. D., Amano, S., Cottingham, M. E., Ziegler, E. A., & Zeller, M. A. (2010). The Warrington Recognition Memory Test for words as a measure of response bias: Total score and response time cutoffs developed on “real world” credible and noncredible subjects. Archives of Clinical Neuropsychology, 25(1), 60–70. https://doi.org/10.1093/arclin/acp088
Klein, C., Wendling, K., Huettner, P., Ruder, H., & Peper, M. (2006). Intra-subject variability in attention-deficit hyperactivity disorder. Biological Psychiatry, 60(10), 1088–1097.
Kosky, K. M., Lace, J. W., Austin, T. A., Seitz, D. J., & Clark, B. (2022). The utility of the Wisconsin card sorting test, 64-card version to detect noncredible attention-deficit/hyperactivity disorder. Applied Neuropsychology: Adult, 29(5), 1231–1241. https://doi.org/10.1080/23279095.2020.1864633
Kura, K. (2013). Japanese north–south gradient in IQ predicts differences in stature, skin color, income, and homicide rate. Intelligence, 41(5), 512–516.
Lange, R. T., Iverson, G. L., Brickell, T. A., Staver, T., Pancholi, S., Bhagwat, A., & French, L. M. (2013). Clinical utility of the Conners’ continuous performance Test-II to detect poor effort in U.S. Military personnel following traumatic brain injury. Psychological Assessment, 25(2), 339–352. https://doi.org/10.1037/a0030915
Larrabee, G. J. (2003). Detection of malingering using atypical performance patterns on standard neuropsychological tests. The Clinical Neuropsychologist, 17(3), 410–425. https://doi.org/10.1076/clin.17.3.410.18089
Larrabee, G. J. (2014). False-positive rates associated with the use of multiple performance and symptom validity tests. Archives of Clinical Neuropsychology, 29(4), 364–373. https://doi.org/10.1093/arclin/acu019
Lee, A., Boone, K. B., Lesser, I., Wohl, M., Wilkins, S., & Parks, C. (2000). Performance of older depressed patients on two cognitive malingering tests: False positive rates for the Rey 15-item memorization and dot counting tests. The Clinical Neuropsychologist, 14(3), 303–308. https://doi.org/10.1076/1385-4046(200008)14:3;1-P;FT303
Lichtenstein, J. D., Greenacre, M. K., Cutler, L., Abeare, K., Baker, S. D., Kent, K., Ali, J., S., & Erdodi, L. A. (2019). Geographic variation and instrumentation artifacts: in search of confounds in performance validity assessment in adults with mild TBI. Psychological Injury and Law, 12(2), 127–145. doi.10.1007/s12207-019-0935
Lin, H. Y., Hwang-Gu, S. L., & Gau, S. F. (2015). Intra‐individual reaction time variability based on ex‐gaussian distribution as a potential endophenotype for attention‐deficit/hyperactivity disorder. Acta Psychiatrica Scandinavica, 132(1), 39–50. https://doi.org/10.1111/acps.12393
Lippa, S. M. (2018). Performance validity testing in neuropsychology: A clinical guide, critical review, and update on a rapidly evolving literature. The Clinical Neuropsychologist, 32(3), 391–421. https://doi.org/10.1080/13854046.2017.1406146. https://doi-org.libezp.lib.lsu.edu/
Lovett, B. J., & Harrison, A. G. (2021). Assessing adult ADHD: New research and perspectives. Journal of Clinical and Experimental Neuropsychology, 43(4), 333–339. https://doi.org/10.1080/13803395.2021.1950640
Lynn, R. (2010). In Italy, north–south differences in IQ predict differences in income, education, infant mortality, stature, and literacy. Intelligence, 38(1), 93–100.
Marshall, P., Schroeder, R., O’Brien, J., Fischer, R., Ries, A., Blesi, B., & Barker, J. (2010). Effectiveness of symptom validity measures in identifying cognitive and behavioral symptom exaggeration in adult attention deficit hyperactivity disorder. The Clinical Neuropsychologist, 24, 1204–1237. https://doi.org/10.1080/13854046.2010.514290
Martin, P. K., & Schroeder, R. W. (2020). Base rates of invalid test performance across clinical non-forensic contexts and settings. Archives of Clinical Neuropsychology, 35(6), 717–725. https://doi.org/10.1093/arclin/acaa017
McDaniel, M. A. (2006). Estimating state IQ: Measurement challenges and preliminary correlates. Intelligence, 34(6), 607–619.
Medici, R. (2013). The use of multiple performance validity tests. Journal of Forensic Psychology Practice, 13(1), 68–78. https://doi.org/10.1080/15228932.2013.746909
Merten, T., Kaminski, A., & Pfeiffer, W. (2020). Prevalence of overreporting on symptom validity tests in a large sample of psychosomatic rehabilitation inpatients. The Clinical Neuropsychologist, 34(5), 1004–1024. https://doi.org/10.1080/13854046.2019.1694073
Merten, T., & Rogers, R. (2017). An international perspective on feigned mental disabilities: Conceptual issues and continuing controversies. Behavioral Sciences and the Law, 35, 97–112. https://doi.org/10.1002/bsl.2274
Messa, L., Holcomb, M., Lichtenstein, J. D., Tyson, B. T., Roth, R. M., & Erdodi, L. A. (2021). They are not destined to fail: A systematic examination of scores on embedded performance validity indicators in patients with intellectual disability. Australian Journal of Forensic Sciences. https://doi.org/10.1080/00450618.2020.1865457. Advance Online Publication.
Mittenberg, W., Patton, C., Canyock, E. M., & Condit, D. C. (2002). Base rates of malingering and symptom exaggeration. Journal of Clinical and Experimental Neuropsychology, 24(8), 1094–1102.
Munkvold, L. H., Manger, T., & Lundervold, A. J. (2014). Conners’ continuous performance test (CCPT-II) in children with ADHD, ODD, or a combined ADHD/ODD diagnosis. Child Neuropsychology, 20(1), 106–126. https://doi.org/10.1080/09297049.2012.753997
Nikolas, M. A., Marshall, P., & Hoelzle, J. B. (2019). The role of neurocognitive tests in the assessment of adult attention-deficit/hyperactivity disorder. Psychological Assessment, 31(5), 685–698. https://doi.org/10.1037/pas0000688
Odland, A. P., Lammy, A. B., Martin, P. K., Grote, C. L., & Mittenberg, W. (2015). Advanced administration and interpretation of multiple validity tests. Psychological Injury and Law, 8(1), 46–63. https://doi.org/10.1007/s12207-015-9216-4
Olla, P., Rykulski, N., Hurtubise, J. L., Bartol, S., Foote, R., Cutler, L., Abeare, K., McVinnie, N., Sabelli, A. G., Hastings, M., & Erdodi, L. A. (2021). Short-term effects of cannabis consumption on cognitive performance in medical cannabis patients. Applied neuropsychology Adult, 28(6), 647–657. https://doi.org/10.1080/23279095.2019.1681424. https://doi-org.libezp.lib.lsu.edu/
Ord, A. S., Miskey, H. M., Lad, S., Richter, B., Nagy, K., & Shura, R. D. (2021). Examining embedded validity indicators in Conners continuous performance test-3 (CPT-3). The Clinical Neuropsychologist, 35(8), 1426–1441. https://doi.org/10.1080/13854046.2020.1751301
Pearson. (2009). Advanced clinical solutions for the WAIS-IV and WMS-IV – technical manual. San Antonio, TX: Author.
Persinger, V. C., Whiteside, D. M., Bobova, L., Saigal, S. D., Vannucci, M. J., & Basso, M. R. (2018). Using the California Verbal Learning Test, Second Edition as an embedded performance validity measure among individuals with TBI and individuals with psychiatric disorders. The Clinical Neuropsychologist, 32(6), 1039–1053. https://doi.org/10.1080/13854046.2017.1419507
Pettersson, R., Söderström, S., & Nilsson, K. W. (2018). Diagnosing ADHD in adults: An examination of the discriminative validity of neuropsychological tests and diagnostic assessment instruments. Journal of Attention Disorders, 22(11), 1019–1031. https://doi.org/10.1177/1087054715618788
Poynter, K., Boone, K. B., Ermshar, A., Miora, D., Cottingham, M., Victor, T. L., Ziegler, E., Zeller, M. A., & Wright, M. (2019). Wait, there’s a baby in this bath water! Update on quantitative and qualitative cut-offs for Rey 15-Item Recall and Recognition. Archives of Clinical Neuropsychology, 34(8), 1367–1380. https://doi.org/10.1093/arclin/acy087
Proto, D. A., Pastorek, N. J., Miller, B. I., Romesser, J. M., Sim, A. H., & Linck, J. M. (2014). The dangers of failing one or more performance validity tests in individuals claiming mild traumatic brain injury-related postconcussive symptoms. Archives of Clinical Neuropsychology, 29, 614–624.
Rai, J. K., An, K. Y., Charles, J., Ali, S., & Erdodi, L. A. (2019). Introducing a forced choice recognition trial to the Rey Complex figure test. Psychology & Neuroscience, 12(4), 451–472. https://doi.org/10.1037/pne0000175
Reedy, S. D., Boone, K. B., Cottingham, M. E., Glaser, D. F., Lu, P. H., Victor, T. L., Ziegler, E. A., Zeller, M. A., & Wright, M. J. (2013). Cross validation of the Lu and colleagues (2003) Rey-Osterrieth Complex Figure Test effort equation in a large known-group sample. Archives of Clinical Neuropsychology, 28(1), 30–37. https://doi.org/10.1093/arclin/acs106
Reitan, R. M. (1955). The relation of the trail making test to organic brain damage. Journal of Consulting Psychology, 19, 393–394.
Reitan, R. M. (1969). Manual for administration of neuropsychological test batteries for adults and children. Indianapolis, IN.
Rey, A. (1941). L’examen psychologique dans les cas d’encephalopathie traumatique [The psychological examination in cases of traumatic encephalopathy]. Archives de Psychologie, 28, 215–285.
Riccio, C. A., & Reynolds, C. R. (2006). Continuous performance tests are sensitive to ADHD in adults but lack specificity. A review and critique for differential diagnosis. Annals of the New York Academy of Sciences, 931, 113–139. https://doi.org/10.1111/j.1749-6632.2001.tb05776.x
Riccio, C. A., Reynolds, C. R., Lowe, P., & Moore, J. J. (2002). The continuous performance test: A window on the neural substrates for attention? Archives of Clinical Neuropsychology, 17(3), 235–272.
Robinson, A., Miller, L. R., Herring, T. T., & Calamia, M. (2023). Utility of the D-KEFS color–word interference test as an embedded validity indicator in psychoeducational evaluations. Psychology & Neuroscience. https://doi.org/10.1037/pne0000301Advance online publication.
Robinson, A., Reed, C., Davis, K., Divers, R., Miller, L., Erdodi, L., & Calamia, M. (2022). Settling the score: Can CPT-3 embedded validity indicators distinguish between credible and non-credible responders referred for ADHD and/or SLD? Journal of Attention Disorders, 27(1), 80–88. https://doi.org/10.1177/10870547221121781
Roma, P., Giromini, L., Burla, F., Ferracuti, S., Viglione, D. J., & Mazza, C. (2020). Ecological validity of the inventory of Problems-29 (IOP-29): An italian study of court-ordered, psychological injury evaluations using the structured inventory of Malingered Symptomatology (SIMS) as criterion variable. Psychological Injury and Law, 13, 57–65. https://doi.org/10.1007/s12207-019-09368-4
Roth, R. M., Isquith, P. K., & Gioia, G. A. (2005). Behavior rating inventory of executive function—adult version. Lutz, FL: Psychological Assessment Resources, Inc.
Roth, R. M., Lance, C. E., Isquith, P. K., Fischer, A. S., & Giancola, P. R. (2013). Confirmatory factor analysis of the Behavior rating inventory of executive function - adult version in healthy adults and application to attention-deficit/hyperactivity disorder. Archives of Clinical Neuropsychology, 28(5), 425–434. https://doi.org/10.1093/arclin/act031
Ruff, R. M., Klopfer, J., & Blank, J. (2016). Homogenous base rates for malingering in neuropsychological examination of litigants. Psychological Injury and Law, 9(2), 143–153.
Samek, J., Spencer, R. J., Rice, S. C., & Waldstein, S. R. (2007). Reliability of the Conners’ continuous performance test in young adults. Archives of Clinical Neuropsychology, 22(7), 860–861.
Schoechlin, C., & Engel, R. R. (2005). Neuropsychological performance in adult attention-deficit hyperactivity disorder: Meta-analysis of empirical data. Archives of Clinical Neuropsychology, 20(6), 727–744. https://doi.org/10.1016/j.acn.2005.04.005
Schroeder, R. W., Martin, P. K., Heinrichs, R. J., & Baade, L. E. (2019). Research methods in performance validity testing studies: Criterion grouping approach impacts study outcomes. The Clinical Neuropsychologist, 33(3), 466–477. https://doi.org/10.1080/13854046.2018.1484517
Shaked, D., Faulkner, L., Tolle, K., Wendell, C. R., Waldstein, S. R., & Spencer, R. J. (2020). Reliability and validity of the Conners’ continuous performance test. Applied Neuropsychology Adult, 27(5), 478–487. https://doi.org/10.1080/23279095.2019.1570199
Sharland, M. J., Waring, S. C., Johnson, B. P., Taran, A. M., Rusin, T. A., Pattock, A. M., & Palcher, J. A. (2018). Further examination of embedded performance validity indicators for the Conners’ continuous performance test and brief test of attention in a large outpatient clinical sample. The Clinical Neuropsychologist, 32(1), 98–108. https://doi.org/10.1080/13854046.2017.1332240
Sherman, E., Slick, D. J., & Iverson, G. L. (2020). Multidimensional Malingering Criteria for Neuropsychological Assessment: A 20-Year update of the Malingered Neuropsychological Dysfunction Criteria. Archives of Clinical Neuropsychology, 35(6), 735–764. https://doi.org/10.1093/arclin/acaa019
Shura, R. D., Martindale, S. L., Taber, K. H., Higgins, A. M., & Rowland, J. A. (2020). Digit span embedded validity indicators in neurologically-intact veterans. The Clinical Neuropsychologist, 34(5), 1025–1037. https://doi.org/10.1080/13854046.2019.1635209
Shura, R. D., Miskey, H. M., Rowland, J. A., Yoash-Gantz, R. E., & Denning, J. H. (2016). Embedded performance validity measures with post deployment veterans: Cross-validation and efficiency with multiple measures. Applied Neuropsychology: Adult, 23(2), 94–104. https://doi.org/10.1080/23279095.2015.1014556
Sirianni, C. D., Abeare, C. A., Ali, S., Razvi, P., Kennedy, A., Pyne, S. R., & Erdodi, L. A. (2021). The V-5 provides quick and accurate measures of psychiatric symptoms for single and repeated in-person and online assessments and is valid in culturally diverse examinees. Psychiatry Research, 298, 11365.
Slick, D. J., Iverson, G. L., & Green, P. (2000). California Verbal Learning Test indicators of suboptimal performance in a sample of head-injury litigants. Journal of Clinical and Experimental Neuropsychology, 22(5), 569–579. https://doi.org/10.1076/1380-3395(200010)22:5;1-9;FT569
Slick, D. J., Tan, J. E., Strauss, E. H., & Hultsch, D. F. (2004). Detecting malingering: A survey of experts’ practices. Archives of Clinical Neuropsychology, 19(4), 465–473.
Sollman, M. J., Ranseen, J. D., & Berry, D. T. R. (2010). Detection of feigned ADHD in college students. Psychological Assessment, 22(2), 325–335.
Sugarman, M. A., Holcomb, E. M., Axelrod, B. N., Meyers, J. E., & Liethen, P. C. (2016). Embedded measures of performance validity in the Rey Complex figure test in a clinical sample of veterans. Applied Neuropsychology Adult, 23(2), 105–114. https://doi.org/10.1080/23279095.2015.1014557
Suhr, J. A., & Berry, D. (2017). The importance of assessing for validity of symptom report and performance in attention deficit/hyperactivity disorder (ADHD): Introduction to the special section on noncredible presentation in ADHD. Psychological Assessment, 29(12), 1427–1428. https://doi.org/10.1037/pas0000535
Suhr, J. A., Lee, G. J., & Harrison, A. G. (2022). Susceptibility of functional impairment ratings to noncredible reporting in postsecondary students undergoing screening for ADHD. The Clinical Neuropsychologist, 36(6), 1493–1505. https://doi.org/10.1080/13854046.2020.1817564
Suhr, J. A., Sullivan, B. K., & Rodriguez, J. L. (2011). The relationship of noncredible performance to continuous performance test scores in adults referred for attention-deficit/hyperactivity disorder evaluation. Archives of Clinical Neuropsychology, 26(1), 1–7. https://doi.org/10.1093/arclin/acq094
Sullivan, B. K., May, K., & Galbally, L. (2007). Symptom exaggeration by college adults in attention-deficit hyperactivity disorder and learning disorder assessments. Applied Neuropsychology, 14(3), 189–207. https://doi.org/10.1080/09084280701509083
Sullivan, K., Lange, R. T., & Dawes, S. (2006). Methods of detecting malingering and estimated symptom exaggeration base rates in Australia. Journal of Forensic Neuropsychology, 4(4), 49–70.
Sweet, J. J., Wolfe, P., Sattlberger, E., Numan, B., Rosenfeld, J. P., Clingerman, S., & Nies, K. J. (2000). Further investigation of traumatic brain injury versus insufficient effort with the California Verbal Learning Test. Archives of Clinical Neuropsychology, 15(2), 105–113.
Trueblood, W. (1994). Qualitative and quantitative characteristics of malingered and other invalid WAIS-R and clinical memory data. Journal of Clinical and Experimental Neuropsychology, 16(4), 597–607. https://doi.org/10.1080/01688639408402671
Tyson, B. T., Baker, S., Greenacre, M., Kent, K., Lichtenstein, J., Sabelli, J. D., A., & Erdodi, L. A. (2018). Differentiating epilepsy from psychogenic nonepileptic seizures using neuropsychological test data. Epilepsy & Behavior, 87, 39–45.
Tyson, B. T., Pyne, S. R., Crisan, I., Calamia, M., Holcomb, M., Giromini, L., & Erdodi, L. A. (2023a). Logical memory, Visual Reproduction and Verbal Paired Associates are effective embedded validity indicators in patients with traumatic brain injury. Advance online publication. Applied Neuropsychology: Adult.
Tyson, B. T., Shahein, A., Abeare, C. A., Baker, S. D., Kent, K., Roth, R. M., & Erdodi, L. A. (2023b). Replicating a meta-analysis: The search for the optimal Word Choice Test cutoff continues. Assessment. Advance online publication.
Victor, T. L., & Boone, K. B. (2021). Identification of feigned intellectual disability. In K. B. Boone (Ed.), Assessment of feigned cognitive impairment: A neuropsychological perspective (2nd ed., pp. 453–480). The Guilford Press.
Victor, T. L., Boone, K. B., Serpa, J. G., Buehler, J., & Ziegler, E. A. (2009). Interpreting the meaning of multiple symptom validity test failure. The Clinical Neuropsychologist, 23(2), 297–313. https://doi.org/10.1080/13854040802232682
Viglione, D. J., Giromini, L., & Landis, P. (2017). The development of the inventory of Problems–29: A brief self-administered measure for discriminating bona fide from feigned psychiatric and cognitive complaints. Journal of Personality Assessment, 99(5), 534–544. https://doi.org/10.1080/00223891.2016.1233882
Warrington, E. K. (1984). Recognition Memory Test manual. Berkshire, United Kingdom: NFERNelson.
Webber, T. A., Sullivan-Baca, E., Modiano, Y. A., Taiwo, Z., & Grabyan, J. M. (2022). Validity of informant report interpretations: Role of examinee performance and symptom invalidity. Psychological Assessment, 34(2), 125–139. https://doi.org/10.1037/pas0001074
Weiss, B. A. (2011). Hotelling’s t test and Steiger’s z test calculator [Computer software]. Available from https://blogs.gwu.edu/weissba/teaching/calculators/hotellings-t-and-steigers-z-tests/
Whitney, K. A., Davis, J. J., Shepard, P. H., Bertram, D. M., & Adams, K. M. (2009). Digit span age scaled score in middle-aged military veterans: Is it more closely associated with TOMM failure than reliable digit span? Archives of Clinical Neuropsychology, 24(3), 263–272. https://doi.org/10.1093/arclin/acp034
Wilkinson, G. S., & Robertson, G. J. (2006). Wide range achievement test – Fourth Edition. Lutz, FL: Psychological Assessment Resources, Inc.
Wolfe, P. L., Millis, S. R., Hanks, R., Fichtenberg, N., Larrabee, G. J., & Sweet, J. J. (2010). Effort indicators within the California Verbal Learning Test-II (CVLT-II). The Clinical Neuropsychologist, 24(1), 153–168. https://doi.org/10.1080/13854040903107791
Young, G. (2015). Malingering in forensic disability-related assessments: Prevalence 15 ± 15%. Psychological Injury and Law, 8(3), 188–199. https://doi.org/10.1007/s12207-015-9232-4
Young, G. (2020). Thirty complexities and controversies in mild traumatic brain injury and persistent post-concussion syndrome: A roadmap for research and practice. Psychological Injury and Law, 13(4), 427–451. https://doi.org/10.1007/s12207-020-09395-6
Zuccato, B. G., Tyson, B. T., & Erdodi, L. A. (2018). Early bird fails the PVT? The effects of timing artifacts on performance validity tests. Psychological Assessment, 30(11), 14911498. https://doi.org/10.1037/pas0000596
Funding
This research received no funding from external granting agencies.
Author information
Authors and Affiliations
Contributions
The first and second authors produced the Introduction and parts of the Discussion section; the second, third and fourth authors performed a comprehensive review of the literature and summarized relevant studies to be references in the Introduction, Methods and Discussion; the sixth author provided supervision during data collection and expertise in integrating the existing research literature with the findings of the study as well as identifying their clinical relevance to practicing neuropsychologists; the last author was responsible for research design, data collection/analysis and finalizing the text of the manuscript.
Corresponding author
Ethics declarations
Conflict of Interest
Robert M. Roth, PhD is an author of the BRIEF-A and receives royalties from the publisher (Psychological Assessment Resources, Inc.). The Authors declare no other conflict of interest.
Compliance with Ethical Standards
The data set used in this study was approved for use for research purposes both by the hospital where the clinical assessments were performed (holder of the records) and the university listed as the corresponding author’s institutional affiliation. To protect confidential patient information, only irreversibly de-identified data were collected.
Ethics Approval
Relevant ethical guidelines were followed throughout the project. All data collection, storage and processing was done with the approval of relevant institutional authorities regulating research involving human participants, in compliance with the 1964 Helsinki Declaration and its subsequent amendments or comparable ethical standards.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Robinson, A., Calamia, M., Penner, N. et al. Two Times the Charm: Repeat Administration of the CPT-II Improves Its Classification Accuracy as a Performance Validity Index. J Psychopathol Behav Assess 45, 591–611 (2023). https://doi.org/10.1007/s10862-023-10055-7
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10862-023-10055-7