Skip to main content
SpringerLink
Log in

Reconsidering the RBANS Factor Structure: a Systematic Literature Review and Meta-Analytic Factor Analysis

  • Review
  • Published:
Neuropsychology Review Aims and scope Submit manuscript

Abstract

The primary aim was to perform a systematic literature review and extract data necessary for a meta-analytic factor analysis of the RBANS. Secondary aims were to examine the potential validity and utility of the resulting factor structure. Literature was identified through a review of PsycINFO, PubMed, MEDLINE, Academic Search Complete, Psychology & Behavioral Sciences Collection, CINAHL Complete, Health Source: Nursing/Academic Edition, and SocINDEX. A two-stage meta-analytic structural equation modeling method was implemented to pool correlation matrices from primary studies and perform confirmatory factor analyses. Following model selection, factor scores were computed for two datasets and subjected to correlation and diagnostic accuracy analyses. A pooled correlation matrix was computed from 24 sample correlation matrices (N = 5299). Confirmatory factor analysis revealed that the theoretical five-factor model produced the best fit but only when error terms between Story Memory and Story Recall as well as between Figure Copy and Figure Recall were included. Regression-based factor scores showed mixed relationships with the manual-defined indices, and the overall diagnostic accuracy of the factor scores was adequate in both samples examined (AUC = 0.71 and 0.87). The five-factor model was an unexpected result given the failure of multiple previous studies to find support for that model. The five-factor model demonstrates several areas of potential improvement, including better representation of the factors by the indicators. The factor scores implied by this model also require further validation.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

References

  • Andreotti, C., & Hawkins, K. A. (2015). RBANS norms based on the relationship of age, gender, education, and WRAT-3 Reading to performance within an older African American sample. The Clinical Neuropsychologist, 29(4), 442–466. https://doi.org/10.1080/13854046.2015.1039589

    Article  PubMed  Google Scholar 

  • Armistead-Jehle, P., & Hansen, C. L. (2016). Factor analysis of the MSVT, NV-MST, and RBANS memory subtests. Archives of Clinical Neuropsychology, 31(5), 465–471. https://doi.org/10.1093/arclin/acw033

    Article  PubMed  Google Scholar 

  • Arredondo, B. C., Marcopulos, B. A., Brand, J. G., Campbell, K. T., & Kent, J. (2017). Cognitive functioning and adjudicative competence: Defendants referred for neuropsychological evaluation in a psychiatric inpatient setting. The Clinical Neuropsychologist, 31(8), 1432–1448. https://doi.org/10.1080/13854046.2017.1317032

    Article  PubMed  Google Scholar 

  • Beatty, W. W., Ryder, K. A., Gontkovsky, S. T., Scott, J. G., McSwan, K. L., & Bharucha, K. J. (2003). Analyzing the subcortical dementia syndrome of Parkinson’s disease using the RBANS. Archives of Clinical Neuropsychology, 18(5), 509–520. https://doi.org/10.1093/arclin/18.5.509

    Article  PubMed  Google Scholar 

  • Beglinger, L. J., Duff, K., Allison, J., Theriault, D., O’Rourke, J. J. F., … Paulsen, J. S. (2010). Cognitive change in patients with Huntington disease on the repeatable battery for the assessment of neuropsychological status. Journal of Clinical and Experimental Neuropsychology, 32(6), 573–578. https://doi.org/10.1080/13803390903313564

    Article  PubMed  Google Scholar 

  • Bonifay, W., Lane, S. P., & Reise, S. P. (2017). Three concerns with applying a bifactor model as a structure of psychopathology. Clinical Psychological Science, 5(1), 184–186. https://doi.org/10.1177/2167702616657069

    Article  Google Scholar 

  • Carlozzi, N. E., Horner, M. D., Yang, C., & Tilley, B. C. (2008). Factor analysis of the repeatable battery for the assessment of neuropsychological status. Applied Neuropsychology, 15(4), 274–279. https://doi.org/10.1080/09084280802325124

    Article  PubMed  Google Scholar 

  • Cheng, Y., Wu, W., Wang, J., Feng, W., Wu, X., & Li, C. (2011). Reliability and validity of the repeatable battery for the assessment of neuropsychological status in community-dwelling elderly. Archives of Medical Science, 7(5), 850–857. https://doi.org/10.5114/aoms.2011.25561

    Article  PubMed  Google Scholar 

  • Cheung, M. W.-L. (2015a). Meta-analysis: A structural equation modeling approach. Chichester: Wiley.

    Google Scholar 

  • Cheung, M. W.-L. (2015b). metaSEM: An R package for meta-analysis using structural equation modeling. Frontiers in Psychology, 5(1521).

  • Cheung, M. W.-L., & Chan, W. (2005). Meta-analytic structural equation modeling: A two-stage approach. Psychological Methods, 10(1), 40–64. https://doi.org/10.1037/1082-989X.10.1.40

    Article  PubMed  Google Scholar 

  • Cohen, J., Cohen, P., West, S. G., & Aiken, L. S. (2003). Applied multiple regression/correlation analysis for the behavioral sciences (3rd ed.). New York: Routledge.

    Google Scholar 

  • Delis, D. C., Jacobson, M., Bondi, M. W., Hamilton, J. M., & Salmon, D. P. (2003). The myth of testing construct validity using factor analysis or correlations with normal or mixed clinical populations: Lessons from memory assessment. Journal of the International Neuropsychological Society, 9(6), 936-946. Doi: 10.10170S1355617703960139

  • Duff, K., Beglinger, L. J., Theriault, D., Allison, J., & Paulsen, J. S. (2010). Cognitive deficits in Huntington’s disease on the repeatable battery for the assessment of neuropsychological status. Journal of Clinical and Experimental Neuropsychology, 32(3), 231–238. https://doi.org/10.1080/13803390902926184

  • Duff, K., Clark, H. J. D., O’Bryant, S. E., Mold, J. W., Schiffer, R. B., & Sutker, P. B. (2008). Utility of the RBANS in detecting cognitive impairment associated with Alzheimer’s disease: Sensitivity, specificity, and positive and negative predictive powers. Archives of Clinical Neuropsychology, 23(5), 603–612. https://doi.org/10.1016/j.acn.2008.06.004

    Article  PubMed  PubMed Central  Google Scholar 

  • Duff, K., Langbehn, D. R., Schoenberg, M. R., Moser, D. J., Baade, L. E., Mold, J., … Adams, R. L. (2006). Examining the repeatable battery for the assessment of neuropsychological status: Factor analytic studies in an elderly sample. American Journal of Geriatric Psychiatry, 14(11), 976–979. https://doi.org/10.1097/01.JGP.0000229690.70011.cd

    Article  PubMed  Google Scholar 

  • Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997). Bias in meta-analysis detected by a simple, graphical test. The British Medical Journal, 315(7109), 629–634. https://doi.org/10.1136/bmj.315.7109.629

    Article  CAS  PubMed  Google Scholar 

  • Emmert, N., Schwarz, L., Vander Wal, J., & Gfeller, J. (2018). RBANS factor structure in older adults with suspected cognitive impairment: Evidence for a 5-factor structure. Applied Neuropsychology: Adult, 25(1), 38–50. https://doi.org/10.1080/23279095.2016.1238827

    Article  Google Scholar 

  • Garcia, C., Leahy, B., Corradi, K., & Forchetti, C. (2008). Component structure of the repeatable battery for the assessment of neuropsychological status in dementia. Archives of Clinical Neuropsychology, 23(1), 63–72. https://doi.org/10.1016/j.acn.2007.08.008

    Article  PubMed  Google Scholar 

  • Gnambs, T., & Staufenbiel, T. (2016). Parameter accuracy in meta-analyses of factor structures. Research Synthesis Methods, 7(2), 168–186. https://doi.org/10.1002/jrsm.1190

    Article  PubMed  Google Scholar 

  • Goette, W. F., & Goette, H. E. (2019). A meta-analysis of the accuracy of embedded performance validity indicators from the repeatable battery for the assessment of neuropsychological status. The Clinical Neuropsychologist, 33(6), 1044–1068. https://doi.org/10.1080/13854046.2018.1538429

    Article  PubMed  Google Scholar 

  • Goette, W. F., & Schmitt, L. A. (2018). Examination of regression-based discrepancy scores for the RBANS in detecting cognitive impairment from an archival sample. Archives of Clinical Neuropsychology, advanced online printing., 34(8), 1329–1339. https://doi.org/10.1093/arclin/acy100

    Article  Google Scholar 

  • Goette, W. F., Werry, A. E., & Schmitt, A. L. (2018). The relationship between smell identification and neuropsychological domains: Results from a sample of community-dwelling adults suspected of dementia. Journal of Clinical and Experimental Neuropsychology, 40(6), 595–605. https://doi.org/10.1080/13803395.2017.1399985

    Article  PubMed  Google Scholar 

  • Gogos, A., Joshua, N., & Rossell, S. L. (2010). Use of the repeatable battery for the assessment of neuropsychological status (RBANS) to investigate group and gender differences in schizophrenia and bipolar disorder. Australian & New Zealand Journal of Psychiatry, 44(3), 220–229. https://doi.org/10.3109/00048670903446882

    Article  Google Scholar 

  • Green, S., Sinclair, E., Rodgers, E., Birks, E., & Lincoln, N. (2013). The repeatable battery for the assessment of neuropsychological status (RBANS) for post-stroke cognitive impairment screening. International Journal of Therapy and Rehabilitation, 20(11), 536–541.

    Article  Google Scholar 

  • Greene, A. L., Eaton, N. R., Li, K., Forbes, M. K., Krueger, R. F., Markon, K. E., … Kotov, R. (2019). Are fit indices used to test psychopathology structure biased? A simulation study. Journal of Abnormal Psychology, 128(7), 740–764. https://doi.org/10.1037/abn0000434

    Article  PubMed  Google Scholar 

  • Grice, J. W. (2001). Computing and evaluating factor scores. Psychological Methods, 6(4), 430–450.

    Article  CAS  Google Scholar 

  • Hand, D. J. (2009). Measuring classifier performance: A coherent alternative to the area under the ROC curve. Machine Learning, 77(1), 103–123. https://doi.org/10.1007/s10994-009-5119-5

    Article  Google Scholar 

  • Hand, D. J. (2010). Evaluating diagnostic tests: The area under the ROC curve and the balance of errors. Statistics in Medicine, 29(14), 1502–1510. https://doi.org/10.1002/sim.3859

    Article  PubMed  Google Scholar 

  • Hobart, M. P., Goldberg, R., Bartko, J. J., & Gold, J. M. (1999). Repeatable battery for the assessment of neuropsychological status as a screening test in schizophrenia II: Convergent/discriminant validity and diagnostic group comparisons. American Journal of Psychiatry, 156(12), 1951–1957.

    CAS  PubMed  Google Scholar 

  • Hoelzle, J. B., & Meyer, G.J. (2009). The Invariant Component Structure of the Personality Assessment Inventory (PAI) Full Scales. Journal of Personality Assessment 91(2):175–186

  • Holden, H. M., Milano, N. J., & Horner, M. D. (2018). Five-factor structure of the RBANS is supported in an Alzheimer’s disease sample: Implications for validation of neuropsychological assessment instruments. Applied Neuropsychology: Adult. Advance online publication. doi: https://doi.org/10.1080/23279095.2018.1529671

  • Holdnack, J. A., Zhou, X., Larrabee, G. J., Millis, S. R., & Salthouse, T. A. (2011). Confirmatory factor analysis of the WAIS-IV/WMS-IV. Assessment, 18(2), 178–191. https://doi.org/10.1177/1073191110393106

    Article  PubMed  PubMed Central  Google Scholar 

  • Hu, L., & Bentler, P. M. (1999). Cuffoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118

    Article  Google Scholar 

  • Iverson, G., Brooks, B., & Haley, G. T. (2009). Interpretation of the RBANS in inpatient psychiatry: Clinical normative data and prevalence of low scores for patients with schizophrenia. Applied Neuropsychology, 16(1), 31–41. https://doi.org/10.1080/09084280802644128

    Article  PubMed  Google Scholar 

  • Jackson, D. L., Gillaspy Jr., J. A., & Purc-Stephenson, R. (2009). Reporting practices in confirmatory factor analysis: An overview and some recommendations. Psychological Methods, 14(1), 6–23. https://doi.org/10.1037/a0014694

    Article  PubMed  Google Scholar 

  • JASP Team (2019). JASP (Version 0.10.1)[Computer software]

  • Jefferys, H. (1998) [1961]. Appendix B of The Theory of Probability 3rd ed., pp. 432–441. Oxford: Clarendon Press

  • Karantzoulis, S., Novitski, J., Gold, M., & Randolph, C. (2013). The repeatable battery for the assessment of neuropsychological status (RBANS): Utility in detection and characterization of mild cognitive impairment due to Alzheimer’s disease. Archives of Clinical Neuropsychology, 28(8), 837–844. https://doi.org/10.1093/arclin/act057

    Article  PubMed  Google Scholar 

  • King, L. C., Bailie, J. M., Kinney, D. I., & Nitch, S. R. (2012). Is the repeatable battery for the assessment of neuropsychological status factor structure appropriate for inpatient psychiatry? An exploratory and higher-order analysis. Archives of Clinical Neuropsychology, 27(7), 756–765. https://doi.org/10.1093/arclin/acs062

    Article  PubMed  Google Scholar 

  • Lezak, M. D., Howieson, D. B., Bigler, E. D., & Tranel, D. (2012). Neuropsychological assessment (5th ed.). New York: Oxford University Press.

  • Lippa, S. M., Hawes, S., Jokic, E., & Caroselli, J. S. (2013). Sensitivity of the RBANS to acute traumatic brain injury and length of post-traumatic amnesia. Brain Injury, 27(6), 689–695. https://doi.org/10.3109/02699052.2013.771793

    Article  PubMed  Google Scholar 

  • McKay, C., Casey, J. E., Wertheimer, J., & Fichtenberg, N. L. (2007). Reliability and validity of the RBANS in a traumatic brain injured sample. Archives of Clinical Neuropsychology, 22(1), 228–241. https://doi.org/10.1016/j.bbr.2011.03.031

    Article  Google Scholar 

  • Messick, S. (1995). Validity of psychological assessment: Validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. American Psychologist, 50(9), 741–749.

    Article  Google Scholar 

  • Mitrushina, M., Boone, K. B., Razani, J., & D’Elia, L. F. (2005). Handbook of normative data for neuropsychological assessment (2nd ed.). New York: Oxford University Press

  • Morgan, G. B., Hodge, K. J., Wells, K. E., & Watkins, M. W. (2015). Are fit indices biased in favor of bi-factor models in cognitive ability research?: A comparison of fit in correlated factors, higher-order, and bi-factor models via Monte Carlo simulation. Journal of Intelligence, 3(1), 2–20. https://doi.org/10.3390/jintelligence3010002

    Article  Google Scholar 

  • Murray, A. L., & Johnson, W. (2013). The limitations of model fit in comparing the bi-factor versus higher-order models of human cognitive ability structure. Intelligence, 41(5), 407–422. https://doi.org/10.1016/j.intell.2013.06.004

    Article  Google Scholar 

  • O’Connor, B. P. (2002). The search for dimensional structure differences between normality and abnormality: A statistical review of published data on personality and psychopathology. Journal of Personality and Social Psychology, 83(4), 962–982. https://doi.org/10.1037//0022-3514.83.4.962

    Article  PubMed  Google Scholar 

  • Pachet, A. K. (2007). Construct validity of the repeatable battery for the assessment of neuropsychological status (RBANS) with acquired brain injury patients. The Clinical Neuropsychologist, 21(2), 286–293. https://doi.org/10.1080/13854040500376823

    Article  PubMed  Google Scholar 

  • Parashar, D. (2004). Analysis of Reliability and Validity of the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) (doctoral dissertation). Retrieved from ProQuest Dissertations & Theses Global. (UMI no. 3143011)

  • R Core Team. (2018). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. Retrieved from https://www.R-project.org/

  • Rabin, L. A., Paolillo, E., & Barr, W. B. (2016). Stability in test-usage practices of clinical neuropsychologists in the United States and Canada over a 10-year period: A follow-up survey of INS and NAN members. Archives of Clinical Neuropsychology, 31(3), 206–230. https://doi.org/10.1093/arclin/acw007

    Article  PubMed  Google Scholar 

  • Randolph, C., Tierney, M.C., Mohr, E., & Chase, T.N. (2010) The Repeatable Battery for the Assessment of Neuropsychological Status (RBANS): Preliminary Clinical Validity. Journal of Clinical and Experimental Neuropsychology 20(3):310–319

  • Randolph, C. (2012). Repeatable battery for the assessment of neuropsychological status update (RBANS update). Bloomington: Pearson.

    Google Scholar 

  • Raykov, T. (1997). Estimation of composite reliability of congeneric measures. Applied Psychological Measurement, 21(2), 173–184. https://doi.org/10.1177/01466216970212006

    Article  Google Scholar 

  • Reise, S. P., Bonifay, W. E., & Haviland, M. G. (2013). Scoring and modeling psychological measures in the presence of multidimensionality. Journal of Personality Assessment, 95(2), 129–140. https://doi.org/10.1080/00223891.2012.725437

    Article  PubMed  Google Scholar 

  • Revelle, W. (2018). psych: Procedures for Personality and Psychological Research, Northwestern University, Evanston, Illinois, USA. R package version 1.8.12, https://CRAN.R-project.org/package=psych

  • Rodriguez, A., Reise, S. P., & Haviland, M. G. (2016). Evaluating bifactor models: Calculating and interpreting statistical indices. Psychological Methods, 21(2), 137–150. https://doi.org/10.1037/met0000045

    Article  PubMed  Google Scholar 

  • Ross, P. T., Padula, C. B., Nitch, S. R., & Kinney, D. I. (2015). Cognition and competency restoration: Using the RBANS to predict length of stay for patients deemed incompetent to stand trial. The Clinical Neuropsychologist, 29(1), 150–165. https://doi.org/10.1080/13854046.2015.1005678

    Article  Google Scholar 

  • Schmitt, A. L., Livingston, R. B., Smernoff, E. N., Reese, E. M., Hafter, D. G., & Harris, J. B. (2010). Factor analysis of the repeatable battery for the assessment of neuropsychological status (RBANS) in a large sample of patients suspected of dementia. Applied Neuropsychology, 17(1), 8–17. https://doi.org/10.1080/09084280903297719

    Article  PubMed  Google Scholar 

  • Schmitt, N. (1996). Uses and abuses of coefficient alpha. Psychological Assessment, 8(4), 350–353.

    Article  Google Scholar 

  • Schneider, W. J., & McGrew, K. S. (2012). The Cattell-horn-Carroll model of intelligence. In D. P. Flanagan & P. L. Harrison (Eds.), Contemporary intellectual assessment: Theories, tests, and issues (3rd ed.pp. 99–144). New York: The Guilford Press.

    Google Scholar 

  • Schoenberg, M. R., Rinehardt, E., Duff, K., Mattingly, M., Bharucha, K. J., & Scott, J. G. (2012). Assessing reliable change using the repeatable battery for the assessment of neuropsychological status (RBANS) for patients with Parkinson’s disease undergoing deep brain stimulation (DBS) surgery. The Clinical Neuropsychologist, 26(2), 255–270. https://doi.org/10.1080/13854046.2011.653587

    Article  PubMed  Google Scholar 

  • Shura, R. D., Brearly, T. W., Rowland, J. A., Martindale, S. L., Miskey, H. M., & Duff, K. (2018). RBANS validity indices: A systematic review and meta-analysis. Neuropsychology Review, 28(3), 269–284. https://doi.org/10.1007/s11065-018-9377-5

    Article  PubMed  Google Scholar 

  • Spencer, R. J., Andren, K. A. K., & Rahman-Filipiak, A. (2018). Incidental learning from the coding subtest of the repeatable battery for the assessment of neuropsychological status. Applied Neuropsychology: Adult, 25(1), 5–10. https://doi.org/10.1080/23279095.2016.1228637

    Article  Google Scholar 

  • Strauss, E., Sherman, E. M. S., & Spreen, O. (2006). A compendium of neuropsychological tests: Administration, norms, and commentary (3rd ed.). New York: Oxford University Press.

    Google Scholar 

  • Torrence, N. D., John, S. E., Gavett, B. E., & O’Bryant, S. E. (2016). An empirical comparison of competing factor structures for the repeatable battery for the assessment of neuropsychological status: A project FRONTIER study. Archives of Clinical Neuropsychology, 31(1), 88–96. https://doi.org/10.1093/arclin/acv057

    Article  PubMed  Google Scholar 

  • Tulsky, D. S., & Price, L. R. (2003). The joint WAIS-III and WMS-III factor structure: Development and cross-validation of a six-factor model of cognitive functioning. Psychological Assessment, 15(2), 149–162. https://doi.org/10.1037/1040-3590.15.2.149

    Article  PubMed  Google Scholar 

  • Viechtbauer, W. (2010). Conducting meta-analyses in R with the metafor package. Journal of Statistical Software, 36(3), 1–48.

    Article  Google Scholar 

  • Vogt, E. M. (2015). Invariant two component structure of the repeatable battery for the assessment of neuropsychological status (RBANS). (Unpublished master’s thesis). Marquette University, Milwaukee, Wisconsin.

  • Vogt, E. M., Prichett, G. D., & Hoelzle, J. B. (2017). Invariant two-component structure of the repeatable battery for the assessment of neuropsychological status (RBANS). Applied Neuropsychology: Adult, 24(1), 50–64. https://doi.org/10.1080/23279095.2015.1088852

    Article  Google Scholar 

  • Watts, A. L., Poore, H. E., & Waldman, I. D. (2019). Riskier tests of the validity of the bifactor model of psychopathology. Clinical Psychological Science, 7(6), 1285–1303. https://doi.org/10.1177/2167702619855035

    Article  Google Scholar 

  • Wilde, M. C. (2006). The validity of the repeatable battery of neuropsychological status in acute stroke. The Clinical Neuropsychologist, 20(4), 702–715. https://doi.org/10.1080/13854040500246901

    Article  CAS  PubMed  Google Scholar 

  • Wolf, E. J., Harrington, K. M., Clark, S. L., & Miller, M. W. (2013). Sample size requirements for structural equation models: An evaluation of power, bias, and solution propriety. Educational and Psychological Measurement, 76(6), 913–934. https://doi.org/10.1177/0013164413495237

    Article  PubMed  PubMed Central  Google Scholar 

  • Yang, C., Garrett-Mayer, E., Schneider, J. S., Gollomp, S. M., & Tilley, B. C. (2009). Repeatable battery for the assessment of neuropsychological status in early Parkinson’s disease. Movement Disorders, 24(10), 1453–1460. https://doi.org/10.1002/mds.22552

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Psychiatry, University of Texas Southwestern Medical Center, Dallas, 5323 Harry Hines Blvd, Dallas, TX, USA

    William Goette

Authors
  1. William Goette
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to William Goette.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Goette, W. Reconsidering the RBANS Factor Structure: a Systematic Literature Review and Meta-Analytic Factor Analysis. Neuropsychol Rev 30, 425–442 (2020). https://doi.org/10.1007/s11065-020-09447-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11065-020-09447-3

Keywords

Search

Navigation