Abstract
We compared 2 rating scales with different manic symptom items on diagnostic accuracy for detecting pediatric bipolar spectrum disorder (BPSDs) in outpatient mental health clinics. Participants were 681 parents/guardians of eligible children (465 male, mean age = 9.34) who completed the Parent General Behavior Inventory-10-item Mania (PGBI-10 M) and mania subscale of the Child and Adolescent Symptom Inventory-Revised (CASI-4R). Diagnoses were based on KSADS interviews with parent and youth. Receiver operating characteristic (ROC) analyses and diagnostic likelihood ratios (DLRs) determined discriminative validity and provided clinical utility, respectively. Logistic regressions tested for incremental validity in the CASI-4R mania subscale and PGBI-10 M in predicting youth BPSD status above and beyond demographic and common diagnostic comorbidities. Both CASI-4R and PGBI-10 M scales significantly distinguished BPSD (N = 160) from other disorders (CASI-4R: Area under curve (AUC) = .80, p < 0.0005; PGBI-10 M: AUC = 0.79, p < 0.0005) even though scale items differed. Both scales performed equally well in differentiating BPSDs (Venkatraman test p > 0.05). Diagnostic likelihood ratios indicated low scores on either scale (CASI: 0–5; PGBI-10 M: 0–6) cut BPSD odds to 1/5 of those with high scores (CASI DLR- = 0.17; PGBI-10 M DLR- = 0.18). High scores on either scale (CASI: 14+; PGBI-10 M: 20+) increased BPSD odds about fourfold (CASI DLR+ = 4.53; PGBI-10 M DLR+ = 3.97). Logistic regressions indicated the CASI-4R mania subscale and PGBI-10 M each provided incremental validity in predicting youth BPSD status. The CASI-4R is at least as valid as the PGBI-10 M to help identify BPSDs, and can be considered as part of an assessment battery to screen for pediatric BPSDs.
Similar content being viewed by others
References
Achenbach, T. M., & Rescorla, L. A. (2001). Manual for the ASEBA School-Age Forms & Profiles. Burlington, VT: University of Vermont.
American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders (4th ed., text rev.). doi: 10.1176/appi.books.9780890423349.
American Psychiatric Association (2013). Diagnostic and statistical manual of mental disorders: DSM-5 (5th ed.). Arlington, VA: American Psychiatric Publishing.
Axelson, D., Birmaher, B., Strober, M., Gill, M. K., Valeri, S., Chiappetta, L., et al. (2006). Phenomenology of children and adolescents with bipolar spectrum disorders. Archives of General Psychiatry, 63(10), 1139.
Carlson, G. A., & Klein, D. N. (2014). How to understand divergent views on bipolar disorder in youth. Annual Review of Clinical Psychology, 10, 529–551. doi:10.1146/annurev-clinpsy-032813-153702.
Carlson, G. A., & Youngstrom, E. A. (2003). Clinical implications of pervasive manic symptoms in children. Biological Psychiatry, 53, 1050–1058.
Chilakamarri, J. K., Filkowski, M. M., & Ghaemi, S. N. (2011). Misdiagnosis of bipolar disorder in children and adolescents: a comparison with ADHD and major depressive disorder. Annals of Clinical Psychiatry, 23, 25–29.
Conners, C. K. (1997). Conners’ Rating Scales - Revised: Short Form. North Tonawanda, NY: Multi-Heath Systems.
DelBello, M. P., & Geller, B. (2001). Review of studies of child and adolescent offspring of bipolar parents. Bipolar Disorders, 3, 325–334. doi:10.1034/j.1399-5618.2001.30607.x.
Denicoff, K. D., Smith-Jackson, E. E., Disney, E. R., Suddath, R. L., Leverich, G. S., & Post, R. M. (1997). Preliminary evidence of the reliability and validity of the prospective life-chart methodology (LCM-p). Journal of Psychiatric Research, 31, 593–603.
Depue, R. A., Slater, J. F., Wolfstetter-Kausch, H., Klein, D., Goplerud, E., & Farr, D. (1981). A behavioral paradigm for identifying persons at risk for bipolar depressive disorder: a conceptual framework and five validation studies. Journal of Abnormal Psychology, 90, 381–437. doi:10.1037//0021-843X.90.5.381.
Diler, R. S., Birmaher, B., Axelson, D., Goldstein, B., Gill, M., Strober, M., et al. (2009). The child behavior checklist (CBCL) and the CBCL-bipolar phenotype are not useful in diagnosing pediatric bipolar disorder. Journal of Child and Adolescent Psychopharmacology, 19, 23–30. doi:10.1089/cap.2008.067.
Findling, R. L., Youngstrom, E. A., Fristad, M. A., Birmaher, B., Kowatch, R. A., Arnold, L. E., et al. (2010). Characteristics of children with elevated symptoms of mania: the longitudinal assessment of manic symptoms (LAMS) study. Journal of Clinical Psychiatry, 71(12), 1664–1672. doi:10.4088/JCP.09m05859yel.
Gadow, K. D., & Drabick, D. A. (2012). Anger and irritability symptoms among youth with ODD: cross-informant versus source-exclusive syndromes. Journal of Abnormal Child Psychology, 40(7), 1073–1085. doi:10.1007/s10802-012-9637-4.
Gadow, K. D., & Sprafkin, J. (2005). Child and adolescent symptom inventory-4R. Stony Brook, NY: Checkmate Plus.
Gadow, K. D., & Sprafkin, J. (2008). Adolescent symptom inventory-4 screening and norms manual. Stony Brook, NY: Checkmate Plus.
Galanter, C. A., & Leibenluft, E. (2008). Frontiers between attention deficit hyperactivity disorder and bipolar disorder. Child and Adolescent Psychiatric Clinics of North America, 17, 325–346 viii-ix. doi:10.1016/j.chc.2007.11.001.
Geller, B., Warner, K., Williams, M., & Zimerman, B. (1998). Prepubertal and young adolescent bipolarity versus ADHD: assessment and validity using the WASH-U-KSADS, CBCL and TRF. Journal of Affective Disorders, 51, 93–100. doi:10.1016/S0165.
Geller, B., Zimerman, B., Williams, M., Bolhofner, K., Craney, J. L., DelBello, M. P., & Soutullo, C. (2001). Reliability of the Washington University in St. Louis kiddie schedule for affective disorders and schizophrenia (WASH-U-KSADS) mania and rapid cycling sections. Journal of the American Academy of Child and Adolescent Psychiatry, 40(4), 450–455. doi:10.1097/00004583-200104000-00014.
Geller, B., Zimerman, B., Williams, M., Delbello, M. P., Bolhofner, K., Craney, J. L., et al. (2002). DSM-IV mania symptoms in a prepubertal and early adolescent bipolar disorder phenotype compared to attention-deficit hyperactive and normal controls. Journal of Child and Adolescent Psychopharmacology, 12, 11–25.
Ghaemi, S. N., Boiman, E. E., & Goodwin, F. K. (1999). Kindling and second messengers: an approach to the neurobiology of recurrence in bipolar disorder. Biological Psychiatry, 45(2), 137–144. doi:10.1016/S0006-3223(98)00256-X.
Goldstein, T. R., Ha, W., Axelson, D. A., Goldstein, B. I., Liao, F., Gill, M. K., et al. (2012). Predictors of prospectively examined suicide attempts among youth with bipolar disorder. Archives of General Psychiatry, 69(11), 1113–1122. doi:10.1001/archgenpsychiatry.2012.650.
Goodman, R. (1997). The strengths and difficulties questionnaire: a research note. Journal of Child Psychology and Psychiatry, 38(5), 581–586.
Goodwin, F. K., & Jamison, K. R. (2007). Manic-depressive illness: Bipolar disorders and recurrent depression. New York, NY: Oxford University Press.
Guyatt, G. H., & Rennie, D. (2002). Users’ guides to the medical literature. Chicago, IL: AMA Press.
Harrell, F. E., Califf, R. M., Pryor, D. B., Lee, K. L., & Rosati, R. A. (1982). Evaluating the yield of medical tests. JAMA, 247(18), 2543–2546. doi:10.1001/jama.1982.03320430047030.
Hauser, M., Galling, B., & Correll, C. U. (2013). Suicidal ideation and suicide attempts in children and adolescents with bipolar disorder: a systematic review of prevalence and incidence rates, correlates, and targeted interventions. Bipolar Disorders, 15, 507–523. doi:10.1111/bdi.12094.
Henry, D. B., Pavuluri, M. N., Youngstrom, E. A., & Birmaher, B. (2008). Accuracy of brief and full forms of the child mania rating scale. Journal of Clinical Psychology, 64(4), 368–381. doi:10.1002/jclp.20464.
Hirschfeld, R. M., Calabrese, J. R., Weissman, M. M., Reed, M., Davies, M. A., Frye, M. A., et al. (2003). Screening for bipolar disorder in the community. Journal of Clinical Psychiatry, 64(1), 53–59. doi:10.4088/JCP.v64n0111.
Horwitz, S. M., Demeter, C. A., Pagano, M. E., Youngstrom, E. A., Fristad, M. A., Arnold, L. E., et al. (2010). Longitudinal assessment of manic symptoms (LAMS) study: background, design, and initial screening results. Journal of Clinical Psychiatry, 71(11), 1511–1517. doi:10.4088/JCP.09m05835yel.
Hosmer, D. W., & Lemeshow, S. (2000). Applied logistic regression. New York: Wiley.
Jaeschke, R., Guyatt, G. H., & Sackett, D. L. (1994). Users’ guides to the medical literature. III. How to use an article about a diagnostic test. B. What are the results and will they help me in caring for my patients?. JAMA: The Journal of the American Medical Association, 271(9), 703–707. doi:10.1001/jama.1994.03510290.
Jenkins, M. M., Youngstrom, E. A., Washburn, J. J., & Youngstrom, J. K. (2011). Evidence-based strategies improve assessment of pediatric bipolar disorder by community practitioners. Professional Psychology: Research and Practice, 42, 121–129.
Jensen-Doss, A., Youngstrom, E. A., Youngstrom, J. K., Feeny, N. C., & Findling, R. L. (2014). Predictors and moderators of agreement between clinical and research diagnoses for children and adolescents. Journal of Consulting and Clinical Psychology, 82(6), 1151–1162. doi:10.1037/a0036657.
Joseph, M., Youngstrom, E. A., & Soares, J. C. (2009). Antidepressant-coincident mania in children and adolescents treated with selective serotonin reuptake inhibitors. Future Neurology, 4(1), 87–102. doi:10.2217/14796708.4.1.87.
Kahana, S. Y., Youngstrom, E. A., Findling, R. L., & Calabrese, J. R. (2003). Employing parent, teacher, and youth self-report checklists in identifying pediatric bipolar spectrum disorders: an examination of diagnostic accuracy and clinical utility. Journal of Child and Adolescent Psychopharmacology, 13, 471–488. doi:10.1089/104454603322724869.
Kaufman, J., Birmaher, B., Brent, D., Rao, U., Flynn, C., Moreci, P., et al. (1997). Schedule for affective disorders and schizophrenia for school-age children-present and lifetime version (K-SADS-PL): initial reliability and validity data. Journal of the American Academy of Child and Adolescent Psychiatry, 36(7), 980–988. doi:10.1097/00004583-199707000-00021.
Marchand, W. R., Wirth, L., & Simon, C. (2006). Delayed diagnosis of pediatric bipolar disorder in a community mental health setting. Journal of Psychiatric Practice, 12(2), 128–133. doi:10.1097/00131746-200603000-00011.
Miller, C. J., Johnson, S. L., Kwapil, T. R., & Carver, C. S. (2011). Three studies on self-report scales to detect bipolar disorder. Journal of Affective Disorders, 128(3), 199–210. doi:10.1016/j.jad.2010.07.012.
Obuchowski, N. A. (2003). Receiver operating characteristic curves and their use in radiology. Radiology, 229, 3–8. doi:10.1148/radiol.2291010898.
Pacchiarotti, I., Bond, D. J., Baldessarini, R. J., Nolen, W. A., Grunze, H., Licht, R. W., et al. (2013). The International Society for Bipolar Disorders (ISBD) task force report on antidepressant use in bipolar disorders. American Journal of Psychiatry, 170(11), 1249–1262. doi:10.1176/appi.ajp.2013.13020185.
Pliszka, S. R., Sherman, J. O., Barrow, M. V., & Irick, S. (2000). Affective disorder in juvenile offenders: a preliminary study. The American Journal of Psychiatry, 157(1), 130–132. doi:10.1176/ajp.157.1.130.
R Development Core Team. (2014). A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. Retrieved from http://www.R-project.org .
Robin, X., Turck, N., Hainard, A., Tiberti, N., Lisacek, F., Sanchez, J. C., & Muller, M. (2011). pROC: an open-source package for R and S+ to analyze and compare ROC curves. BMC Bioinformatics, 12, 77. doi:10.1186/1471-2105-12-77.
Sprafkin, J., Gadow, K. D., Salisbury, H., Schneider, J., & Loney, J. (2002). Further evidence of reliability and validity of the child symptom inventory-4: parent checklist in clinically referred boys. Journal of Clinical Child and Adolescent Psychology, 31(4), 513–524.
Sprafkin, J., Steinberg, E., Gadow, K. D., & Drabick, D. A. (2013). Agreement among categorical, dimensional, and impairment criteria for ADHD and common comorbidities. Journal of Attention Disorders, 1–13. doi:10.1177/1087054712475083.
Stewart, A. J., Theodore-Oklota, C., Hadley, W., Brown, L. K., Donenberg, G., DiClemente, R., & Project, S. S. G (2012). Mania symptoms and HIV-risk behavior among adolescents in mental health treatment. Journal of Clinical Child and Adolescent Psychology, 41(6), 803–810. doi:10.1080/15374416.2012.675569.
Straus, S. E., Glasziou, P., Richardson, W. S., & Haynes, R. B. (2011). Evidence-based medicine: How to practice and teach evidence-based medicine. Edinburgh: Elsevier.
Swets, J. A., Dawes, R. M., & Monahan, J. (2000). Better decisions through science. Scientific American, 283(4), 82–87. doi:10.1038/scientificamerican1000-82.
Van Meter, A. R., Moreira, A. L., & Youngstrom, E. A. (2011). Meta-analysis of epidemiologic studies of pediatric bipolar disorder. Journal of Clinical Psychiatry, 72(9), 1250–1256. doi:10.4088/JCP.10m06290.
Van Meter, A., You, D.S., Halverson, T., Youngstrom, E.A., Birmaher, B., Fristad, M.A., Kowatch, R.A., Horwitz, S.M., Frazier, T.W., Arnold, L.E., Findling, R.L., the LAMS Group (2016). Diagnostic efficiency of caregiver report on the SCARED for identifying youth anxiety disorders in outpatient settings. Journal of Clinical Child and Adolescent Psychology (in press).
Venkatraman, E. S. (2000). A permutation test to compare receiver operating characteristic curves. Biometrics, 56(4), 1134–1138. doi:10.1111/j.0006-341X.2000.01134.x.
Wagner, K. D., Hirschfeld, R. M., Emslie, G. J., Findling, R. L., Gracious, B. L., & Reed, M. L. (2006). Validation of the mood disorder questionnaire for bipolar disorders in adolescents. Journal of Clinical Psychiatry, 67(5), 827–830. doi:10.4088/JCP.v67n0518.
Weintraub, M., Youngstrom, E. A., Marvin, S. E., Podell, J. L., Walshaw, P. D., Kim, E. Y., et al. (2014). Diagnostic profiles and clinical characteristics of youth referred to a pediatric mood disorders clinic. Journal of Psychiatric Practice, 20(2), 154–162. doi:10.1097/01.pra.0000445251.20875.47.
Youngstrom, E. A. (2014). A primer on receiver operating characteristic analysis and diagnostic efficiency statistics for pediatric psychology: We are ready to ROC. Journal of Pediatric Psychology. doi:10.1093/jpepsy/jst062.
Youngstrom, E. A., Findling, R. L., Danielson, C. K., & Calabrese, J. R. (2001). Discriminative validity of parent report of hypomanic and depressive symptoms on the General Behavior Inventory. Psychological Assessment, 13(2), 267–276. doi:10.1037/1040-3590.13.2.267 .http://psycnet.apa.org/
Youngstrom, E. A., Findling, R. L., Calabrese, J. R., Gracious, B. L., Demeter, C., Bedoya, D. D., & Price, M. (2004). Comparing the diagnostic accuracy of six potential screening instruments for bipolar disorder in youths aged 5 to 17 years. Journal of the American Academy of Child and Adolescent Psychiatry, 43(7), 847–858. doi:10.1097/01.chi.0000125091.35109.1e.
Youngstrom, E. A., Meyers, O., Demeter, C., Youngstrom, J. K., Morello, L., Piiparinen, R., et al. (2005). Comparing diagnostic checklists for pediatric bipolar disorder in academic and community mental health settings. Bipolar Disorders, 7, 507–517. doi:10.1111/j.1399-5618.2005.00269.x.
Youngstrom, E. A., Meyers, O., Youngstrom, J. K., Calabrese, J. R., & Findling, R. L. (2006). Comparing the effects of sampling designs on the diagnostic accuracy of eight promising screening algorithms for pediatric bipolar disorder. Biological Psychiatry, 60(9), 1013–1019. doi:10.1016/j.biopsych.2006.06.023.
Youngstrom, E. A., Frazier, T. W., Demeter, C., Calabrese, J. R., & Findling, R. L. (2008a). Developing a 10-item mania scale from the parent general behavior inventory for children and adolescents. Journal of Clinical Psychiatry, 69(5), 831–839. doi:10.4088/JCP.v69n0517.
Youngstrom, E. A., Joseph, M. F., & Greene, J. (2008b). Comparing the psychometric properties of multiple teacher report instruments as predictors of bipolar disorder in children and adolescents. Journal of Clinical Psychology, 64, 382–401. doi:10.1002/jclp.20462.
Youngstrom, E. A., Freeman, A. J., & Jenkins, M. M. (2009). The assessment of children and adolescents with bipolar disorder. Child & Adolescent Psychiatric Clinics of North America, 18(2), 353–390 viii-ix. doi:10.1016/j.chc.2008.12.002.
Youngstrom, E. A., Jenkins, M. M., Jensen-Doss, A., & Youngstrom, J. K. (2012). Evidence-based assessment strategies for pediatric bipolar disorder. Israel Journal of Psychiatry & Related Sciences, 49, 15–27.
Youngstrom, E. A., Choukas-Bradley, S., Calhoun, C. D., & Jensen-Doss, A. (2014). Clinical guide to the evidence-based assessment approach to diagnosis and treatment. Cognitive and Behavioral Practice. doi:10.1016/j.cbpra.2013.12.005.
Youngstrom, E. A., Genzlinger, J., Egerton, G., & Van Meter, A. R. (2015). Multivariate meta-analysis of the discriminative validity of caregiver, youth and teacher rating scales for pediatric bipolar disorder: mother knows best about mania. Archives of Scientific Psychology, 3(1), 112–137. doi:10.1037/arc0000024.
Zhou, X., Obuchowski, N. A., & McClish, D. K. (2011). Statistical methods in diagnostic medicine. Hoboken, NJ: Wiley.
Author information
Authors and Affiliations
Consortia
Corresponding author
Ethics declarations
Funding
This study was funded in part by National Institutes of Health (grant number NIH R01 MH073967; PI: R.L. Findling).
Conflict of Interest
Mian-Li Ong declares that he has no conflict of interest. Eric Youngstrom has consulted with Pearson, Western Psychological Services, Johnson & Johnson, Lundbeck and Otsuka about psychological assessment. Jesselyn Jia-Xin Chua declares that she has no conflict of interest. Tate Halverson declares that she has no conflict of interest. Sarah Horwitz declares that she has no conflict of interest. Amy Storfer-Isser declares that she has no conflict of interest. Thomas Frazier has received federal funding or research support from, acted as a consultant to, received travel support from, and/or received a speaker’s honorarium from the Cole Family Research Fund, Simons Foundation, Ingalls Foundation, Forest Laboratories, Ecoeos, IntegraGen, Kugona LLC, Shire Development, Bristol-Myers Squibb, National Institutes of Health, and the Brain and Behavior Research Foundation. Mary Fristad receives royalties from American Psychiatric Press, CFPSI and Guilford Press and honoraria from American Occupational Therapy Association and Physicians’ Post-Graduate Press. Eugene Arnold has received research funding from Curemark, Forest, Lilly, Neuropharm, Novartis, Noven, Shire, and YoungLiving (as well as NIH and Autism Speaks) and has consulted with or been on advisory boards for Arbor, Gowlings, Neuropharm, Novartis, Noven, Organon, Otsuka, Pfizer, Roche, Seaside Therapeutics, Sigma Tau, Shire, Tris Pharma, and Waypoint and received travel support from Noven. Mary Phillips is a consultant for Roche Pharmaceuticals. Robert Kowatch declares that he has no conflict of interest. Robert Findling receives or has received research support, acted as a consultant and/or served on a speaker’s bureau for Alcobra, American Academy of Child & Adolescent Psychiatry, American Physician Institute, American Psychiatric Press, AstraZeneca, Bracket, Bristol-Myers Squibb, CogCubed, Cognition Group, Coronado Biosciences, Dana Foundation, Elsevier, Forest, GlaxoSmithKline, Guilford Press, Johns Hopkins University Press, Johnson and Johnson, Jubilant Clinsys, KemPharm, Lilly, Lundbeck, Merck, NIH, Neurim, Novartis, Noven, Otsuka, Oxford University Press, Pfizer, Physicians Postgraduate Press, Purdue, Rhodes Pharmaceuticals, Roche, Sage, Shire, Sunovion, Supernus Pharmaceuticals, Transcept Pharmaceuticals, Validus, and WebMD.
Ethical Approval
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed Consent
Informed consent was obtained from all individual participants included in the study.
Additional information
This research was supported in part by NIH R01 MH073967 (Coordinating PI: R.L. Findling).
Rights and permissions
About this article
Cite this article
Ong, ML., Youngstrom, E.A., Chua, J.JX. et al. Comparing the CASI-4R and the PGBI-10 M for Differentiating Bipolar Spectrum Disorders from Other Outpatient Diagnoses in Youth. J Abnorm Child Psychol 45, 611–623 (2017). https://doi.org/10.1007/s10802-016-0182-4
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10802-016-0182-4