Skip to main content

Advertisement

SpringerLink
Log in

High-End Specificity of the Attention-Deficit/Hyperactivity Problems Scale of the Child Behavior Checklist for Ages 1.5–5 in a Sample of Young Children with Disruptive Behavior Disorders

  • Original Article
  • Published:
Child Psychiatry & Human Development Aims and scope Submit manuscript

Abstract

In practice, ADHD is commonly assessed with parent-reports in the absence of diagnostic interviews or behavioral observations, yet little is known about how accurately rating scales can independently detect ADHD. We used receiver operating characteristic analysis to evaluate the CBCL 1.5–5 Attention-Deficit/Hyperactivity Problems scale’s ability to correctly classify the presence/absence of ADHD within a sample of young children with disruptive behavior disorders (N = 44), offering a conservative test of the scale’s ability to distinguish ADHD symptoms from neighboring problems (i.e., “high-end specificity”). Across cut scores, the scale accurately differentiated between children with and without co-occurring ADHD (AUC = 0.83, SE = 0.07). Applying a cut score in the range of 61–64 yielded the most favorable balance across diagnostic utility properties (i.e., sensitivity = 0.71, specificity = 0.91, positive predictive power = 0.88, negative predictive power = 0.78). Findings provide empirical support to bolster confidence regarding use of this scale to assess early child ADHD, even in the context of complex diagnostic profiles.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

References

  1. Centers for Disease Control and Prevention [CDC] (2017) Attention-Deficit/Hyperactivity Disorder (ADHD) Basic Information. Retrieved from https://www.cdc.gov/ncbddd/adhd/facts.html#1

  2. Danielson ML, Visser SN, Gleason MM, Peacock G, Claussen AH, Blumberg SJ (2017) A national profile of Attention-Deficit Hyperactivity Disorder diagnosis and treatment among US children aged 2 to 5 years. JDBP 38(7):455–464

    PubMed  Google Scholar 

  3. Wang PS, Berglund P, Olfson M, Pincus HA, Wells KB, Kessler RC (2005) Failure and delay in initial treatment contact after first onset of mental disorders in the national comorbidity survey replication. Arch Gen Psychiatry 62:603–613

    Article  PubMed  Google Scholar 

  4. Visser SN, Danielson ML, Bitsko RH, Holbrook JR, Kogan MD, Ghandour RM et al (2014) Trends in the parent-report of health care provider-diagnosed and medicated Attention-Deficit/Hyperactivity Disorder: United States, 2003–2011. J Am Acad Child Adolesc Psychiatry 53(1):34–46

    Article  PubMed  Google Scholar 

  5. Shaw M, Hodgkins P, Caci H, Young S, Kahle J, Woods AG et al (2012) A systematic review and analysis of long-term outcomes in attention deficit hyperactivity disorder: effects of treatment and non-treatment. BMC Med 10(99):1–15

    Google Scholar 

  6. Bendiksen B, Svensson E, Aase H, Reichborn-Kjennerud T, Friis S, Myhre AM et al (2017) Co-occurrence of ODD and CD in preschool children with symptoms of ADHD. J Atten Disord 21:741–752

    Article  PubMed  Google Scholar 

  7. Lavigne JV, LeBailly SA, Hopkins J, Gouze KR, Binns HJ (2009) The prevalence of ADHD, ODD, depression, and anxiety in a community sample of 4-year-olds. J Clin Child Adolesc Psychol 38(3):315–328

    Article  PubMed  Google Scholar 

  8. Comer JS, Chow C, Chan P, Cooper-Vince C, Wilson LAS (2013) Psychosocial treatment efficacy for disruptive behavior problems in young children: A meta-analytic examination. J Am Acad Child Adolesc Psychiatry 52:26–36

    Article  PubMed  Google Scholar 

  9. Greenhill L, Kollins S, Abikoff H, McCracken J, Riddle M, Swanson J et al (2006) Efficacy and safety of immediate-release methylphenidate treatment for preschoolers with ADHD. J Am Acad Child Adolesc Psychiatry 45:1284–1293

    Article  PubMed  Google Scholar 

  10. Kaminski JW, Claussen AH (2017) Evidence base update for psychosocial treatments for disruptive behaviors in children. J Clin Child Adolesc Psychol 46:477–499

    Article  PubMed  PubMed Central  Google Scholar 

  11. Pelham WE, Fabiano GA (2008) Evidence-based psychosocial treatments for attention-deficit/hyperactivity disorder. J Clin Child Adolesc Psychol 37:84–214

    Article  Google Scholar 

  12. American Academy of Pediatrics [AAP] (2011) ADHD: clinical practice guideline for the diagnosis, evaluation, and treatment of attention-deficit/hyperactivity disorder in children and adolescents. Pediatrics 128(5):1007–1022

    Article  Google Scholar 

  13. Langberg JM, Froehlich TE, Loren REA, Martin JE, Epstein JN (2008) Assessing children with ADHD in primary care settings. J Clin Child Adolesc Psychol 8:627–641

    Google Scholar 

  14. Pelham WE, Fabiano GA, Massetti GM (2005) Evidence-based assessment of attention deficit hyperactivity disorder in children and adolescents. J Clin Child Adolesc Psychol 34:449–476

    Article  PubMed  Google Scholar 

  15. Power TJ, Watkins MW, Anastopolous AD, Reid R, Lambert MC, DuPaul GJ (2017) Multi-informant assessment of ADHD symptom-related impairments among children and adolescents. J Clin Child Adolesc Psychol 46:661–674

    Article  PubMed  Google Scholar 

  16. Visser SN, Zablotsky B, Holbrook JR, Danielson ML, Bitsko RH (2015) Diagnostic experiences of children with Attention-Deficit/Hyperactivity Disorder. Natl Health Stat Rep 81:1–7

    Google Scholar 

  17. Achenbach TM, Rescorla LA (2000) Child Behavior Checklist for Ages 1.5–5. ASEBA, Vermont

    Google Scholar 

  18. Achenbach TM, Rescorla LA (2000) Child Behavior Checklist for Ages 6–18. ASEBA, Vermont

    Google Scholar 

  19. Chen WJ, Faraone SV, Biederman J, Tsuang MT (1994) Diagnostic accuracy of the Child Behavior Checklist scales for attention-deficit hyperactivity disorder: A receiver-operating characteristic analysis. J Consult Clin Psychol 62(5):1017–1025

    Article  PubMed  Google Scholar 

  20. Achenbach TM (2013) DSM-Oriented guide for the Achenbach system of empirically based assessment (ASEBA). University of Vermont Research Center for Children, Youth, and Families, Burlington

    Google Scholar 

  21. Rescorla LA (2005) Assessment of young children using the Achenbach System of Empirically Based Assessment (ASEBA). Ment Retard Dev Disabil Res Rev 11:226–237

    Article  PubMed  Google Scholar 

  22. Achenbach TM, Rescorla LA (2001) Manual for ASEBA preschool forms & profiles. Research Center for Children, Youth, and Families, University of Vermont, Burlington

    Google Scholar 

  23. Kristensen S, Henriksen TB, Bilenberg N (2010) The Child Behavior Checklist for Ages 1.5–5 (CBCL/1(1/2)-5): assessment and analysis of parent- and caregiver-reported problems in a population-based sample of Danish preschool children. Nord J Psychiatry 64(3):203–209

    Article  Google Scholar 

  24. Comer JS, Kendall PC (2005) High-end specificity of the Children’s Depression Inventory (CDI) in a sample of anxiety-disordered youth. Depress Anxiety 22:11–19

    Article  PubMed  Google Scholar 

  25. Kendall PC, Hollon SD, Beck AT, Hammen CL, Ingram RE (1987) Issues and recommendations regarding use of the Beck Depression Inventory. Cognit Ther Res 11(3):289–299

    Article  Google Scholar 

  26. Keenan K, Wakschlag LS, Danis B, Hill C, Humphries M, Duax J et al (2007) Further evidence of the reliability and validity of DSM-IV ODD and CD in preschool children. J Am Acad Child Adolesc Psychiatry 26(4):457–468

    Article  Google Scholar 

  27. Orvaschel H, Puig-Antich J (1995) Schedule for affective disorders and Schizophrenia for school-age children-epidemiologic 5th Version. Ft. Nova University, Lauderdale

    Google Scholar 

  28. Bunte TL, Schoemaker K, Hessen DJ, van der Heijden PG, Matthys W (2013) Clinical usefulness of the Kiddie-Disruptive Behavior Disorder Schedule in the diagnosis of DBD and ADHD in preschool children. J Abnorm Child Pyschol 41:681–690

    Article  Google Scholar 

  29. Hart KC, Ros R, Gonzalez V, Graziano PA (2018) Parent perceptions of medication treatment for preschool children with ADHD. Child Psychiatry Hum Dev 49(1):155–162

    Article  PubMed  Google Scholar 

  30. Leblanc N, Boivin M, Dionne G, Brengden M, Vitaro F, Tremblay RE et al (2008) The development of hyperactive-impulsive behaviors during the preschool years: the predictive validity of parental assessments. J Abnorm Psychol 36:977–987

    Article  Google Scholar 

  31. Martel MM (2016) Dispositional trait types of ADHD in young children. J Atten Disord 20:43–52

    Article  PubMed  Google Scholar 

  32. Zweig MH, Campbell G (1993) Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine. Clin Chem 39(4):561–577

    PubMed  Google Scholar 

  33. Obuchowski NA (2005) Fundamentals of clinical research for radiologists. Am J Roentgenol 184(2):364–372

    Article  Google Scholar 

  34. Matthey S, Patrovski P (2002) The Children’s depression inventory: errors in cutoff scores for screening purposes. Psychol Assess 14:146–149

    Article  PubMed  Google Scholar 

  35. Hoagwood K, Kelleher KJ, Feil M, Comer D (2000) Treatment services for children with ADHD: a national perspective. J Am Acad Child Adolesc Psychiatry 39:198–206

    Article  PubMed  Google Scholar 

  36. Office of the Surgeon General, Center for Mental Health Services, National Institute of Mental Health (2001) Mental health: culture, race, and ethnicity: a supplement to mental health: a report of the Surgeon General. Substance Abuse and Mental Health Services Administration, Rockville

    Google Scholar 

  37. Breslau J, Kendler KS, Su M, Gaxiola-Aguilar S, Kessler RC (2005) Lifetime risk and persistence of psychiatric disorders across ethnic groups in the United States. Psychol Med 35(3):317–327

    Article  PubMed  PubMed Central  Google Scholar 

  38. Williams DR, González HM, Neighbors H, Nesse R, Abelson JM, Sweetman J, Jackson JS (2007) Prevalence and distribution of major depressive disorder in African Americans, Caribbean blacks, and non-Hispanic Whites: results from the National Survey of American Life. Arch Gen Psychiatry 64(3):305–315

    Article  PubMed  Google Scholar 

  39. American Psychiatric Association [APA] (2013) Diagnostic and statistical manual of mental disorders: DSM-5. American Psychiatric Association, Washington, D.C

    Book  Google Scholar 

  40. Elkins RM, Carpenter AL, Pincus DB, Comer JS (2014) Inattention symptoms and the diagnosis of comorbid attention-deficit/hyperactivity disorder among youth with generalized anxiety disorder. J Anxiety Disord 28(8):754–760

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Funding

This work was supported by the National Institutes of Health (NIH) K23 MH090247 (PI: Comer).

Author information

Authors and Affiliations

  1. Mental Health Interventions and Technology (MINT) Program, Center for Children and Families, Department of Psychology, Florida International University, 11200 S.W. 8th Street, Miami, FL, 33199, USA

    Natalie Hong & Jonathan S. Comer

Authors
  1. Natalie Hong
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jonathan S. Comer
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jonathan S. Comer.

Ethics declarations

Conflict of interest

Dr. Comer receives royalties from Macmillan Learning. No other authors have financial interests to declare.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hong, N., Comer, J.S. High-End Specificity of the Attention-Deficit/Hyperactivity Problems Scale of the Child Behavior Checklist for Ages 1.5–5 in a Sample of Young Children with Disruptive Behavior Disorders. Child Psychiatry Hum Dev 50, 222–229 (2019). https://doi.org/10.1007/s10578-018-0834-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10578-018-0834-4

Keywords

Search

Navigation