Skip to main content

Advertisement

Log in

Multimodal Treatments for Childhood Attention-deficit/Hyperactivity Disorder: Interpreting Outcomes in the Context of Study Designs

  • Published:
Clinical Child and Family Psychology Review Aims and scope Submit manuscript

Abstract

The goal of this article was to outline issues critical to evaluating the literature on incremental benefit of multiple effective treatments used together, vs. a single effective treatment, for childhood ADHD. These issues include: (1) sequencing and dosage of treatments being combined and compared; (2) difficulty drawing valid conclusions about individual components of treatment when treatment packages are employed; (3) differing results emerging from measurement tools that purportedly measure the same domain; and (4) the resultant difficulty in reaching a summary conclusion when multiple outcome measures yielding conflicting results are used. The implications of these issues for the design and conduct of future studies are discussed, and recommendations are made for future research.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

Notes

  1. Of course, intensive behavioral therapies, similarly to high doses of medication, have limitations. Specifically, aside from the limited availability and high cost of intensive, complex, direct contingency management programs (see Barkley 2000, for a discussion of this issue in regard to the MTA study), an added difficulty for psychosocial treatment generally is that gains are difficult to maintain outside the treatment setting (Richters et al. 1995). Indeed, generalization of gains and persistence of effects following participation in an intensive behavioral treatment program (e.g., Pelham and Hoza 1996; Pelham et al. 2005b) has not been adequately studied. In addition, follow-up studies into adolescence and young adulthood of children who participated in intensive behavioral treatments as children are rare, and have only recently begun to appear in the literature. Consistent with other long-term follow-up studies of ADHD samples (for a brief review, see Richters et al. 1995), these studies document continuing adjustment problems and risky behaviors into adolescence and adulthood relative to controls (e.g., Flory et al. 2006; Molina et al. 2007; Thompson et al. 2007). This suggests that short-term intensive behavioral treatment, like medication, has limitations.

References

  • Abikoff, H., Hechtman, L., Klein, R. G., Gallagher, R., Fleiss, K., Etcovitch, J., et al. (2004a). Social functioning in children with ADHD treated with long-term methylphenidate and multimodal psychosocial treatment. Journal of the American Academy of Child and Adolescent Psychiatry, 43, 820–829.

    Article  PubMed  Google Scholar 

  • Abikoff, H., Hechtman, L., Klein, R. G., Weiss, G., Fleiss, K., Etcovitch, J., et al. (2004b). Symptomatic improvement in children with ADHD treated with long-term methylphenidate and multimodal psychosocial treatment. Journal of the American Academy of Child and Adolescent Psychiatry, 43, 802–811.

    Article  PubMed  Google Scholar 

  • American Psychiatric Association (1994). Diagnostic and statistical manual of mental disorders (4th ed.). Washington, DC: Author.

    Google Scholar 

  • Arnold, L. E., Chuang, S., Davies, M., Abikoff, H. B., Conners, C. K., Elliott, G. R., et al. (2004). Nine months of multicomponent behavioral treatment for ADHD and effectiveness of MTA fading procedures. Journal of Abnormal Child Psychology, 32, 39–51.

    Article  PubMed  Google Scholar 

  • Barkley, R. A. (2000). Commentary on the multimodal treatment study of children with ADHD. Journal of Abnormal Child Psychology, 28, 595–599.

    Article  PubMed  Google Scholar 

  • Barkley, R. A., Shelton, T. L., Crosswait, C., Moorehouse, M., Fletcher, K., Barrett, S., et al. (2000). Multi-method psycho-educational intervention for preschool children with disruptive behavior: Preliminary results at post-treatment. Journal of Child Psychology and Psychiatry, 41, 319–332.

    Article  PubMed  Google Scholar 

  • Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Cunningham, C. E. (1999). In the wake of the MTA: Charting a new course for the study and treatment of children with attention-deficit hyperactivity disorder. Canadian Journal of Psychiatry, 44, 999–1006.

    Google Scholar 

  • Ercan, E. S., Varan, A., & Deniz, U. (2005). Effects of combined treatment on Turkish children diagnosed with attention-deficit/hyperactivity disorder: A preliminary report. Journal of Child and Adolescent Psychopharmacology, 15, 203–219.

    Article  PubMed  Google Scholar 

  • Flory, K., Molina, B. S. G., Pelham, W. E., Gnagy, E., & Smith, B. (2006). Childhood ADHD predicts risky sexual behavior in young adulthood. Journal of Clinical Child & Adolescent Psychology, 35, 571–577.

    Article  Google Scholar 

  • Hechtman, L., Abikoff, H., Klein, R. G., Greenfield, B., Etcovitch, J., Cousins, L., et al. (2004a). Children with ADHD treated with long-term methylphenidate and multimodal psychosocial treatment: Impact on parental practices. Journal of the American Academy of Child and Adolescent Psychiatry, 43, 830–838.

    Article  PubMed  Google Scholar 

  • Hechtman, L., Abikoff, H., Klein, R. G., Weiss, G., Respitz, C., Kouri, J., et al (2004b). Academic achievement and emotional status of children with ADHD treated with long-term methylphenidate and multimodal psychosocial treatment. Journal of the American Academy of Child and Adolescent Psychiatry, 43, 812–819.

    Article  PubMed  Google Scholar 

  • Hoza, B., Gerdes, A. C., Mrug, S., Hinshaw, S. P., Bukowski, W. M., Gold, J. A., et al. (2005). Peer-assessed outcomes in the multimodal treatment study of children with attention deficit hyperactivity disorder. Journal of Clinical Child and Adolescent Psychology, 34, 74–86.

    Article  PubMed  Google Scholar 

  • Hoza, B., Johnston, C., Pillow, D. R., & Ascough, J. C. (2006). Predicting treatment response for childhood attention-deficit/hyperactivity disorder: Introduction of a heuristic model to guide research. Applied and Preventive Psychology, 11, 215–229.

    Article  Google Scholar 

  • Hoza, B., Kaiser, N. M., & Hurt, E. (in press). Evidence-based treatments for attention-deficit/hyperactivity disorder (ADHD). In M. Roberts, D. Elkin, & R. Steele (Eds.), Handbook of evidence based therapies for children and adolescents. New York: Springer.

  • Hoza, B., Owens, J. S., & Pelham, W. E. (1999). Attention-deficit/hyperactivity disorder. In R.T. Ammerman, M. Hersen, & C. G. Last (Eds.), Handbook of prescriptive treatments for children and adolescents (2nd ed., pp. 63–83). Boston: Allyn & Bacon.

    Google Scholar 

  • Jensen, P. S., Hinshaw, S. P., Kraemer, H. C., Lenora N., Newcorn J. H., Abikoff, H. B., et al. (2001). ADHD comorbidity findings from the MTA study: Comparing comorbid subgroups. Journal of the American Academy of Child & Adolescent Psychiatry, 40, 147–158.

    Article  Google Scholar 

  • Klein, R. G., & Abikoff, H. (1997). Behavior therapy and methylphenidate in the treatment of children with ADHD. Journal of Attention Disorders, 2, 89–114.

    Article  Google Scholar 

  • Klein, R. G., Abikoff, H., Hechtman, L., & Weiss, G. (2004). Design and rationale of controlled study of long-term methylphenidate and multimodal psychosocial treatment in children with ADHD. Journal of the American Academy of Child and Adolescent Psychiatry, 43, 792–801.

    Article  PubMed  Google Scholar 

  • Kolko, D. J., Bukstein, O. G., & Barron, J. (1999). Methylphenidate and behavior modification in children with ADHD and comorbid ODD or CD: Main and incremental effects across settings. Journal of the American Academy of Child and Adolescent Psychiatry, 38, 578–586.

    Article  PubMed  Google Scholar 

  • Mash, E. J., & Hunsley, J. (2005). Evidence-based assessment of child and adolescent disorders: Issues and challenges. Journal of Clinical Child & Adolescent Psychology, 34, 362–379.

    Article  Google Scholar 

  • Molina, B. S. G., Pelham, W. E., Gnagy, E. M., Thompson, A. L., & Marshal, M. P. (2007). Attention-deficit/hyperactivity disorder risk for heavy drinking and alcohol use disorder is age specific. Alcoholism: Clinical and Experimental Research, 31, 643–654.

    Google Scholar 

  • Mrug, S., Hoza, B., & Gerdes, A. C. (2001). Children with attention-deficit/hyperactivity disorder: Peer relationships and peer-oriented interventions. In W. Damon (Series Ed.), D. W. Nangle, & C. A. Erdley (Eds.), New directions for child and adolescent development: No. 91. The role of friendship in psychological adjustment (pp. 51–77). San Francisco: Jossey-Bass.

  • MTA Cooperative Group (1999). A 14-month randomized clinical trial of treatment strategies for attention-deficit/hyperactivity disorder. Archives of General Psychiatry, 56, 1073–1086.

    Article  Google Scholar 

  • Owens, J. S., & Hoza, B. (2003). The role of inattention and hyperactivity/impulsivity in the positive illusory bias. Journal of Consulting and Clinical Psychology, 71, 680–691.

    Article  PubMed  Google Scholar 

  • Pelham, W. E. (1999). The NIMH multimodal treatment study for attention-deficit hyperactivity disorder: Just say yes to drugs alone? Canadian Journal of Psychiatry, 44, 981–990.

    Google Scholar 

  • Pelham, W. E., Burrows-MacLean, L., Gnagy, E. M., Fabiano, G. A., Coles, E. K., Tresco, K. E., et al. (2005a). Transdermal methylphenidate, behavioral, and combined treatment for children with ADHD. Experimental and Clinical Psychopharmacology, 13, 111–126.

    Article  PubMed  Google Scholar 

  • Pelham, W. E., Erhardt, D., Gnagy, E. M., Greiner, A. R., Arnold, L. E., Abikoff, H. B., et al. (2007). Parent and teacher evaluation of treatment in the MTA: Consumer satisfaction and perceived effectiveness. University at Buffalo (submitted).

  • Pelham, W. E., Fabiano, G. A., Gnagy, E. M., Greiner, A. R., & Hoza, B. (2005b). The role of summer treatment programs in the context of comprehensive treatment for attention-deficit/hyperactivity disorder. In E. D. Hibbs & P. S. Jensen (Eds.), Psychosocial treatments for child and adolescent disorders: Empirically based strategies for clinical practice (2nd ed., pp. 377–409). Washington, DC: American Psychological Association.

    Google Scholar 

  • Pelham, W. E., Fabiano, G. A., & Massetti, G. M. (2005c). Evidence-based assessment of attention deficit hyperactivity disorder in children and adolescents. Journal of Clinical Child and Adolescent Psychology, 34, 449–476.

    Article  PubMed  Google Scholar 

  • Pelham, W. E., Gnagy, E. M., Greiner, A. R., Hoza, B., Hinshaw, S. P., Swanson, J. M., et al. (2000). Behavioral versus behavioral and pharmacological treatment in ADHD children attending a summer treatment program. Journal of Abnormal Child Psychology, 28, 507–525.

    Article  PubMed  Google Scholar 

  • Pelham, W. E., & Hinshaw, S. P. (1992). Behavioral intervention for attention deficit-hyperactivity disorder. In S. M. Turner, K. D. Calhoun, & H. E. Adams (Eds.), Handbook of clinical behavior therapy (Vol. 2, pp. 259–283). New York: Wiley.

    Google Scholar 

  • Pelham, W. E., & Hoza, B. (1996). Intensive treatment: A summer treatment program for children with ADHD. In E. D. Hibbs & P. S. Jensen (Eds.), Psychosocial treatments for child and adolescent disorders: Empirically based strategies for clinical practice (pp. 311–340). Washington, DC: American Psychological Association.

    Chapter  Google Scholar 

  • Pelham, W. E., Wheeler, T., & Chronis, A. (1998). Empirically supported psychosocial treatments for attention deficit hyperactivity disorder. Journal of Clinical Child Psychology, 27, 190–205.

    Article  PubMed  Google Scholar 

  • Pfiffner, L. J., & McBurnett, K. (1997). Social skills training with parent generalization: Treatment effects for children with attention deficit disorder. Journal of Consulting and Clinical Psychology, 65, 749–757.

    Article  PubMed  Google Scholar 

  • Reitman, D., Hupp, S. D. A., O’Callaghan, P. M., Gulley, V., & Northup, J. (2001). The influence of a token economy and methylphenidate on attentive and disruptive behavior during sports with ADHD-diagnosed children. Behavior Modification, 25, 305–323.

    Article  PubMed  Google Scholar 

  • Richters, J. E., Arnold, L. E., Jensen, P. S., Abikoff, H., Conners, C. K., Greenhill, L. L., et al. (1995). NIMH collaborative multisite multimodal treatment study of children with ADHD: I. Background and rationale. Journal of the American Academy of Child & Adolescent Psychiatry, 34, 987–1000.

    Article  Google Scholar 

  • Rosenthal, R. (1979). The “file drawer problem” and tolerance for null results. Psychological Bulletin, 86, 638–641.

    Article  Google Scholar 

  • Swanson, J. M., Elliott, G. R., Greenhill, L. L., Wigal, T., Arnold, L. E., Vitiello, B., et al. (2007). Effects of stimulant medication on growth rates across 3 years in the MTA follow-up. Journal of the American Academy of Child and Adolescent Psychiatry, 46, 1015–1027.

    Article  PubMed  Google Scholar 

  • Thompson, A. L., Molina, B. S. G., Pelham, W., & Gnagy, E. M. (2007). Risky driving in adolescents and young adults with childhood ADHD. Journal of Pediatric Psychology, 32, 745–759.

    Article  PubMed  Google Scholar 

  • Tutty, S., Gephart, H., & Wurzbacher, K. (2003). Enhancing behavioral and social skill functioning in children newly diagnosed with attention-deficit hyperactivity disorder in a pediatric setting. Developmental and Behavioral Pediatrics, 24, 51–57.

    Google Scholar 

  • van der Oord, S., Prins, P. J. M., Oosterlaan, J., & Emmelkamp, P. M. G. (2007). Does brief, clinically based, intensive multimodal behavior therapy enhance the effects of methylphenidate in children with ADHD? European Child and Adolescent Psychiatry, 16, 48–57.

    Article  PubMed  Google Scholar 

  • Volkow, N. D., & Insel, T. R. (2003). What are the long-term effects of methylphenidate treatment? Biological Psychiatry, 54, 1307–1309.

    Article  PubMed  Google Scholar 

  • Wells, K. C., Chi, T. C., Hinshaw, S. P., Epstein, J. N., Pfiffner, L., Nebel-Schwalm, M., et al. (2006). Treatment-related changes in objectively measured parenting behaviors in the multimodal treatment study of children with attention-deficit/hyperactivity disorder. Journal of Consulting and Clinical Psychology, 74, 649–657.

    Article  PubMed  Google Scholar 

  • Wells, K. C., Epstein, J. N., Hinshaw, S. P., Conners, C. K., Klaric, J., Abikoff, H. B., et al. (2000). Parenting and family stress treatment outcomes in attention deficit hyperactivity disorder (ADHD): An empirical analysis in the MTA study. Journal of Abnormal Child Psychology, 28, 543–553.

    Article  PubMed  Google Scholar 

Download references

Acknowledgments

During the preparation of this manuscript, all authors were supported in part by a grant from the National Institute of Mental Health to the first author: R01 MH065899. The first author also was supported in part by N01 MH12010 to B.S.G. Molina; and the first and third authors were supported in part by R43 MH076359 to A. Terrazas. The views represented in this article are solely those of the authors.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Betsy Hoza.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Hoza, B., Kaiser, N.M. & Hurt, E. Multimodal Treatments for Childhood Attention-deficit/Hyperactivity Disorder: Interpreting Outcomes in the Context of Study Designs. Clin Child Fam Psychol Rev 10, 318–334 (2007). https://doi.org/10.1007/s10567-007-0025-5

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10567-007-0025-5

Keywords

Navigation