Skip to main content
SpringerLink
Log in

Utilizing Benchmarking to Study the Effectiveness of Parent–Child Interaction Therapy Implemented in a Community Setting

  • Original Paper
  • Published:
Journal of Child and Family Studies Aims and scope Submit manuscript

Abstract

Benchmarking is a program evaluation approach that can be used to study whether the outcomes of parents/children who participate in an evidence-based program in the community approximate the outcomes found in randomized trials. This paper presents a case illustration using benchmarking methodology to examine a community implementation of Parent–Child Interaction Therapy (CI-PCIT) utilized as a child maltreatment prevention effort. Data were collected from 83 parent–child dyads. Change scores were compared to treatment and control effect sizes aggregated from the PCIT literature. Pre-post results indicated significant positive changes in child behavior for CI-PCIT completers. Benchmarking analyses revealed that parents who completed CI-PCIT reported significantly greater positive child outcomes than the aggregate control group benchmark, and significantly less than observed in the treatment benchmark. A summary of decision points and implications for utilizing this methodology in the child maltreatment field are postulated.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Barth, R. (2009). Preventing child abuse and neglect with parent training: Evidence and opportunities. The Future of Children, 19, 95–118.

    Article  PubMed  Google Scholar 

  • Barth, R. P., Landsverk, J., Chamberlain, P., Reid, J. B., Rolls, J. A., Hurlburt, M. S., et al. (2005). Parent-training programs in child welfare services: Planning for a more evidence-based approach to serving biological parents. Research on Social Work Practice, 15, 353.

    Article  Google Scholar 

  • Brestan, E. V., Eyberg, S. M., Boggs, S. R., & Algina, J. (1997). Parent–Child Interaction Therapy: Parents’ perceptions of untreated siblings. Child & Family Behavior Therapy, 19, 13–28.

    Article  Google Scholar 

  • Bridge, T., Massie, E., & Mills, C. (2008). Prioritizing cultural competence in the implementation of an evidence-based practice model. Children and Youth Services Review, 30, 1111–1118.

    Article  Google Scholar 

  • Briss, P. A., Zaza, S., Pappaioanou, M., Fielding, J., Wright-De Aguero, L., Truman, B. I., et al. (2000). Developing an evidence-based guide to community preventive services—methods. The task force on community preventive services. American Journal of Preventive Medicine, 18, 35–43.

    Article  PubMed  Google Scholar 

  • California evidence-based clearinghouse for child welfare. (2009). Usage Guide for the CEBC. Retrieved from http://www.cachildwelfareclearinghouse.org.

  • Carroll, C., Patterson, M., Wood, S., Booth, A., Rick, J., & Balain, S. (2007). A conceptual framework for implementation fidelity. Implementation Science, 2, 40.

    Article  PubMed  Google Scholar 

  • Centers for Disease Control and Prevention, National Center for Injury Prevention and Control. (2004). Using evidence-based parenting programs to advance CDC efforts in child maltreatment prevention: Research brief. Atlanta, GA: Author.

    Google Scholar 

  • Chaffin, M., & Friedrich, B. (2004). Evidence-based treatments in child abuse and neglect. Children and Youth Services Review, 26, 1097–1113.

    Article  Google Scholar 

  • Chaffin, M., Funderburk, B., Bard, D., Valle, L. A., & Gurwitch, R. (2011). A combined motivation and Parent–Child Interaction Therapy package reduces child welfare recidivism in a randomized dismantling field trial. Journal of Consulting and Clinical Psychology, 79, 84–95.

    Article  PubMed  Google Scholar 

  • Chaffin, M., Silovsky, J. F., Funderburk, B., Valle, L. A., Brestan, E. V., Balachova, T., et al. (2004). Parent–Child Interaction Therapy with physically abusive parents: Efficacy for reducing future abuse reports. Journal of Consulting and Clinical Psychology, 72, 500–510.

    Article  PubMed  Google Scholar 

  • Curtis, N. M., Ronan, K. R., & Borduin, C. M. (2004). Multisystemic treatment: A meta-analysis of outcome studies. Journal of Family Psychology, 3, 411–419.

    Article  Google Scholar 

  • Curtis, N. M., Ronan, K. R., Heiblum, N., & Crellin, K. (2009). Dissemination and effectiveness of multisystemic treatment in New Zealand: A benchmarking study. Journal of Family Psychology, 23, 119–129.

    Article  PubMed  Google Scholar 

  • Eyberg, S. M., Boggs, S. R., & Algina, J. (1995). Parent–Child Interaction Therapy: A psychosocial model for the treatment of young children with conduct problem behavior and their families. Psychopharmacology Bulletin, 31, 83–91.

    PubMed  Google Scholar 

  • Eyberg, S. M., Nelson, M. M., Duke, M., & Boggs, S. R. (2005). Manual for the dyadic parent–child interaction coding system, 3rd edn. Gainesville: University of Florida. Available from http://www.PCIT.org.

  • Eyberg, S. M., & Pincus, D. (1999). Eyberg Child Behavior Inventory Sutter Student Behavior Inventory—revised professional manual. Odessa, FL: Psychological Assessment Resources.

    Google Scholar 

  • Farrell, L. J., Schlup, B., & Boschen, M. J. (2010). Cognitive-behavioral treatment of childhood obsessive-compulsive disorder in community-based clinical practice: Clinical significance and benchmarking against efficacy. Behaviour Research and Therapy, 48, 409–417.

    Article  PubMed  Google Scholar 

  • Galanter, R., Self-Brown, S., Valente, J., Dorsey, S., Whitaker, D., Bertuglia-Haley, M., & Prieto, M. (in press). Effectiveness of Parent Child-Interaction Therapy delivered to at-risk families in the home setting. Child and Family Behavior Therapy.

  • Hembree-Kigin, T., & McNeil, C. (1995). Parent–Child Interaction Therapy. New York: Plenum.

    Google Scholar 

  • Hermann, R. C., Mattke, S., Somekh, D., Silfverhielm, H., Goldner, E., Glover, G., et al. (2006). Quality indicators for international benchmarking of mental health care. International Journal for Quality in Health Care, 18, 31–38.

    Article  PubMed  Google Scholar 

  • Hunsley, J., & Lee, C. M. (2007). Research-informed benchmarks for psychological treatments: Efficacy studies, effectiveness studies, and beyond. Professional Psychology: Research and Practice, 38, 21–33.

    Article  Google Scholar 

  • Leung, C., Tsang, S., Heung, K., & Yiu, I. (2009). Effectiveness of Parent–Child Interaction Therapy (PCIT) among Chinese families. Research on Social Work Practice, 19, 304–313.

    Article  Google Scholar 

  • Masse, J. J., & McNeil, C. B. (2008). In-home Parent–Child Interaction Therapy: Clinical considerations. Child and Family Behavior Therapy, 30, 127–135.

    Article  Google Scholar 

  • Matos, M., Bauermeister, J. J., & Bernal, G. (2009). Parent–Child Interaction Therapy for Puerto Rican preschool children with ADHD and behavior problems: A pilot efficacy study. Family Process, 48, 232–252.

    Article  PubMed  Google Scholar 

  • McCabe, K., & Yeh, M. (2009). Parent–Child Interaction Therapy for Mexican Americans: A randomized clinical trial. Journal of Clinical Child & Adolescent Psychology, 38, 753–759.

    Article  Google Scholar 

  • McLeod, B. D., Southam-Gerow, M. A., & Weisz, J. R. (2009). Conceptual and methodological issues in treatment integrity measurement. Social Psychology Review, 38, 541–546.

    Google Scholar 

  • McNeil, C. B., Capage, L. C., Bahl, A., & Blanc, H. (1999). Importance of early intervention for disruptive behavior problems: Comparison of treatment and waitlist-control groups. Early Education and Development, 10, 445–454.

    Article  Google Scholar 

  • Minami, T., Serlin, R. C., Wampold, B. E., Kircher, J. C., & Brown, G. S. (2008a). Using clinical trials to benchmark effects produced in clinical practice. Quality & Quantity, 42, 513–525.

    Article  Google Scholar 

  • Minami, T., Wampold, B. E., Serlin, R. C., Hamilton, E. G., & Brown, G. S. (2008b). Benchmarking the effectiveness of psychotherapy treatment for adult depression in a managed care environment: A preliminary study. Journal of Consulting and Clinical Psychology, 76, 116–124.

    Article  PubMed  Google Scholar 

  • Minami, T., Wampold, B. E., Serlin, R. C., Kircher, J. C., & Brown, G. S. (2007). Benchmarks for psychotherapy efficacy in adult major depression. Journal of Consulting and Clinical Psychology, 75, 232–243.

    Article  PubMed  Google Scholar 

  • Neill, J. T. (2003). Reviewing and benchmarking adventure therapy outcomes: Applications of meta-analysis. Journal of Experiential Education, 25, 316–321.

    Google Scholar 

  • Nixon, R. D. V. (2001). Changes in hyperactivity and temperament in behaviourally disturbed preschoolers after Parent–Child Interaction Therapy (PCIT). Behaviour Change, 18, 168–176.

    Article  Google Scholar 

  • Nixon, R. D. V., Sweeney, L., Erickson, D. B., & Touyz, S. W. (2003). Parent–Child Interaction Therapy: A comparison of standard and abbreviated treatments for oppositional defiant preschoolers. Journal of Consulting and Clinical Psychology, 71, 251–260.

    Article  PubMed  Google Scholar 

  • Oei, T. P. S., & Boschen, M. J. (2009). Clinical effectiveness of a cognitive behavioral group treatment program for anxiety disorders: A benchmarking study. Journal of Anxiety Disorders, 23, 950–957.

    Article  PubMed  Google Scholar 

  • Prinz, R. J., Sanders, M. R., Shapiro, C. J., Whitaker, D. J., & Lutzker, J. R. (2009). Population- based prevention of child maltreatment: The US Triple P System population trial. Prevention Science, 10, 1–12.

    Article  PubMed  Google Scholar 

  • Reid, M. J., Webster-Stratton, C., & Hammond, M. (2003). Follow-up of children who received the Incredible Years intervention for oppositional-defiant disorder: Maintenance and prediction of 2-year outcome. Behavior Therapy, 34, 471–491.

    Article  Google Scholar 

  • Sanders, M. R., Markie-Dadds, C., & Turner, K. M. T. (2003). Theoretical, scientific and clinical foundations of the Triple P-Positive Parenting Program: A population approach to the promotion of parenting competence. St. Lucia, Australia: Parenting and Family Support Centre.

    Google Scholar 

  • Schuhmann, E. M., Foote, R. C., Eyberg, S. M., Boggs, S. R., & Algina, J. (1998). Efficacy of Parent–Child Interaction Therapy: Interim report of a randomized trial with short-term maintenance. Journal of Clinical Child Psychology, 27, 34–45.

    Article  PubMed  Google Scholar 

  • Solomon, M., Ono, M., Timmer, S. G., & Goodlin-Jones, B. (2008). The effectiveness of Parent–Child Interaction Therapy for families of children on the autism spectrum. Journal of Autism Developmental Disorders, 38, 1767–1776.

    Article  Google Scholar 

  • Stewart, R. E., & Chambless, D. L. (2009). Cognitive-behavioral therapy for adult anxiety disorders in clinical practice: A meta-analysis of effectiveness studies. Journal of Consulting and Clinical Psychology, 77, 595–606.

    Article  PubMed  Google Scholar 

  • R Development Core Team (2009) R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. ISBN 3-900051-07-0, URL http://www.R-project.org.

  • Thomas, R., & Zimmer-Gembeck, M. J. (2007). Behavioral outcomes of Parent–Child Interaction Therapy and Triple P-Positive Parenting Program: A review and meta-analysis. Journal of Abnormal Child Psychology, 35, 475–495.

    Article  PubMed  Google Scholar 

  • Urquiza, A. J., & McNeil, C. B. (1996). Parent–Child Interaction Therapy: An intensive dynamic intervention for physically abusive families. Child Maltreatment, 1(2), 133–144.

    Google Scholar 

  • Ware, L. M., McNeil, C. B., Masse, J., & Stevens, S. (2008). Efficacy of in-home Parent–Child Interaction Therapy. Child & Family Behavior Therapy, 30, 99–126.

    Article  Google Scholar 

  • Webster-Stratton, C., & Reid, M. J. (2010). Adapting the Incredible Years, an evidence-based parenting program, for families involved in the child welfare system. Journal of Children’s Services, 5, 25–42.

    Article  Google Scholar 

  • Weersing, V. R. (2005). Benchmarking the effectiveness of psychotherapy: Program evaluation as a component of evidence-based practice. Journal of American Academy of Child Adolescent Psychiatry, 44, 1058–1062.

    Article  Google Scholar 

  • Weersing, V. R., & Weisz, J. R. (2002). Community clinic treatment of depressed youth: Benchmarking usual care against CBT clinical trials. Journal of Consulting and Clinical Psychology, 70, 299–310.

    Article  PubMed  Google Scholar 

  • Whitaker, D. J., Lutzker, J. R., & Shelley, G. A. (2005). Child maltreatment prevention priorities at the Centers for Disease Control and Prevention. Child Maltreatment, 10, 245–259.

    Article  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institute of Public Health, Georgia State University, Atlanta, GA, 30302, USA

    Shannon Self-Brown, Jessica R. Valente, Robert C. Wild, Daniel J. Whitaker & Jenelle Stanley

  2. Durham Exchange Clubs’ Family Center, Durham, NC, USA

    Rachel Galanter

  3. University of Washington, Seattle, WA, USA

    Shannon Dorsey

Authors
  1. Shannon Self-Brown
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jessica R. Valente
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Robert C. Wild
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Daniel J. Whitaker
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Rachel Galanter
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Shannon Dorsey
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Jenelle Stanley
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Shannon Self-Brown.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Self-Brown, S., Valente, J.R., Wild, R.C. et al. Utilizing Benchmarking to Study the Effectiveness of Parent–Child Interaction Therapy Implemented in a Community Setting. J Child Fam Stud 21, 1041–1049 (2012). https://doi.org/10.1007/s10826-012-9566-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10826-012-9566-4

Keywords

Search

Navigation