Exploration-Stage Implementation Variation
Its Effect on the Cost-Effectiveness of an Evidence-Based Parenting Program
Abstract
The present study examines the effect of agency-level implementation variation on the cost-effectiveness of an evidence-based parent training program (Positive Parenting Program: “Triple P”). Staff from six community-based agencies participated in a five-day training to prepare them to deliver a 12-week Triple P parent training group to caregivers. Prior to the training, administrators and staff from four of the agencies completed a site readiness process intended to prepare them for the implementation demands of successfully delivering the group, while the other two agencies did not complete the process. Following the delivery of each agency’s first Triple P group, the graduation rate and average cost per class graduate were calculated. The average cost-per-graduate was over seven times higher for the two agencies that had not completed the readiness process than for the four completing agencies ($7,811 vs. $1,052). The contrast in costs was due to high participant attrition in the Triple P groups delivered by the two agencies that did not complete the readiness process. The odds of Triple P participants graduating were 12.2 times greater for those in groups run by sites that had completed the readiness process. This differential attrition was not accounted for by between-group differences in participant characteristics at pretest. While the natural design of this study limits the ability to empirically test all alternative explanations, these findings indicate a striking cost savings for sites completing the readiness process and support the thoughtful application of readiness procedures in the early stages of an implementation initiative.
References
(2009). Evidence based practice implementation and staff emotional exhaustion in children services. Behaviour Research and Therapy, 47, 954–960.
(2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Admin Policy Mental Health, 38, 4–23.
(2011). Return on investment: Evidence-based options to improve statewide outcomes (Document No. 11-07-1201). Olympia, WA: Washington State Institute for Public Policy.
(1993). The Parenting Scale: A measure of dysfunctional parenting in discipline situations. Psychological Assessment, 5, 137–144.
(2011). So now we’ve picked an evidence-based program, what’s next? Perspectives of service providers and administrators. Professional Psychology: Research and Practice, 42, 169–175.
(2005). Parent training programs in child welfare services: Planning for a more evidence-based approach to serving biological parents. Research on Social Work Practice, 15, 353–371.
(2013, February). Implementation science: Building the bridge from good intentions to great outcomes. Keynote presentation at the 2013 Helping Families Change Conference, Los Angeles, CA.
(2011). Integrating Triple P into existing family support services: A case study on program implementation. Prevention Science, 12, 411–422.
(1998). Effective psychosocial treatments of conduct disordered children and adolescents: 29 years, 82 studies, and 5, 272 kids. Journal of Consulting and Clinical Psychology, 27, 180–189.
(2006). Patterns of retention in a preventive interventions with ethnic minority families. Journal of Primary Prevention, 27, 171–193.
(2008). Effectiveness of the triple P positive parenting programon behavioral problems in children: A meta-analysis. Behavior Modification, 32, 714–735.
(2011). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41, 327–350.
(2007). Parenting programme for parents of children at risk of developing conduct disorder: Cost effectiveness analysis. British Medical Journal, 334, 682–687.
(2008). Evidence-based psychosocial treatments for children and adolescents with disruptive behavior. Journal of Clinical Child and Adolescent Psychology, 37, 215–237.
(2005). Implementation research: A synthesis of the literature (FMHI Publication #231). Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network.
(2009). Core implementation components. Research on Social Work Practice, 19, 531–540.
(2010). Improving the mental health of children in child welfare through the implementation of evidence-based parenting interventions. Administration and Policy in Mental Health, 37, 27–39.
(2007). Building on strengths: Current status and opportunities for improvement of parent training for families in child welfare. In , Child protection: Using research to improve policy and practice (pp. 81–106). Washington, DC: Brookings Institution.
. (2001). Crossing the quality chasm: A new health system for the 21st century. Washington, DC: National Academy Press.
(2014). Clustering practitioners within service organizations may improve implementation outcomes for evidence-based programs. Zeitschrift für Psychologie, 222, 30–36. doi: 10.1027/2151-2604/a000163
(1995). Manual for the Depression Anxiety Stress Scales (2nd ed.). Sydney, Australia: Psychology Foundation of Australia.
(2009). Preparing social work practitioners to use evidence-based practice: A comparison of experiences from an implementation project. Research on Social Work Practice, 19, 613–627.
(2010). The dissemination and implementation of evidence-based psychological treatments: A review of current efforts. American Psychologist, 65, 73–84.
(2008). An ethnographic study of implementation of evidence-based treatments in child mental health: First steps. Psychiatric Services, 59, 738–746.
(2010). Pathways Triple P and the child welfare system: A promising fit. Children and Youth Services Review, 32, 611–618.
(2009). Population-based prevention of child maltreatment: The US Triple P system population trial. Prevention Science, 10, 1–12.
(2011). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health, 38, 65–76.
(1999). Triple P-positive parenting program: Towards an empirically validated multilevel parenting and family support strategy for the prevention of behavior and emotional problems in children. Clinical Child and Family Psychology Review, 2, 71–90.
(2008). Triple P-positive parenting program as a public health approach to strengthening parenting. Journal of Family Psychology, 22, 506–517.
(2009). Predicting utilization of evidence-based parenting interventions with organizational, service-provider and client variables. Administration and Policy in Mental Health, 36, 133–143.
(2005). Practitioner’s manual for Pathways Triple P. Brisbane St. Lucia, Australia: University of Queensland.
(2002). The development and dissemination of the Triple P-positive parenting program: A multi-level, evidence-based system of parenting and family support. Prevention Science, 31, 173–198.
(2003). Theoretical, scientific and clinical foundations of the Triple P-positive parenting program: A population approach to the promotion of parenting competence. Parenting Research and Practice Monograph, 1, 1–21.
(2001). Financial cost of social exclusion: Follow up study of antisocial children into adulthood. British Medical Journal, 323, 191–194.
(2010). The sustainability of evidence-based practices in routine mental health agencies. Community Mental Health Journal, 46, 119–129.
(1998). Facilitator’s manual for Group Triple P. Brisbane, Australia: Family International.
(2006). Evidence-based youth psychotherapies versus usual clinical care: A metaanalysis of direct comparisons. American Psychologist, 61, 671–689.
(2008). The role of staff turnover in the implementation of evidence-based practices in mental health care. Psychiatric Services, 59, 732–737.
