Abstract
This study aimed to provide initial validity and reliability of the Measure of NDBI Strategy Implementation-Caregiver Change (MONSI-CC), a novel measure that captures changes in caregivers’ implementation of NDBI strategies during early intervention. The MONSI-CC was applied to 119 observations of 43 caregiver-child dyads of preschoolers with autism spectrum disorders (ASD). The MONSI-CC showed high inter-rater and test–retest reliability and captured significant improvements in caregivers’ implementation of NDBI strategies. Significant associations between improvements in caregiver NDBI implementation and improvements in the child’s ASD symptoms also emerged. Our work shows promising evidence for the utility of the MONSI-CC to evaluate implementation of NDBI strategies by caregivers as a mediating and moderating factor for treatment effects on children with ASD.
Similar content being viewed by others
References
Kim, S.H., Dufek, S., Vibert B., & Lord, C. (2019). Measure of NDBI Strategy Implementation - Caregiver Change (MONSI-CC). Copyright in Progress.
Barkley, R. A. (2013). Defiant children: A clinician’s manual for assessment and parent training. New York: Guilford Press.
Bearss, K., Burrell, T. L., Stewart, L., & Scahill, L. (2015). Parent training in autism spectrum disorder: What’s in a name? Clinical Child and Family Psychology Review,18(2), 170–182.
Bishop, S. L., Guthrie, W., Coffing, M., & Lord, C. (2011). Convergent validity of the Mullen Scales of Early Learning and the Differential Ability Scales in children with autism spectrum disorders. American Journal on Intellectual and Developmental Disabilities,116(5), 331–343.
Browne, M., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen (Ed.), Testing structural equation models (Vol. 154, pp. 136–162). Newbury Park, CA: Sage.
Carter, A. S., Messinger, D. S., Stone, W. L., Celimli, S., Nahmias, A. S., & Yoder, P. (2011). A randomized controlled trial of Hanen’s ‘More Than Words’ in toddlers with early autism symptoms. Journal of Child Psychology and Psychiatry,52(7), 741–752.
Casagrande, K., & Ingersoll, B. (2017). Parent-mediated interventions for social communication in young children with ASD. In J. B. Leaf (Ed.), Autism and Child Psychopathology. Handbook of Social Skills and Autism Spectrum Disorder (pp. 285–312). Cham: Springer.
Crockett, J. L., Fleming, R. K., Doepke, K. J., & Stevens, J. S. (2007). Parent training: Acquisition and generalization of discrete trials teaching skills with parents of children with autism. Research in Developmental Disabilities,28(1), 23–36.
Davlantis, K., Estes, A., Dawson, G., & Rogers, S. (2019). A novel method for measuring learning opportunities provided by parents to young children with autism spectrum disorder. Autism,23(6), 1563–1574.
Dawson, G., Rogers, S., Munson, J., Smith, M., Winter, J., Greenson, J., … Varley, J. (2010). Randomized, controlled trial of an intervention for toddlers with autism: The Early Start Denver Model. Pediatrics, 125(1), e17–e23.
Durlak, J., & DuPre, E. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and factors affecting implementation. American Journal of Community Psychology,41(3–4), 327–350.
Eyberg, S., & Funderburk, D. (2011). Parent-child interaction therapy protocol. Gainsville, FL: PCIT International.
Frost, K., Koehn, G. N., Russell, K. M., & Ingersoll, B. (2019). Measuring child social communication across contexts: Similarities and differences across play and snack routines. Autism Research,12(4), 636–644.
Gengoux, G. W., Berquist, K. L., Salzman, E., Schapp, S., Phillips, J. M., Frazier, T. W., … Hardan, A. Y. (2015). Pivotal response treatment parent training for autism: Findings from a 3-month follow-up evaluation. Journal of Autism and Developmental Disorders, 45(9), 2889–2898.
Gotham, K., Pickles, A., & Lord, C. (2009). Standardizing ADOS scores for a measure of severity in autism spectrum disorders. Journal of Autism and Developmental Disorders,39(5), 693–705.
Grahame, V., Brett, D., Dixon, L., McConachie, H., Lowry, J., Rodgers, J., … Le Couteur, A. (2015). Managing repetitive behaviours in young children with autism spectrum disorder (ASD): Pilot randomised controlled trial of a new parent group intervention. Journal of Autism and Developmental Disorders, 45(10), 3168–3182.
Green, J., Charman, T., McConachie, H., Aldred, C., Slonims, V., Howlin, P., … Pickles, A. (2010). Parent-mediated communication-focused treatment in children with autism (PACT): A randomised controlled trial. The Lancet, 375(9732), 2152–2160.
Grzadzinski, R., Carr, T., Colombi, C., McGuire, K., Dufek, S., Pickles, A., et al. (2016). Measuring changes in social communication behaviors: Preliminary development of the Brief Observation of Social Communication Change (BOSCC). Journal of Autism and Developmental Disorders,46(7), 2464–2479.
Gulsrud, A. C., Hellemann, G., Shire, S., & Kasari, C. (2016). Isolating active ingredients in a parent-mediated social communication intervention for toddlers with autism spectrum disorder. Journal of Child Psychology and Psychiatry,57(5), 606–613.
Hus, V., Gotham, K., & Lord, C. (2014). Standardizing ADOS domain scores: Separating severity of social affect and restricted and repetitive behaviors. Journal of Autism and Developmental Disorders,44(10), 2400–2412.
Individuals with Disabilities Education Act (IDEA). 20 U.S.C. § 1400 (2004).
Ingersoll, B., & Dvortcsak, A. (2010). Teaching social communication to children with autism: A manual for parents. New York: Guilford Press.
Kasari, C., Gulsrud, A., Paparella, T., Hellemann, G., & Berry, K. (2015). Randomized comparative efficacy study of parent-mediated interventions for toddlers with autism. Journal of Consulting and Clinical Psychology,83(3), 554–563.
Kasari, C., Lawton, K., Shih, W., Barker, T. V., Landa, R., Lord, C. (2014). Caregiver-mediated intervention for low-resourced preschoolers with autism: An RCT. Pediatrics, 134(1), e72–e79.
Kazdin, A. E. (2005). Parent management training: Treatment for oppositional, aggressive, and antisocial behavior in children and adolescents. New York: Oxford University Press.
Kim, S. H., Grzadzinski, R., Martinez, K., & Lord, C. (2018). Measuring treatment response in children with autism spectrum disorder: Applications of the Brief Observation of Social Communication Change to the Autism Diagnostic Observation Schedule. Autism,23(5), 1176–1185.
Le Couteur, A., Lord, C., & Rutter, M. (2003). The autism diagnostic interview-revised (ADI-R). Los Angeles, CA: Western Psychological Services.
Lord, C., Rutter, M., Dilavore, P., & Risi, S. (2000). ADOS: Autism diagnostic observation schedule. Los Angeles, CA: Western Psychological Services.
Lord, C., Rutter, M., DiLavore, P., Risi, S., Gotham, K., & Bishop, S. (2012). Autism diagnostic observation schedule: ADOS-2. Los Angeles, CA: Western Psychological Services.
Lovaas, O. I. (1987). Behavioral treatment and normal educational and intellectual functioning in young autistic children. Journal of Consulting and Clinical Psychology,55(1), 3–9.
Mullen, E. M. (1995). Mullen scales of early learning. Circle Pines, MN: AGS.
Muthén, L. K., & Muthén, B. O. (2012). Mplus user’s guide 1998–2012 (7th ed.). Los Angeles, CA: Muthén & Muthén.
National Research Council. (2001). Educating children with autism. Washington, DC: National Academies Press.
Nock, M., Ferriter, C., & Holmberg, E. (2006). Parents beliefs about treatment credibility and effectiveness: Assessment and relation to subsequent treatment participation. Journal of Child and Family Studies,16(1), 27–38.
Oono, I. P., Honey, E. J., & McConachie, H. (2013). Parent-mediated early intervention for young children with autism spectrum disorders (ASD). Evidence-Based Child Health: A Cochrane Review Journal,8(6), 2380–2479.
Pickard, K. E., Kilgore, A. N., & Ingersoll, B. R. (2016). Using community partnerships to better understand the barriers to using an evidence-based, parent-mediated intervention for autism spectrum disorder in a medicaid system. American Journal of Community Psychology,57(3–4), 391–403.
Pickles, A., Harris, V., Green, J., Aldred, C., McConachie, H., Slonims, V., … the PACT Consortium. (2015). Treatment mechanism in the MRC preschool autism communication trial: Implications for study design and parent-focussed therapy for children. Journal of Child Psychology and Psychiatry, 56(2), 162–170.
Pickles, A., Le Couteur, A., Leadbitter, K., Salomone, E., Cole-Fletcher, R., Tobin, H., … Green, J. (2016). Parent-mediated social communication therapy for young children with autism (PACT): Long-term follow-up of a randomised controlled trial. The Lancet, 388(10059), 2501–2509.
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., … Hensley, M. (2011). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health, 38(2), 65–76.
Rogers, S., Estes, A., Lord, C., Munson, J., Rocha, M., Winter, J., … Talbott, M. (2019). A multisite randomized controlled two-phase trial of the Early Start Denver Model compared to treatment as usual. Journal of the American Academy of Child & Adolescent Psychiatry, Advance online publication.
Rogers, S., Estes, A., Lord, C., Vismara, L., Winter, J., Fitzpatrick, A., … Dawson, G. (2012). Effects of a brief Early Start Denver Model (ESDM)-based parent intervention on toddlers at risk for autism spectrum disorders: A randomized controlled trial. Journal of the American Academy of Child and Adolescent Psychiatry, 51(10), 1052–1065.
Rogers, S., Estes, A., Vismara, L., Munson, J., Zierhut, C., Greenson, J., … Talbott, M. (2019). Enhancing low-intensity coaching in parent implemented early start denver model intervention for early autism: A randomized comparison treatment trial. Journal of Autism and Developmental Disorders, 49(2), 632–646.
Schreibman, L., Dawson, G., Stahmer, A. C., Landa, R., Rogers, S. J., McGee, G. G., … Halladay, A. (2015). Naturalistic developmental behavioral interventions: Empirically validated treatments for autism spectrum disorder. Journal of Autism and Developmental Disorders, 45(8), 2411–2428.
Shalev, R., Lavine, C., & Di Martino, A. (2019). A systematic review of the role of parent characteristics in parent-mediated interventions for children with autism spectrum disorder. Journal of Developmental and Physical Disabilities, 1–21.
Shire, S. Y., Goods, K., Shih, W., Mucchetti, C., Kaiser, A., Wright, C., … Kasari, C. (2015). Parents’ adoption of social communication intervention strategies: Families including children with autism spectrum disorder who are minimally verbal. Journal of Autism and Developmental Disorders, 45(6), 1712–1724.
Siller, M., Hutman, T., & Sigman, M. (2013). A parent-mediated intervention to increase responsive parental behaviors and child communication in children with ASD: A Randomized Clinical Trial. Journal of Autism and Developmental Disorders,43(3), 540–555.
Skrondal, A., & Rabe-Hesketh, S. (2004). Generalized latent variable modeling: Multilevel, longitudinal, and structural equation models (1st ed.). Boca Raton: Chapman & Hall/CRC.
Solomon, R., Necheles, J., Ferch, C., & Bruckman, D. (2007). Pilot study of a parent training program for young children with autism: The PLAY Project Home Consultation program. Autism,11(3), 205–224.
Strauss, K., Vicari, S., Valeri, G., D’Elia, L., Arima, S., & Fava, L. (2012). Parent inclusion in Early Intensive Behavioral Intervention: The influence of parental stress, parent treatment fidelity and parent-mediated generalization of behavior targets on child outcomes. Research in Developmental Disabilities,33(2), 688–703.
Wainer, A., & Ingersoll, B. (2013). Intervention fidelity: An essential component for understanding ASD parent training research and practice. Clinical Psychology: Science and Practice,20(3), 335–357.
Wetherby, A. M., Guthrie, W., Woods, J., Schatschneider, C., Holland, R. D., Morgan, L., et al. (2014). Parent-implemented social intervention for toddlers with autism: An RCT. Pediatrics,134(6), 1084–1093.
Acknowledgement
This work was supported by a grant awarded to author S.H.K National Institute of Mental Health (NIMH; 1R01MH114925-01). Work for this project was also supported by Grants awarded to author C.L. from NIMH (RO1MH081757, 1RC1MH089721, R01RFAMH14100, R01MH078165), Autism Speaks (5766), and Health Resources and Service Administration (HRSA; UA3MC11055). The views expressed in this work are those of the authors and not necessarily those of the NIMH, Autism Speaks or HRSA. The authors would like to thank Nurit Benrey-Grinberg and Hannah Thomas for their data coding. The authors would also like to thank Connie Kasari, Sally Rogers, and Amy Wetherby for the data and support of this project.
Author information
Authors and Affiliations
Contributions
BV participated in the design of the study, statistical analysis, interpretation of data, and drafted the manuscript; SD conceived of the study, participated in the design of study, interpretation of the data and manuscript preparation; CK helped to draft the manuscript and performed the statistical analysis; YB helped to draft the manuscript and performed the statistical analysis; JW participated in the design of the study, and helped to draft the manuscript; CL conceived of the study, assisted in interpretation of the data, statistical analysis, and helped to draft the manuscript; SK conceived of the study; participated the design of the study, interpretation of data, statistical analysis, and manuscript writing. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Conflict of interest
C.L. receives royalties from the sale of the ADI-R and the ADOS-2. All royalties related to the research were donated to a non-profit organization. No other authors have conflicts of interest regarding this study.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Vibert, B.A., Dufek, S., Klein, C.B. et al. Quantifying Caregiver Change Across Early Autism Interventions Using the Measure of NDBI Strategy Implementation: Caregiver Change (MONSI-CC). J Autism Dev Disord 50, 1364–1379 (2020). https://doi.org/10.1007/s10803-019-04342-0
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10803-019-04342-0