Skip to main content
Log in

Measuring Changes in Social Communication Behaviors: Preliminary Development of the Brief Observation of Social Communication Change (BOSCC)

  • Original Paper
  • Published:
Journal of Autism and Developmental Disorders Aims and scope Submit manuscript

Abstract

Psychometric properties and initial validity of the Brief Observation of Social Communication Change (BOSCC), a measure of treatment-response for social-communication behaviors, are described. The BOSCC coding scheme is applied to 177 video observations of 56 young children with ASD and minimal language abilities. The BOSCC has high to excellent inter-rater and test–retest reliability and shows convergent validity with measures of language and communication skills. The BOSCC Core total demonstrates statistically significant amounts of change over time compared to a no change alternative while the ADOS CSS over the same period of time did not. This work is a first step in the development of a novel outcome measure for social-communication behaviors with applications to clinical trials and longitudinal studies.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  • Anagnostou, E., Jones, N., Huerta, M., Halladay, A. K., Wang, P., Scahill, L., et al. (2015). Measuring social communication behaviors as a treatment endpoint in individuals with autism spectrum disorder. Autism, 19(5), 622–636. doi:10.1177/1362361314542955.

    Article  PubMed  Google Scholar 

  • Anderson, D. K., Liang, J. W., & Lord, C. (2014). Predicting young adult outcome among more and less cognitively able individuals with autism spectrum disorders. Journal of Child Psychology and Psychiatry, 55(5), 485–494. doi:10.1111/jcpp.12178.

    Article  PubMed  Google Scholar 

  • Bishop, S. L., Guthrie, W., Coffing, M., & Lord, C. (2011). Convergent validity of the mullen scales of early learning and the differential ability scales in children with Autism Spectrum Disorders. American Association on Intellectual and Developmental Disabilities, 116(5), 331–343. doi:10.1352/1944-7558-116.5.331.

    Article  Google Scholar 

  • Bolte, E. E., & Diehl, J. J. (2013). Measurement tools and target symptoms/skills used to assess treatment response for individuals with autism spectrum disorder. Journal of Autism and Developmental Disorders, 43(11), 2491–2501. doi:10.1007/s10803-013-1798-7.

    Article  PubMed  Google Scholar 

  • Boomsma, A., Van Lang, N. D., De Jonge, M. V., De Bildt, A. A., Van Engeland, H., & Minderaa, R. B. (2008). A new symptom model for autism cross-validated in an independent sample. Journal of Child Psychology and Psychiatry, 49(8), 809–816. doi:10.1111/j.1469-7610.2008.01897.x.

    Article  PubMed  Google Scholar 

  • Brian, J., Smith, I., Zwaigenbaum, L., Roberts, W., & Bryson, S. (2015). The social ABCs caregiver-mediated intervention for toddlers with autism spectrum disorder: feasibility, acceptability, and evidence of promise from a multisite study. Autism Research,. doi:10.1002/aur.1582.

    Google Scholar 

  • Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 136–162). Newbury Park, CA: Sage.

    Google Scholar 

  • Busner, J., & Targum, S. D. (2007). The Clinical Global Impression Scale. Psychiatry, 4(7), 28–37.

    PubMed  PubMed Central  Google Scholar 

  • Chambless, D. L., & Hollon, S. D. (1998). Defining empirically supported therapies. Journal of Consulting and Clinical Psychology, 66(1), 7–18.

    Article  PubMed  Google Scholar 

  • Cunningham, A. (2012). Measuring change in social interaction skills of young children with autism. Journal of Autism and Developmental Disorders, 42, 593–605.

    Article  PubMed  Google Scholar 

  • Danial, J. T., & Wood, J. J. (2013). Cognitive behavioral therapy for children with autism: review and considerations for future research. Journal of Developmental and Behavioral Pediatrics, 34(9), 702–715. doi:10.1097/DBP.0b013e31829f676c.

    Article  PubMed  Google Scholar 

  • Dawson, G., Rogers, S., Munson, J., Smith, M., Winter, J., Greenson, J., et al. (2010). Randomized, controlled trial of an intervention for toddlers with autism: the Early Start Denver Model. Pediatrics, 125(1), e17–e23. doi:10.1542/peds.2009-0958.

    Article  PubMed  Google Scholar 

  • DeGeorge, A., Dufek, S., & Lord, C. (in preparation). Effects of parent mediated coaching versus psyhoeducation on social communication development of underserved young children with autism: A pilot study.

  • Elliot, C. D. (2007). Differential ability scales—second edition. New York: Harcourt Brace Jovanovich.

    Google Scholar 

  • Esler, A. N., Bal, V. H., Guthrie, W., Wetherby, A., Ellis Weismer, S., & Lord, C. (2015). The autism diagnostic observation schedule, toddler module: standardized severity scores. Journal of Autism and Developmental Disorders, 45(9), 2704–2720. doi:10.1007/s10803-015-2432-7.

    Article  PubMed  Google Scholar 

  • Estes, A., Munson, J., Rogers, S., Greenson, J., Winter, J., & Dawson, G. (2015). Long-term outcomes of early intervention in 6-year-old children with autism spectrum disorder. Journal of the American Academy of Child and Adolescent Psychiatry, 54(7), 580–587.

    Article  PubMed  Google Scholar 

  • Fletcher-Watson, S., & McConachie, H. (2015). The search for an early intervention outcome measurement tool in autism. Focus on Autism and Other Developmental Disabilities. doi:10.1177/1088357615583468.

    Google Scholar 

  • Fletcher-Watson, S., Petrou, A., Scott-Barrett, J., Dicks, P., Graham, C., O’Hare, A., et al. (2015). A trial of an iPad intervention targeting social communication skills in children with autism. Autism. doi:10.1177/1362361315605624.

    Google Scholar 

  • Ginn, N. C., Clionsky, L. N., Eyberg, S. M., Warner-Metzger, C., & Abner, J. P. (2015). Child-directed interaction training for young children with autism spectrum disorders: Parent and child outcomes. Journal of Clinical Child and Adolescent Psychology,. doi:10.1080/15374416.2015.1015135.

    PubMed  Google Scholar 

  • Gotham, K., Pickles, A., & Lord, C. (2009). Standardizing ADOS scores for a measure of severity in autism spectrum disorders. Journal of Autism and Developmental Disorders, 39(5), 693–705. doi:10.1007/s10803-008-0674-3.

    Article  PubMed  Google Scholar 

  • Gotham, K., Pickles, A., & Lord, C. (2012). Trajectories of autism severity in children using standardized ADOS scores. Pediatrics, 130(5), e1278–e1284. doi:10.1542/peds.2011-3668.

    Article  PubMed  PubMed Central  Google Scholar 

  • Green, J., Charman, T., McConachie, H., Aldred, C., Slonims, V., Howlin, P., et al. (2010). Parent-mediated communication-focused treatment in children with autism (PACT): A randomised controlled trial. Lancet, 375(9732), 2152–2160. doi:10.1016/S0140-6736(10)60587-9.

    Article  PubMed  PubMed Central  Google Scholar 

  • Guastella, A. J., Gray, K. M., Rinehart, N. J., Alvares, G. A., Tonge, B. J., Hickie, I. B., et al. (2015). The effects of a course of intranasal oxytocin on social behaviors in youth diagnosed with autism spectrum disorders: a randomized controlled trial. Journal of Child Psychology and Psychiatry, 56(4), 444–452. doi:10.1111/jcpp.12305.

    Article  PubMed  Google Scholar 

  • Guthrie, W., Swineford, L. B., Wetherby, A. M., & Lord, C. (2013). Comparison of DSM-IV and DSM-5 factor structure models for toddlers with autism spectrum disorder. Journal of the American Academy of Child and Adolescent Psychiatry, 52(8), 797–805 e792. doi:10.1016/j.jaac.2013.05.004.

  • Gutstein, S., Burgess, A., & Montfort, K. (2007). Evaluation of the relationship development intervention program. Autism, 11(5), 397–411.

    Article  PubMed  Google Scholar 

  • Hobson, J. A., Tarver, L., Beurkens, N., & Peter Hobson, R. (2015). The relation between severity of autism and caregiver–child interaction: a study in the context of relationship development intervention. Journal of Abnormal Child Psychology,. doi:10.1007/s10802-015-0067-y.

    Google Scholar 

  • Hus, V., Bishop, S., Gotham, K., Huerta, M., & Lord, C. (2013). Factors influencing scores on the social responsiveness scale. Journal of Child Psychology and Psychiatry, 54(2), 216–224. doi:10.1111/j.1469-7610.2012.02589.x.

    Article  PubMed  Google Scholar 

  • Kaale, A., Smith, L., & Sponheim, E. (2012). A randomized controlled trial of preschool-based joint attention intervention for children with autism. Journal of Child Psychology and Psychiatry, 53(1), 97–105. doi:10.1111/j.1469-7610.2011.02450.x.

    Article  PubMed  Google Scholar 

  • Kasari, C., Gulsrud, A., Freeman, S., Paparella, T., & Hellemann, G. (2012). Longitudinal follow-up of children with autism receiving targeted interventions on joint attention and play. Journal of the American Academy of Child and Adolescent Psychiatry, 51(5), 487–495. doi:10.1016/j.jaac.2012.02.019.

    Article  PubMed  PubMed Central  Google Scholar 

  • Kasari, C., Gulsrud, A., Wong, C., Kwon, S., & Locke, J. (2010). Randomized controlled caregiver mediated joint engagement intervention for toddlers with autism. Journal of Autism and Developmental Disorders, 40(9), 1045–1056. doi:10.1007/s10803-010-0955-5.

    Article  PubMed  PubMed Central  Google Scholar 

  • Kim, S. H., & Lord, C. (2010). Restricted and repetitive behaviors in toddlers and preschoolers with autism spectrum disorders based on the Autism Diagnostic Observation Schedule (ADOS). Autism Research, 3(4), 162–173. doi:10.1002/aur.142.

    Article  PubMed  PubMed Central  Google Scholar 

  • Kitzerow, J., Teufel, K., Wilker, C., & Freitag, C. M. (2015). Using the brief observation of social communication change (BOSCC) to measure autism-specific development. Autism Research,. doi:10.1002/aur.1588.

    PubMed  Google Scholar 

  • Lam, K. S., & Aman, M. G. (2007). The Repetitive Behavior Scale-Revised: Independent validation in individuals with autism spectrum disorders. Journal of Autism and Developmental Disorders, 37(5), 855–866. doi:10.1007/s10803-006-0213-z.

    Article  PubMed  Google Scholar 

  • Levy, S., Mandell, D., & Schultz, R. (2009). Autism. Lancet, 374, 1627–1638.

    Article  PubMed  PubMed Central  Google Scholar 

  • Lord, C., Bishop, S., & Anderson, D. (2015). Developmental trajectories as autism phenotypes. American Journal of Medical Genetics Part C: Seminars in Medical Genetics, 169(2), 198–208. doi:10.1002/ajmg.c.31440.

    Article  Google Scholar 

  • Lord, C., Luyster, R. J., Gotham, K., & Guthrie, W. (2012a). Autism Diagnostic Observation Schedule, second edition (ADOS-2) toddler module. Los Angeles, CA: Western Psychological Services.

    Google Scholar 

  • Lord, C., Luyster, R., Guthrie, W., & Pickles, A. (2012b). Patterns of developmental trajectories in toddlers with autism spectrum disorder. Journal of Consulting and Clinical Psychology, 80(3), 477–489. doi:10.1037/a0027214.

    Article  PubMed  PubMed Central  Google Scholar 

  • Lord, C., Rutter, M., & Couteur, A. (1994). Autism diagnostic interview-revised: A revised version of a diagnostic interview for caregivers of individuals with possible pervasive developmental disorders. Journal of Autism and Developmental Disorders, 24(5), 659–685. doi:10.1007/BF02172145.

    Article  PubMed  Google Scholar 

  • Lord, C., Rutter, M., DiLavore, P. C., Risi, S., Gotham, K., & Bishop, S. L. (2012c). Autism Diagnostic Observation Schedule, second edition (ADOS-2) modules 1–4. Los Angeles, CA: Western Psychological Services.

    Google Scholar 

  • Mandy, W. P., Charman, T., & Skuse, D. H. (2012). Testing the construct validity of proposed criteria for DSM-5 autism spectrum disorder. Journal of the American Academy of Child and Adolescent Psychiatry, 51(1), 41–50. doi:10.1016/j.jaac.2011.10.013.

    Article  PubMed  Google Scholar 

  • Matson, J. (2007). Determining treatment outcome in early intervention programs for autism spectrum disorders: A critical analysis of measurement issues in learning based interventions. Research in Developmental Disabilities, 28, 207–218.

    Article  PubMed  Google Scholar 

  • McConachie, H., Parr, J., Glod, M., Hanratty, J., Livingstone, N., Oono, I., et al. (2015). Systematic review of tools to measure outcomes for young children with autism spectrum disorder. Health Technology Assessment, 19(41), 1–506.

    Article  PubMed  PubMed Central  Google Scholar 

  • Mullen, E. M. (1995). Mullen scales of early learning. Circle Pines, MN: American Guidance Service.

    Google Scholar 

  • Muthen, B., & Muthen, L. (1998–2012). Mplus User’s Guide. (7th ed.). Los Angeles, CA: Muthen and Muthen.

  • Owley, T., McMahon, W., Cook, E. H., Laulhere, T., South, M., Mays, L. Z., et al. (2001). Multisite, double-blind, placebo-controlled trial of porcine secretin in autism. Journal of the American Academy of Child and Adolescent Psychiatry, 40(11), 1293–1299. doi:10.1097/00004583-200111000-00009.

    Article  PubMed  Google Scholar 

  • Pickles, A., Harris, V., Green, J., Aldred, C., McConachie, H., Slonims, V., et al. (2015). Treatment mechanism in the MRC preschool autism communication trial: Implications for study design and parent-focussed therapy for children. Journal of Child Psychology and Psychiatry, 56(2), 162–170. doi:10.1111/jcpp.12291.

    Article  PubMed  Google Scholar 

  • Richler, J., Huerta, M., Bishop, S. L., & Lord, C. (2010). Developmental trajectories of restricted and repetitive behaviors and interests in children with autism spectrum disorders. Development and Psychopathology, 22, 55–69. doi:10.1017/S0954579409990265.

    Article  PubMed  PubMed Central  Google Scholar 

  • Rogers, S. J., Estes, A., Lord, C., Vismara, L., Winter, J., Fitzpatrick, A., et al. (2012). Effects of a brief Early Start Denver model (ESDM)-based parent intervention on toddlers at risk for autism spectrum disorders: a randomized controlled trial. Journal of the American Academy of Child and Adolescent Psychiatry, 51(10), 1052–1065. doi:10.1016/j.jaac.2012.08.003.

    Article  PubMed  PubMed Central  Google Scholar 

  • Rogers, S., & Vismara, L. (2008). Evidence-based comprehensive treatments for early autism. Journal of Clinical Child and Adolescent Psychology, 37(1), 8–38. doi:10.1080/15374410701817808.

    Article  PubMed  PubMed Central  Google Scholar 

  • Rutgers, A. H., Bakermans-Kranenburg, M. J., van Ijzendoorn, M. H., & van Berckelaer-Onnes, I. A. (2004). Autism and attachment: A meta-analytic review. Journal of Child Psychology and Psychiatry, 45(6), 1123–1134. doi:10.1111/j.1469-7610.2004.t01-1-00305.x.

    Article  PubMed  Google Scholar 

  • Sallows, G., & Gaupner, T. (2005). Intensive behavioral treatment for children with autism: Four-year outcome and predictors. American Journal on Mental Retardation, 110(6), 417–438.

    Article  PubMed  Google Scholar 

  • Scahill, L., Aman, M. G., Lecavalier, L., Halladay, A. K., Bishop, S. L., Bodfish, J. W., et al. (2015). Measuring repetitive behaviors as a treatment endpoint in youth with autism spectrum disorder. Autism, 19(1), 38–52. doi:10.1177/1362361313510069.

    Article  PubMed  Google Scholar 

  • Shumway, S., Farmer, C., Thurm, A., Joseph, L., Black, D., & Golden, C. (2012). The ADOS calibrated severity score: Relationship to phenotypic variables and stability over time. Autism Research, 5(4), 267–276. doi:10.1002/aur.1238.

    Article  PubMed  PubMed Central  Google Scholar 

  • Shuster, J., Perry, A., Bebko, J., & Toplak, M. E. (2014). Review of factor analytic studies examining symptoms of autism spectrum disorders. Journal of Autism and Developmental Disorders, 44(1), 90–110. doi:10.1007/s10803-013-1854-3.

    Article  PubMed  Google Scholar 

  • Siller, M., & Sigman, M. (2008). Modeling longitudinal change in the language abilities of children with autism: Parent behaviors and child characteristics as predictors of change. Developmental Psychology, 44(6), 1691–1704.

    Article  PubMed  Google Scholar 

  • Slaughter, V., & Ong, S. S. (2014). Social behaviors increase more when children with ASD are imitated by their mother versus an unfamiliar adult. Autism Research, 7(5), 582–589. doi:10.1002/aur.1392.

    Article  PubMed  Google Scholar 

  • Sparrow, S. S., Cicchetti, D. V., & Balla, D. A. (2005). Vineland adaptive behavior scales, (Vineland-II). Circle Pines, MN: American Guidance Services.

    Google Scholar 

  • Spence, S., & Thurm, A. (2010). Testing autism interventions: Trials and tribulations. Lancet, 375, 2124–2125.

    Article  PubMed  Google Scholar 

  • Spreckley, M., & Boyd, R. (2009). Efficacy of applied behavioral intervention in preschool children with autism for improving cognitive, language, and adaptive behavior: A systematic review and meta-analysis. Journal of Pediatrics, 154, 338–344.

    Article  PubMed  Google Scholar 

  • Thurm, A., Manwaring, S. S., Swineford, L., & Farmer, C. (2015). Longitudinal study of symptom severity and language in minimally verbal children with autism. Journal of Child Psychology and Psychiatry, 56(1), 97–104. doi:10.1111/jcpp.12285.

    Article  PubMed  Google Scholar 

  • van Lang, N. D., Boomsma, A., Sytema, S., de Bildt, A. A., Kraijer, D. W., Ketelaars, C., & Minderaa, R. B. (2006). Structural equation analysis of a hypothesised symptom model in the autism spectrum. Journal of Child Psychology and Psychiatry, 47(1), 37–44. doi:10.1111/j.1469-7610.2005.01434.x.

    Article  PubMed  Google Scholar 

  • Wetherby, A. M., Guthrie, W., Woods, J., Schatschneider, C., Holland, R. D., Morgan, L., & Lord, C. (2014). Parent-implemented social intervention for toddlers with autism: an RCT. Pediatrics, 134(6), 1084–1093. doi:10.1542/peds.2014-0757.

    Article  PubMed  PubMed Central  Google Scholar 

  • Wolery, M., & Garfinkle, A. (2002). Measures in intervention research with young children who have autism. Journal of Autism and Developmental Disorders, 32(5), 463–478.

    Article  PubMed  Google Scholar 

  • Yoder, P., Bottema-Beutel, K., Woynaroski, T., Chandrasekhar, R., & Sandbank, M. (2013). Social communication intervention effects vary by dependent variable type in preschoolers with autism spectrum disorders. Evidence-Based Communication Assessment and Intervention, 7(4), 150–174.

    Article  PubMed  Google Scholar 

  • Yoder, P., Woynaroski, T., Fey, M., & Warren, S. (2014). Effects of dose frequency of early communication intervention in young children with and without Down syndrome. American Journal on Intellectual and Developmental Disabilities, 119(1), 17–32. doi:10.1352/1944-7558-119.1.17.

    Article  PubMed  PubMed Central  Google Scholar 

  • Zhou, T., & Yi, C. (2014). Parenting styles and parents’ perspectives on how their own emotions affect the functioning of children with autism spectrum disorders. Family Process, 53(1), 67–79. doi:10.1111/famp.12058.

    Article  PubMed  Google Scholar 

Download references

Acknowledgments

This work was supported by a Dennis Weatherstone Predoctoral Fellowship from Autism Speaks and a Graduate Student fellowship with Weill Cornell Medical College and Teachers College, Columbia University awarded to author R.G. Work for this project was also supported by Grants awarded to author C.L. from NIMH (R01MH081757, 1RC1MH089721, R01RFAMH14100, R01MH078165), Autism Speaks (5766), and HRSA (UA3MC11055) and author K.M. from Marilyn and James Simons Family Giving and a NIH T32 (5T32MH016434-35). In addition, this work was partially funded by the UK National Institute for Health Research (NIHR) Biomedical Research Centre at South London and Maudsley NHS Foundation Trust and King’s College London. The views expressed are those of the authors and not necessarily those of the UK NHS, the NIHR or the Department of Health. The authors would like to sincerely thank Catherine Dick, Kyle Frost, Michelle Heyman, Natalie Hong, and Sophie Manevich for assistance with data coding and Sheri Stegall at Western Psychological Services for copyright assistance.

Author Contribution

R.G. participated in study conceptualization, measure development, data coding, analysis, interpretation, and manuscript preparation. T.C. and C.C. participated in conceptualization and development of the Brief Observation of Social Communication Change (BOSCC). K.M. and S.D. participated in study conceptualization, measure development and data coding. A.P. assisted with data analyses and interpretation. C.L. participated in study conceptualization, measure development, data analysis and interpretation, and manuscript preparation.

Funding

This study was funded by NIMH (R01MH081757, 1RC1MH089721, R01RFAMH14100, R01MH078165), NIH (5T32MH016434-35), Autism Speaks (5766, 9650), HRSA (UA3MC11055), a Graduate Student fellowship with Weill Cornell Medical College and Teachers College, Columbia University, Marilyn and James Simons Family Giving, and the UK National Institute for Health Research (NIHR) Biomedical Research Centre at South London and Maudsley NHS Foundation Trust and King’s College London. The views expressed are those of the authors and not necessarily those of the UK NHS, the NIHR or the Department of Health.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Catherine Lord.

Ethics declarations

Conflict of interest

C.L. receives royalties from the sale of the ADI-R and the ADOS-2. All royalties related to the research were donated to a non-profit organization. No other authors have conflicts of interest with regard to this study.

Ethical Approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Informed Consent

Informed consent was obtained from all individual participants included in the study.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (DOCX 1063 kb)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Grzadzinski, R., Carr, T., Colombi, C. et al. Measuring Changes in Social Communication Behaviors: Preliminary Development of the Brief Observation of Social Communication Change (BOSCC). J Autism Dev Disord 46, 2464–2479 (2016). https://doi.org/10.1007/s10803-016-2782-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10803-016-2782-9

Keywords

Navigation