Skip to main content
SpringerLink
Log in

Examining the Psychometric Properties of the Brazilian Ages & Stages Questionnaires-Social-Emotional: Use in Public Child Daycare Centers in Brazil

  • Original Paper
  • Published:
Journal of Child and Family Studies Aims and scope Submit manuscript

Abstract

A mental health evaluation project was conducted in the City of Rio de Janeiro for the entire population of young children who received services in public child daycare centers and preschools. The Brazilian Portuguese version of the Ages & Stages Questionnaires: Social-Emotional (ASQ:SE-BR) served as an outcome measure for social-emotional development. Four age intervals of the ASQ:SE-BR were investigated by time period, 2011 and 2012. A total of 76,806 children from 21 to 66 months were evaluated. Three thousand children were randomly selected from each age interval and year for the analyses. The analyses used unidimensional Rasch Partial Credit Model and multidimensional Rasch Partial Credit Model to evaluate the psychometric properties of the ASQ:SE-BR. The model comparisons indicated support for the one-construct model and the two-construct model, indicating adequate evidence for the internal structure for the ASQ:SE-BR. Only one item was found to have misfit. Sound psychometric properties were supported by the results including internal structure, weighted item fit, reliability, and invariance across years. Item difficulty presented an appropriate coverage across intervals. This study provides supportive evidence for the use and interpretation of ASQ:SE scores with urban low-income Brazilian population.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  • Adams, R. J., Wilson, M. R., & Wang, W. C. (1997). The multidimensional random coefficients multinomial logit model. Applied Psychological Measurement, 21(1), 1–23.

    Article  Google Scholar 

  • Adams, R. J., Wu, M. L., & Wilson, M. R. (2016). ConQuest (Version 4.5) [Computer software]. Camberwell: Australian Council for Educational Research.

    Google Scholar 

  • Achenbach, T. M. (1991). Manual for the Child Behavior Checklist/4-18 and 1991 profile. Burlington, VT: University of Vermont, Department of Psychiatry.

    Google Scholar 

  • Achenbach, T. M. (1993). Manual for the Child Behavior Checklist/2-3 and 1992 profile. Burlington, VT: University of Vermont, Department of Psychiatry.

    Google Scholar 

  • Ackerman, T. A. (1994). Using multidimensional item response theory to understand what items and tests are measuring. Applied Measurement in Education, 7(4), 255–278.

    Article  Google Scholar 

  • Alkherainej, K., & Squires, J. (2016). Accuracy of three screening instruments in identifying preschool children at risk for Autism spectrum disorder. Journal of Intellectual Disability-Diagnosis and Treatment, 3(4), 156–163.

    Article  Google Scholar 

  • American Academy of Pediatrics. (2001). Developmental surveilance and screening of infants and young children. Pediatrics, 108(1), 192–196.

    Article  Google Scholar 

  • American Academy of Pediatrics. (2006). Identifying infants and young children with developmental disorders in the medical home: An alogorithm for developmental surveilance and screening. Pediatrics, 118(1), 405–420.

    Article  Google Scholar 

  • American Educational Research Association [AERA], American Psychological Association [APA], National Council for Measurement in Education [NCME]. (2014). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.

    Google Scholar 

  • Ansley, T. N., & Forsyth, R. A. (1985). An examination of the characteristics of unidimensional IRT parameter estimates derived from two-dimensional data. Applied Psychological Measurement, 9(1), 37–48.

    Article  Google Scholar 

  • Baggett, K. M., Warlen, L., Hamilton, J. L., Roberts, J. L., & Staker, M. (2007). Screening infant mental health indicators: an early head start initiative. Infants and Young Children, 20(4), 300–310.

    Article  Google Scholar 

  • Beeber, L. S., Holditch-Davis, D., Perreira, K., Schwartz, T. A., Lewis, V., & Blanchard, H., et al. (2010). Short-term in-home intervention reduces depressive symptoms in Early Head Start Latina mothers of infants and toddlers. Research in Nursing and Health, 33(1), 60–76.

    PubMed  PubMed Central  Google Scholar 

  • Bond, T., & Fox, C. M. (2015). Applying the Rasch model: Fundamental measurement in the human sciences. New York, NY: Routledge.

    Google Scholar 

  • Brauner, C. B., & Stephens, B. C. (2006). Estimating the prevalence of early childhood serious emotional/behavioral disorder: Challenges and recommendations. Public Health Reports, 121, 303–310.

    Article  PubMed  PubMed Central  Google Scholar 

  • Briggs-Gowan, M. J., Carter, A. S., Irwin, J. R., Wachtel, K., & Cicchetti, D. V. (2004). The brief infant-toddler social and emotional assessment: Screening for social-emotional problems and delays in competence. Journal of Pediatric Psychology, 29(2), 143–155.

    Article  PubMed  Google Scholar 

  • Briggs, R. D., Stettler, E. M., Silver, E. J., Schrag, R. D. A., Nayak, M., Chinitz, S., & Racine, A. D. (2012). Social-emotional screening for infants and toddlers in primary care. Pediatrics, 129(2), e377–e384.

    Article  PubMed  Google Scholar 

  • Campos, J. J., Mumme, D. L., Kermoian, R., & Campos, R. G. (1994). A functionalist perspective on the nature of emotion. Monographs of the Society for Research in Child Development, 59(2-3), 284–303.

    Article  PubMed  Google Scholar 

  • Caselman, T. D., & Self, P. A. (2008). Assessment instruments for measuring young children’s social-emotional behavioral development. Children & Schools, 30(2), 103–115.

    Article  Google Scholar 

  • Chen, C. Y., Filgueiras, A., Squires, J., & Landeira-Fernandez, J. (2016). Examining the factor structure of an early childhood social emotional screening assessment. Journal of Special Education and Rehabilitation, 17(3-4), 89–104.

    Article  Google Scholar 

  • Constituição do Rio de Janeiro (1988). Constituição do Rio de Janeiro [The Constitution of Rio de Janeiro]. http://www.amperj.org.br/store/legislacao/constituicao/cerj.pdf.

  • Denham, S. A., Wyatt, T. M., Bassett, H. H., Echeverria, D., & Knox, S. S. (2009). Assessing social-emotional development in children from a longitudinal perspective. Journal of Epidemiology and Community Health, 63(Suppl 1), i37–i52.

    Article  PubMed  Google Scholar 

  • Dowdy, E., Chin, J. K., & Quirk, M. P. (2013). Preschool screening an examination of the behavioral and emotional screening system preschool teacher form (BESS preschool). Journal of Psychoeducational Assessment, 31(6), 578–584.

    Article  Google Scholar 

  • Embretson, S. E., & Reise, S. (2000). Item response theory for psychologists. Mahwah, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Feeney-Kettler, K. A., Kratochwill, T. R., Kaiser, A. P., Hemmeter, M. L., & Kettler, R. J. (2010). Screening young children’s risk for mental health problems: A review of four measures. Assessment for Effective Intervention, 35(4), 218–230.

    Article  Google Scholar 

  • Filgueiras, A., & Landeira-Fernandez, J. (2014). Políticas públicas na primeira infância: A importância do investimento público adequado e da avaliação global do desenvolvimento [Early childhood public policies: The importance of public investment on a global development assessment]. In A. S. Magalhães (Ed.). Perspectivas contemporâneas da teoria e da prática em psicologia [Contemporary perspectives of theory and practice in psychology] (pp. 213–229). Brazil: Prospectiva Publishers.

    Google Scholar 

  • Filgueiras, A., Pires, P., & Landeira-Fernandez, J. (2014). Screening measures used in child daycare centers: A 15-years systematic review. Psychology, 5(19), 2109–2119.

    Article  Google Scholar 

  • Gokiert, R. J., Georgis, R., Tremblay, M., Krishnan, V., Vandenberghe, C., & Lee, C. (2014). Evaluating the adequacy of social-emotional measures in early childhood. Journal of Psychoeducational Assessment, 32(5), 441–454.

    Article  Google Scholar 

  • Hambleton, R. K., & Jones, R. W. (1993). An NCME instructional module on comparison of classical test theory and item response theory and their applications to test development. Educational Measurement: Issues and Practice, 12(3), 38–47.

    Article  Google Scholar 

  • Hambleton, R. K., & Swaminathan, H. (1985). Item response theory: Principles and applications. Boston: Kluwer Academic.

    Book  Google Scholar 

  • Heo, K. H., & Squires, J. (2012). Cultural adaptation of a parent completed social emotional screening instrument for young children: Ages and stages questionnaire social-emotional. Early Human Development, 88(3), 151–158.

    Article  PubMed  Google Scholar 

  • Indicadores de Dados Básicos (2012). Indicadores socioeconômicos—B.5.1 proporção de pessoas de baixa renda [Socioeconomic indicators—B.5.1 proportion of people with low income]. http://tabnet.datasus.gov.br/cgi/tabnet.exe?idb2012/b0501c.defAccessed.

  • International Test Commission. (2001). International guidelines for test use. International Journal of Testing, 1(2), 93–114.

    Article  Google Scholar 

  • International Test Commission (2005). International guidelines on test adaptation. http://www.intestcom.org.

  • Jee, S. H., Conn, A. M., Szilagyi, P. G., Blumkin, A., Baldwin, C. D., & Szilagyi, M. A. (2010). Identification of social‐emotional problems among young children in foster care. Journal of Child Psychology and Psychiatry, 51(12), 1351–1358.

    Article  PubMed  Google Scholar 

  • Jiang, S., Wang, C., & Weiss, D. J. (2016). Sample size requirements for estimation of item parameters in the multidimensional graded response model. Frontiers in Psychology, 7, 109.

    PubMed  PubMed Central  Google Scholar 

  • Jones, S. M., & Bouffard, S. M. (2012). Social and emotional learning in schools: From programs to strategies. Social Policy Report, 26(4), 1–22.

    Google Scholar 

  • Kettler, R. J., & Feeney‐Kettler, K. A. (2011). Screening systems and decision making at the preschool level: Application of a comprehensive validity framework. Psychology in the Schools, 48(5), 430–441.

    Article  Google Scholar 

  • Kose, I. A., & Demirtasli, N. C. (2012). Comparison of unidimensional and multidimensional models based on item response theory in terms of both variables of test length and sample size. Procedia-Social and Behavioral Sciences, 46, 135–140.

    Article  Google Scholar 

  • Kucuker, S., Kapci, E. G., & Uslu, R. I. (2011). Evaluation of the Turkish version of the “ages and stages questionnaires: Social-Emotional” in identifying children with social-emotional problems. Infants and Young Children, 24(2), 207–220.

    Article  Google Scholar 

  • Marks, K., & LaRosa, A. (2012). Understanding developmental-behavioral screening measures. Pediatrics in Review, 33(10), 448–458.

    Article  PubMed  Google Scholar 

  • Masters, G. N. (1982). A Rasch model for partial credit scoring. Psychometrika, 47(2), 149–174.

    Article  Google Scholar 

  • Meadan, H., Ostrosky, M. M., Zaghlawan, H. Y., & Yu, S. (2012). Using coaching with preschool teachers to support the social skills of children with and without Autism spectrum disorders. International Journal of Early Childhood Special Education, 4(2), 74–94.

    Google Scholar 

  • Raver, C. C., & Zigler, E. F. (1997). Social competence: An untapped dimension in evaluating Head Start’s success. Early Childhood Research Quarterly, 12(4), 363–385.

    Article  Google Scholar 

  • Salvia, J., Ysseldyke, J. E., & Bolt, S. (2013). Assessment in special and inclusive education (12 ed.). Belmont, CA: Wadsworth.

    Google Scholar 

  • Scalise, K. (2012). Crowdsourcing and education with relation to the knowledge economy. In N. Karacapilidis (Ed.). Web-based and blended educational tools and innovations (pp. 136–150). Hershey, PA: IGI Global.

    Google Scholar 

  • Sparrow, S. S., Balla., D. A., & Cicchetti, D. V. (1998). Vineland social-emotional early childhood scale (SEEC). Circle Pines, MN: American Guidance Service.

    Google Scholar 

  • Squires, J., Bricker, D., Heo, K., & Twombly, E. (2001). Identification of social-emotional problems in young children using a parent-completed screening measure. Early Childhood Research Quarterly, 16(4), 405–419.

    Article  Google Scholar 

  • Squires, J., Bricker, D., & Twombly, E. (2002). The ages & stages questionnaires: Social-Emotional. A parent-completed, child-monitoring system for social-emotional behaviors. Baltimore, MD: Paul H. Brookes Publishing.

    Google Scholar 

  • Squires, J., Bricker, D., & Twombly, E. (2011). Ages and stages questionnaire social-emocional Brasil (Hora R, Santana C, & Teixeira M., Trans.). Rio de Janeiro, Brazil: Pontifical Catholic University of Rio de Janeiro.

    Google Scholar 

  • Squires, J., Bricker, D., & Twombly, E. (2015). Ages & stages questionnaires: Social-emotional (2nd ed.). Baltimore, MD: Paul H. Brookes Publishing.

    Google Scholar 

  • Wu, M. L., Adams, R. J., & Wilson, M. R. (1998). The generalised Rasch model ACER ConQuest. Hawthorn, Australia: ACER.

    Google Scholar 

  • Wu, M. L., Adams, R. J., Wilson, M. R., & Haldane, S. A. (2007). ACER ConQuest version 2.0: Generalised item response modelling software [Computer software and manual]. Camberwell, Victoria: ACER Press: Australian Council for Educational Research.

    Google Scholar 

  • Yovanoff, P., & Squires, J. (2006). Determining cutoff scores on a developmental screening measure: Use of receiver operating characteristics and item response theory. Journal of Early Intervention, 29(1), 48–62.

    Article  Google Scholar 

  • Zwick, R., Thayer, D. T., & Lewis, C. (1999). An empirical Bayes approach to Mantel‐Haenszel DIF analysis. Journal of Educational Measurement, 36(1), 1–28.

    Article  Google Scholar 

Download references

Acknowledgements

We acknowledge the many teachers, families and children in Rio de Janeiro that participated in our research study. We thank Dr. Kathleen Scalise and Dr. Ray Adams for their statistical support.

Author information

Authors and Affiliations

  1. Special Education and Clinical Sciences Department, University of Oregon, Oregon, USA

    Chieh-Yu Chen & Jane Squires

  2. National Education Institute, Singapore, Singapore

    Huichao Xie

  3. Department of Fundamentals in Psychology, Rio de Janeiro State University, Rio de Janeiro, Brazil

    Alberto Filgueiras

  4. Department of Psychology, Pontifical Catholic University of Rio de Janeiro, R. Marquês de São Vicente, 225 - Gávea, Rio de Janeiro, RJ, Brazil

    Luis Anunciação & Jesus Landeira-Fernandez

Authors
  1. Chieh-Yu Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Huichao Xie
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Alberto Filgueiras
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jane Squires
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Luis Anunciação
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Jesus Landeira-Fernandez
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jesus Landeira-Fernandez.

Ethics declarations

Conflicts of Interest

The authors declare that they have no competing interests.

Appendix

Appendix

ASQ:SE 24month items example (English)

  1. 1.

    Does your child look at you when you talk to him?

  2. 2.

    Does your child seem too friendly with strangers?

  3. 3.

    Does your child laugh or smile when you play with her?

  4. 4.

    Is your child’s body relaxed?

  5. 5.

    When you leave, does your child remain upset and cry for more than an hour?

  6. 6.

    Does your child greet or say hello to familiar adults?

  7. 7.

    Does your child like to be hugged or cuddled?

  8. 8.

    When upset, can your child calm down within 15 min?

  9. 9.

    Does your child stiffen and arch his back when picked up?

  10. 10.

    Is your child interested in things around her, such as people, toys, and foods?

  11. 11.

    Does your child cry, scream, or have tantrums for long periods of time?

  12. 12.

    Do you and your child enjoy mealtimes together?

  13. 13.

    Does your child have eating problems, such as stuffing foods, vomiting, eating nonfood items, or ____? (You may write in another problem.)

  14. 14.

    Does your child sleep at least 10 h in a 24-h period?

  15. 15.

    When you point at something, does your child look in the direction you are pointing?

  16. 16.

    Does your child have trouble falling asleep at naptime or at night?

  17. 17.

    Does your child get constipated or have diarrhea?

  18. 18.

    Does your child follow simple directions? For example, does he sit down when asked?

  19. 19.

    Does your child let you know how she is feeling with either words or gestures? For example, does she let you know when she is hungry, hurt, or tired?

  20. 20.

    Does your child check to make sure you are near when exploring new places, such as a park or a friend’s home?

  21. 21.

    Does your child do things over and over and can’t seem to stop? Examples are rocking, hand flapping, spinning, or ______. (You may write in something else.)

  22. 22.

    Does your child like to hear stories or sing songs?

  23. 23.

    Does your child hurt himself on purpose?

  24. 24.

    Does your child like to be around other children?

  25. 25.

    Does your child try to hurt other children, adults, or animals (for example, by kicking or biting)?

ASQ:SE 24month items example (Brazilian Portuguese)

  1. 1.

    A criança olha para você quando você fala com ela?

  2. 2.

    A criança parece exageradamente amigável com estranhos? (Se necessário, pergunte aos pais ou responsáveis)

  3. 3.

    A criança ri ou sorri quando você brinca com ela?

  4. 4.

    O corpo da criança é relaxado (não é tenso)?

  5. 5.

    Quando você sai, a criança continua chateada e chora por mais de uma hora?

  6. 6.

    A criança recebe bem ou diz “oi” para adultos conhecidos?

  7. 7.

    A criança gosta de ser abraçada ou aconchegada?

  8. 8.

    Quando está aborrecida, a criança consegue se acalmar em até 15 min?

  9. 9.

    Quando você leva a criança no colo, ela fica rígida e joga as costas para trás (arquear as costas)?

  10. 10.

    A criança tem interesse pelo que está a sua volta, como pessoas, brinquedos e comida?

  11. 11.

    A criança chora, grita ou faz birra por longos períodos de tempo?

  12. 12.

    Você e a criança curtem o momento da refeição juntos? (Se necessário, pergunte aos pais ou responsáveis)

  13. 13.

    A criança tem qualquer tipo de problema para comer, como: se empanturrar, vomitar, comer coisas que não são alimentos ou ____ (você pode anotar outro problema)?

  14. 14.

    A criança dorme pelo menos 10 horas em um período de 24 horas? (Se necessário, pergunte aos pais ou responsáveis)

  15. 15.

    Quando você aponta para alguma coisa, a criança olha na direção em que você está apontando?

  16. 16.

    A criança tem dificuldade em adormecer na hora do soninho ou à noite?

  17. 17.

    A criança tem prisão de ventre ou diarreia?

  18. 18.

    A criança segue instruções simples? Por exemplo, ela senta quando pedem?

  19. 19.

    A criança o avisa como está se sentindo com gestos ou palavras? Por exemplo, ela te avisa quando está com fome, machucada ou cansada?

  20. 20.

    A criança se certifica de que você está por perto quando explora lugares novos, como um parque ou a casa de um amigo? (Se necessário, pergunte aos pais ou responsáveis)

  21. 21.

    A criança faz movimentos repetitivos e parece não conseguir parar? Por exemplo, se balançar, sacudir as mãos, rodar ou ____ (você pode anotar outra coisa)?

  22. 22.

    A criança gosta de ouvir histórias ou cantar músicas?

  23. 23.

    A criança se machuca de propósito?

  24. 24.

    A criança gosta de estar com outras crianças?

  25. 25.

    A criança tenta machucar outras crianças, adultos ou animais (por exemplo, chutando ou mordendo)?

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chen, CY., Xie, H., Filgueiras, A. et al. Examining the Psychometric Properties of the Brazilian Ages & Stages Questionnaires-Social-Emotional: Use in Public Child Daycare Centers in Brazil. J Child Fam Stud 26, 2412–2425 (2017). https://doi.org/10.1007/s10826-017-0770-0

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10826-017-0770-0

Keywords

Search

Navigation