Skip to main content
Log in

Testing a Bifactor Model of Relational and Physical Aggression in Early Childhood

  • Published:
Journal of Psychopathology and Behavioral Assessment Aims and scope Submit manuscript

Abstract

Different approaches have been used to classify children as relationally aggressive, physically aggressive, or both relationally and physically aggressive (co-occurring aggression). The goal of the current study (N = 164, 50.9% boys, M age = 47.75 months, SD = 7.37) was to test a bifactor model of aggression, which allows for aggression to be assessed dimensionally, and postulates a co-occurring aggression factor as well as unique relational and physical aggression factors, during early childhood. Aggression was measured using reliable observer and teacher reports of physical and relational aggression subscales. The two-factor model was an adequate fit to the data but the bifactor model was a significant improvement in model fit compared to the two-factor model. Alternative statistics for evaluating bifactor models were used in the current study. The measurement invariance (e.g., configural invariance, metric invariance, and scalar invariance) of the bifactor model was tested across gender and results from the bifactor model using teacher report showed that the model was invariant across gender. Lastly, the criterion validity of the model was examined by evaluating the relations between the bifactor model and observations of physical and relational aggression and results generally supported the validity of the bifactor model. Overall, results suggest that a bifactor model of aggression may be a useful method for studying aggression in early childhood.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1

Similar content being viewed by others

References

  • Bonifay, W., Lane, S. P., & Reise, S. P. (2016). Three concerns with applying a bifactor model as structure of psychopathology. Clinical Psychological Science, 5, 184–186. doi:10.1177/2167702616657069.

    Article  Google Scholar 

  • Browne, M. W., & Cudeck, R. (1992). Alternative ways of assessing model fit. Sociological Methods & Research, 21, 230–258.

    Article  Google Scholar 

  • Card, N. A., Stucky, B. D., Sawalani, G. M., & Little, T. D. (2008). Direct and indirect aggression during childhood and adolescence: a meta-analytic review of gender differences, intercorrelations, and relations to maladjustment. Child Development, 79, 1185–1229. doi:10.1111/j.1467-8624.2008.01184.x.

    Article  PubMed  Google Scholar 

  • Carragher, N., & McWilliams, L. A. (2011). A latent class analysis of DSM-IV criteria for pathological gambling: results from the National Epidemiologic Survey on alcohol and related conditions. Psychiatry Research, 187, 185–192. doi:10.1016/j.psychres.2010.12.022.

    Article  PubMed  Google Scholar 

  • Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14, 464–504.

    Article  Google Scholar 

  • Chen, F. F., Hayes, A., Carver, C. S., Laurenceau, J., & Zhang, Z. (2012). Modeling general and specific variance in multifaceted constructs: a comparison of the bifactor model to other approaches. Journal of Personality, 80, 219–251. doi:10.1111/j.14676494.2011.00739.x.

    Article  PubMed  Google Scholar 

  • Côté, S. M., Vaillancourt, T., LeBlanc, J. C., Nagin, D. S., & Tremblay, R. E. (2006). The development of physical aggression from toddlerhood to pre-adolescence: a nation wide longitudinal study of Canadian children. Journal of Abnormal Child Psychology, 34, 71–85. doi:10.1007/s10802-005-9001-z.

    Article  PubMed  Google Scholar 

  • Crick, N. R. (1997). Engagement in gender normative versus nonnormative forms of aggression: links to social psychological adjustment. Developmental Psychology, 33, 610–617. doi:10.1037/0012-1649.33.4.610.

    Article  PubMed  Google Scholar 

  • Crick, N. R., & Grotpeter, J. K. (1995). Relational aggression, gender, and social-psychological adjustment. Child Development, 66, 710–722. doi:10.2307/1131945.

    Article  PubMed  Google Scholar 

  • Crick, N. R., & Zahn-Waxler, C. (2003). The development of psychopathology in females and males: current progress and future challenges. Development and Psychopathology, 15, 719–742. doi:10.1017/S095457940300035X.

    Article  PubMed  Google Scholar 

  • Crick, N. R., Casas, J. F., & Mosher, M. (1997). Relational and overt aggression in preschool. Developmental Psychology, 33, 579–588. doi:10.1037/0012-1649.33.4.579.

    Article  PubMed  Google Scholar 

  • Crick, N. R., Ostrov, J. M., Appleyard, K., Jansen, E. A., & Casas, J. F. (2004). Relational aggression in early childhood: 'You can't come to my birthday party unless...'. In M. Putallaz & K. L. Bierman (Eds.), Aggression, antisocial behavior, and violence among girls: A developmental perspective (pp. 71–89). New York: Guilford Publications.

    Google Scholar 

  • Crick, N. R., Ostrov, J. M., Burr, J. E., Cullerton-Sen, C., Jansen-Yeh, E., & Ralston, P. (2006a). A longitudinal study of relational and physical aggression in preschool. Journal of Applied Developmental Psychology, 27, 254–268. doi:10.1016/j.appdev.2006.02.006.

    Article  Google Scholar 

  • Crick, N. R., Ostrov, J. M., & Werner, N. E. (2006b). A longitudinal study of relational aggression, physical aggression, and children's social-psychological adjustment. Journal of Abnormal Child Psychology, 34, 131–142. doi:10.1007/s10802-005-9009-4.

    Article  PubMed  Google Scholar 

  • Dodge, K. A., Coie, J. D., & Lynam, D. (2006). Aggression and antisocial behavior in youth In W. Damon (series Ed.) & N. Eisenberg (Vol. Ed.), Handbook of child psychology: Vol. 3, Social, emotional, and personality development (6th ed., pp. 719-788). Hoboken: Wiley.

  • Ebesutani, C., McLeish, A. C., Luberto, C. M., Young, J., & Maack, D. J. (2014). A bifactor model of anxiety sensitivity: analysis of the anxiety sensitivity index-3. Journal of Psychopathology and Behavioral Assessment, 36, 452–464. doi:10.1007/s10862-013-9400-3.

    Article  Google Scholar 

  • Ettekal, I., & Ladd, G. W. (2015). Costs and benefits of children’s physical and relational aggression trajectories on peer rejection, acceptance, and friendships: variations by aggression subtypes, gender, and age. Developmental Psychology, 51, 1756–1770. doi:10.1037/dev0000057.

    Article  PubMed  Google Scholar 

  • Hancock, G. R., & Mueller, R. O. (2001). Rethinking construct reliability within latent variable systems. In R. Cudeck, S. du Toit, & D. Sörbom (Eds.), Structural equation modeling: Present and future—A Festschrift in honor of Karl Jöreskog (pp. 195–216). Lincolnwood, IL: Scientific Software International.

    Google Scholar 

  • Hartup, W. W., & Stevens, N. (1999). Friendships and adaptation across the life span. Current Directions in Psychological Science, 8, 76–79. doi:10.1111/1467-8721.00018.

    Article  Google Scholar 

  • Hooper, D., Coughlan, J., & Mullen, M. R. (2008). Structural equation modeling: guidelines for determining model fit. Electronic Journal of Business Research Methods, 6, 53–60.

    Google Scholar 

  • Hu, L.-T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55. doi:10.1080/10705519909540118.

    Article  Google Scholar 

  • Kline, R. B. (2011). Principles and practice of structural equation modeling (3rd ed.). New York: Guilford Press.

    Google Scholar 

  • Kreft, I. G. G., & De Leeuw, J. (1998). Introducing multilevel modeling. Newbury Park: Sage.

    Book  Google Scholar 

  • Krueger, R. F., Markon, K. E., Patrick, C. J., Benning, S. D., & Kramer, M. D. (2007). Linking antisocial behavior, substance use, and personality: an integrative quantitative model of the adult externalizing spectrum. Journal of Abnormal Psychology, 116, 645–666. doi:10.1037/0021-843X.116.4.645.

    Article  PubMed  PubMed Central  Google Scholar 

  • Lansford, J. E., Skinner, A. T., Sorbring, E., Giunta, L. D., Deater-Deckard, K., Dodge, K. A., et al. (2012). Boys’ and girls’ relational and physical aggression in nine countries. Aggressive Behavior, 38(298), 308. doi:10.1002/ab.21433.

    Google Scholar 

  • Li, C. (2016). Confirmatory factor analysis with ordinal data: comparing robust maximum likelihood and diagonally weighted least squares. Behavior Research Methods, 48, 936–949. doi:10.3758/s13428-015-0619-7.

    Article  PubMed  Google Scholar 

  • Lightdale, J. R., & Prentice, D. A. (1994). Rethinking sex differences in aggression: aggressive behavior in the absence of social roles. Personality and Social Psychology Bulletin, 20, 34–44. doi:10.1177/0146167294201003.

    Article  Google Scholar 

  • Little, T. D., Jones, S. M., Henrich, C. C., & Hawley, P. H. (2003). Disentangling the “whys” from the “whats” of aggressive behaviour. International Journal of Behavioral Development, 27, 122–133. doi:10.1080/01650250244000128.

    Article  Google Scholar 

  • MacCallum, R. C., Browne, M. W., & Sugawara, H. M. (1996). Power analysis and determination of sample size for covariance structure modeling. Psychological Methods, 1, 130–149. doi:10.1037/1082-989X.1.2.130.

    Article  Google Scholar 

  • MacCallum, R. C., Zhang, S., Preacher, K. J., & Rucker, D. D. (2002). On the practice of dichotomization of quantitative variables. Psychological Methods, 7, 19–40. doi:10.1037/1082-989X.7.1.19.

    Article  PubMed  Google Scholar 

  • Maccoby, E. E. (1990). Gender and relationships: a developmental account. American Psychologist, 45, 513–520. doi:10.1037/0003-066X.45.4.513.

    Article  PubMed  Google Scholar 

  • Miller, G. A., & Chapman, J. P. (2001). Misunderstanding analysis of covariance. Journal of Abnormal Psychology, 110, 40–48. doi:10.1037/0021-843X.110.1.40.

    Article  PubMed  Google Scholar 

  • Murray-Close, D., & Ostrov, J. M. (2009). A longitudinal study of forms and functions of aggressive behavior in early childhood. Child Development, 80, 828–842. doi:10.1111/j.1467-8624.2009.01300.x.

    Article  PubMed  Google Scholar 

  • Murray-Close, D., Nelson, D. A., Ostrov, J. M., Casas, J. F., & Crick, N. R. (2016). Relational aggression: A developmental psychopathology perspective. In D. Cicchetti (Ed.), Developmental psychopathology (3rd ed., pp. 660–722). New York: Wiley.

    Google Scholar 

  • Muthén, L. K. (2015). Re: testing for measurement and structural equivalence [Online discussion group]. Retrieved from: http://www.statmodel.com/discussion/messages/11/21028.html?1429024985.

  • Muthén, L. K., & Muthén, B. O. (1998-2015). Mplus (version 7.4). Los Angeles: Muthén & Muthén.

  • NICHD Early Child Care and Research Network. (2004). Trajectories of physical aggression from toddlerhood to middle childhood: III. Person-centered trajectories of physical aggression. Monographs of the Society for Research in Child Development, 69, 41–49.

    Google Scholar 

  • Ostrov, J. M. (2008). Forms of aggression and peer victimization during early childhood: a short-term longitudinal study. Journal of Abnormal Child Psychology, 36, 311–322. doi:10.1007/s10802-007-9179-3.

    Article  PubMed  Google Scholar 

  • Ostrov, J. M., & Hart, E. J. (2013). Observational methods. In T. D. Little (Ed.), The Oxford handbook of quantitative methods (vol. 1): Foundations (pp. 286–304). New York: Oxford University Press.

    Google Scholar 

  • Ostrov, J. M., & Kamper, K. E. (2015). Future directions for research on the development of relational and physical peer victimization. Journal of Clinical Child and Adolescent Psychology, 44, 509–519. doi:10.1080/15374416.2015.1012723.

    Article  PubMed  Google Scholar 

  • Ostrov, J. M., & Keating, C. F. (2004). Gender differences in preschool aggression during free play and structured interactions: an observational study. Social Development, 13, 255–277. doi:10.1111/j.14679507.2004.000266.x.

    Article  Google Scholar 

  • Ostrov, J. M., Ries, E. E., Stauffacher, K., Godleski, S. A., & Mullins, A. D. (2008). Relational aggression, physical aggression and deception during early childhood: a multimethod, multi-informant short-term longitudinal study. Journal of Clinical Child and Adolescent Psychology, 37, 664–675. doi:10.1080/15374410802148137.

    Article  PubMed  Google Scholar 

  • Ostrov, J. M., Gentile, D. A., & Mullins, A. D. (2013). Evaluating the effect of educational media exposure on aggression in early childhood. Journal of Applied Developmental Psychology, 34, 38–44. doi:10.1016/j.appdev.2012.09.005.

    Article  Google Scholar 

  • Ostrov, J. M., Kamper, K. E., Hart, E. J., Godleski, S. A., & Blakely-McClure, S. J. (2014). A gender-balanced approach to the study of peer victimization and aggression subtypes in early childhood. Development and Psychopathology, 26, 575–587. doi:10.1017/S0954579414000248.

    Article  PubMed  Google Scholar 

  • Rhemtulla, M., Brosseau-Liard, P. É., & Savalei, V. (2012). When can categorical variables be treated as continuous? A comparison of robust continuous and categorical SEM estimation methods under suboptimal conditions. Psychological Methods, 17, 354–373. doi:10.1037/a0029315.

    Article  PubMed  Google Scholar 

  • Rodenacker, K., Hautmann, C., Görtz-Dorten, A., & Döpfner, M. (2016). The factor structure of adhd – Different models, analyses and informants in a bifactor framework. Journal of Psychopathology and Behavioral Assessment, 39, 92–102. doi:10.1007/s10862-016-9565-7.

    Article  Google Scholar 

  • Rodriguez, A., Reise, S. P., & Haviland, M. G. (2016a). Applying bifactor statistical indices in the evaluation of psychological measures. Journal of Personality Assessment, 98, 223–237. doi:10.1080/00223891.2015.1089249.

    Article  PubMed  Google Scholar 

  • Rodriguez, A., Reise, S. P., & Haviland, M. G. (2016b). Evaluating bifactor models: calculating and interpreting statistical indices. Psychological Methods, 21, 137–150. doi:10.1037/met0000045.

    Article  PubMed  Google Scholar 

  • Satorra, A., & Bentler, P. M. (2010). Ensuring positiveness of the scaled difference chi-square test statistic. Psychometrika, 75, 243–248. doi:10.1007/s11336-009-9135-y.

    Article  PubMed  PubMed Central  Google Scholar 

  • Schmitt, N., & Kuljanin, G. (2008). Measurement invariance: review of practice and implications. Human Resource Management Review, 18, 210–222. doi:10.1016/j.hrmr.2008.03.003.

    Article  Google Scholar 

  • Smith, R. L., Rose, A. J., & Schwartz-Mette, R. A. (2010). Relational and overt aggression in childhood and adolescence: clarifying mean-level gender differences and associations with peer acceptance. Social Development, 19, 243–269. doi:10.1111/j.14679507.2009.00541.x.

    Article  Google Scholar 

  • Steiger, J. H. (1990). Structural model evaluation and modification: an interval estimation approach. Multivariate Behavioral Research, 25, 173–180.

    Article  PubMed  Google Scholar 

  • Tackett, J. L., & Ostrov, J. M. (2010). Measuring relational aggression in middle childhood in a multi-informant multi-method study. Journal of Psychopathology and Behavioral Assessment, 32, 490–500. doi:10.1007/s10862-010-9184-7.

    Article  Google Scholar 

  • Tackett, J. L., Daoud, S. B., De Bolle, M., Burt, S. A. (2013). Is relational aggression part of the externalizing spectrum? A bifactor model of youth antisocial behavior. Aggressive Behavior, 39, 149–159. doi:10.1002/ab.21466.

  • U.S. Census Bureau (2010). Community facts. Retrieved from https://factfinder.census.gov/faces/nav/jsf/pages/community_facts.xhtml?src=bkmk.

  • Yoon, M., & Millsap, R. E. (2007). Detecting violations of factorial invariance using data-based specification searches: a Monte Carlo study. Structural Equation Modeling, 14, 435–463. doi:10.1080/10705510701301677.

    Article  Google Scholar 

Download references

Acknowledgements

We thank the UB Social Development Lab for their assistance and special thanks to Dr. Kimberly Kamper-DeMarco and Sarah Blakely-McClure for methodological assistance and coordination of the data collection, Amanda Levy for reference checking, and Miriam Stotsky for APA and formatting consultation. We are grateful to the families, teachers, and administrators of participating schools.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kristin J. Perry.

Ethics declarations

Ethical Approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Informed Consent

Informed consent was obtained from all individual participants included in the study.

Funding

Preparation of this manuscript was facilitated by a grant from the National Science Foundation to the second author (BCS-1450777).

Conflict of Interest

The authors declare that they have no conflict of interest.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Perry, K.J., Ostrov, J.M. Testing a Bifactor Model of Relational and Physical Aggression in Early Childhood. J Psychopathol Behav Assess 40, 93–106 (2018). https://doi.org/10.1007/s10862-017-9623-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10862-017-9623-9

Keywords

Navigation