1887
Volume 171, Issue 1
  • ISSN 0019-0829
  • E-ISSN: 1783-1490
GBP
Buy:£15.00 + Taxes

Abstract

Abstract

The present study investigated second language acquisition (SLA) doctoral students’ statistical training and knowledge of statistics. One hundred and twenty SLA doctoral students in North America took a comprehensive statistics survey, and 16 of them participated in follow-up interviews. The results showed that doctoral students were well trained in basic descriptive statistics, while their training in inferential statistics, particularly advanced statistics, was limited. When looking at their statistical knowledge, the results indicated that SLA doctoral students were good at understanding descriptive and inferential statistics, but they found it hard to interpret statistical analyses related to inferential statistics that are commonly encountered in SLA research. Several suggestions directed toward improving statistical literacy in SLA were provided.

Loading

Article metrics loading...

/content/journals/10.1075/itl.18031.gon
2019-04-02
2024-04-18
Loading full text...

Full text loading...

References

  1. Aiken, L. S., West, S. G., & Millsap, R. E.
    (2008) Doctoral training in statistics, measurement, and methodology in psychology: Replication and extension of Aiken, West, Sechrest, and Reno’s (1990) survey of PhD programs in North America. American Psychologist, 63(1), 32–50. 10.1037/0003‑066X.63.1.32
    https://doi.org/10.1037/0003-066X.63.1.32 [Google Scholar]
  2. Aiken, L. S., West, S. G., Sechrest, L., & Reno, R. R.
    (1990) Graduate training in statistics, methodology, and measurement in psychology: A survey of PhD programs in North America. American Psychologist, 45(6), 721–734. 10.1037/0003‑066X.45.6.721
    https://doi.org/10.1037/0003-066X.45.6.721 [Google Scholar]
  3. Borders, L. D., Wester, K. L., Fickling, M. J., & Adamson, N. A.
    (2014) Research training in doctoral programs accredited by the council for accreditation of counseling and related educational programs. Counselor Education and Supervision, 53(2), 145–160. 10.1002/j.1556‑6978.2014.00054.x
    https://doi.org/10.1002/j.1556-6978.2014.00054.x [Google Scholar]
  4. Brown, J. D.
    (2004) Resources on quantitative/statistical research for applied linguists. Second Language Research, 20(4), 372–393. 10.1191/0267658304sr245ra
    https://doi.org/10.1191/0267658304sr245ra [Google Scholar]
  5. (2013) Teaching statistics in language testing courses. Language Assessment Quarterly, 10(3), 351–369. 10.1080/15434303.2013.769554
    https://doi.org/10.1080/15434303.2013.769554 [Google Scholar]
  6. (2015) Why bother learning advanced quantitative methods in L2 research?InL. Plonsky (Ed), Advancing quantitative methods in second language research. New York: Routledge. 10.4324/9781315870908‑2
    https://doi.org/10.4324/9781315870908-2 [Google Scholar]
  7. Brown, J. D., & Bailey, K. M.
    (2008) Language testing courses: What are they in 2007? Language Testing, 25(3), 349–383. 10.1177/0265532208090157
    https://doi.org/10.1177/0265532208090157 [Google Scholar]
  8. Capraro, R. M., & Thompson, B.
    (2008) The educational researcher defined: What will future researchers be trained to do?The Journal of Educational Research, 101(4), 247–253. 10.3200/JOER.101.4.247‑253
    https://doi.org/10.3200/JOER.101.4.247-253 [Google Scholar]
  9. Chaudron, C.
    (2001) Progress in language classroom research: Evidence from The Modern Language Journal, 1916–2000. Modern Language Journal, 85, 57–76. 10.1111/0026‑7902.00097
    https://doi.org/10.1111/0026-7902.00097 [Google Scholar]
  10. Creswell, J. W.
    (2013) Qualitative inquiry and research design: Choosing among five approaches. Los Angeles, CA: SAGE.
    [Google Scholar]
  11. Creswell, J. W., & Clark, V. L. P.
    (2011) Designing and conducting mixed methods research. Los Angeles, CA: SAGE.
    [Google Scholar]
  12. Cunnings, I.
    (2012) An overview of mixed-effects statistical models for second language researchers. Second Language Research, 28(3), 369–382. 10.1177/0267658312443651
    https://doi.org/10.1177/0267658312443651 [Google Scholar]
  13. Curtis, D. A., & Harwell, M.
    (1998) Training doctoral students in educational statistics in the United States: A national survey. Journal of Statistics Education, 6(1), 1–23. 10.1080/10691898.1998.11910604
    https://doi.org/10.1080/10691898.1998.11910604 [Google Scholar]
  14. Field, A.
    (2013) Discovering statistics using IBM SPSS statistics. London: SAGE.
    [Google Scholar]
  15. Finney, S. & Schraw, G.
    (2003) Self-efficacy beliefs in college statistics courses. Contemporary Educational Psychology, 28, 161–186. 10.1016/S0361‑476X(02)00015‑2
    https://doi.org/10.1016/S0361-476X(02)00015-2 [Google Scholar]
  16. Gass, S.
    (2009) A survey of SLA research. InW. Ritchie & T. Bhatia (Eds.), Handbook of second language acquisition (pp.3–28). Bingley, UK: Emerald.
    [Google Scholar]
  17. Golinski, C., & Cribbie, R. A.
    (2009) The expanding role of quantitative methodologists in advancing psychology. Canadian Psychology/Psychologie canadienne, 50(2), 83–90. 10.1037/a0015180
    https://doi.org/10.1037/a0015180 [Google Scholar]
  18. Gonulal, T.
    (2016) Statistical literacy among second language acquisition graduate students. Unpublished dissertation. Michigan State University, East Lansing.
  19. (2018) An investigation of the predictors of statistical literacy in second language acquisition. Eurasian Journal of Applied Linguistics, 4(1), 49–70. 10.32601/ejal.460631
    https://doi.org/10.32601/ejal.460631 [Google Scholar]
  20. (2019) Missing data management practices in L2 research: The good, the bad and the ugly. Erzincan University Education Faculty Journal, 21(1), 1–18.
    [Google Scholar]
  21. Gonulal, T., Loewen, S., & Plonsky, L.
    (2017) The development of statistical literacy in applied linguistics graduate students. ITL – International Journal of Applied Linguistics, 168(1), 4–32. 10.1075/itl.168.1.01gon
    https://doi.org/10.1075/itl.168.1.01gon [Google Scholar]
  22. Henson, R. K., Hull, D. M., & Williams, C. S.
    (2010) Methodology in our education research culture toward a stronger collective quantitative proficiency. Educational Researcher, 39(3), 229–240. 10.3102/0013189X10365102
    https://doi.org/10.3102/0013189X10365102 [Google Scholar]
  23. Jones, M.
    (2013) Issues in doctoral studies – Forty years of journal discussion: Where have we been and where are we going?International Journal of Doctoral Studies, 8, 83–104. 10.28945/1871
    https://doi.org/10.28945/1871 [Google Scholar]
  24. Kline, P.
    (1999) The handbook of psychological testing. London: Routledge.
    [Google Scholar]
  25. Larson-Hall, J.
    (2015) A guide to doing statistics in second language research using SPSS and R (2nd ed.). New York, NY: Routledge. 10.4324/9781315775661
    https://doi.org/10.4324/9781315775661 [Google Scholar]
  26. Larson-Hall, J., & Herrington, R.
    (2010) Improving data analysis in second language acquisition by utilizing modern developments in applied statistics. Applied Linguistics, 31(3), 368–390. 10.1093/applin/amp038
    https://doi.org/10.1093/applin/amp038 [Google Scholar]
  27. Larson-Hall, J., & Plonsky, L.
    (2015) Reporting and interpreting quantitative research findings: What gets reported and recommendations for the field. Language Learning, 65(S1), 127–159. 10.1111/lang.12115
    https://doi.org/10.1111/lang.12115 [Google Scholar]
  28. Lazaraton, A.
    (2000) Current trends in research methodology and statistics in applied linguistics. TESOL Quarterly, 34(1), 175–181. 10.2307/3588103
    https://doi.org/10.2307/3588103 [Google Scholar]
  29. (2005) Quantitative research methods. InE. Hinkel (Ed.), Handbook of research in second language teaching and learning (pp.109–224). Mahwah, NJ: Lawrence Erlbaum Associates.
    [Google Scholar]
  30. Lazaraton, A., Riggenbach, H., & Ediger, A.
    (1987) Forming a discipline: Applied linguists’ literacy in research methodology and statistics. TESOL Quarterly, 21(2), 263–277. 10.2307/3586735
    https://doi.org/10.2307/3586735 [Google Scholar]
  31. Leech, N. L., & Goodwin, L. D.
    (2008) Building a methodological foundation: Doctoral-level methods courses in colleges of education. Research in the Schools, 15(1), 1–8.
    [Google Scholar]
  32. Loewen, S., Gonulal, T., Isbell, D. R., Ballard, L., Crowther, D., Lim, J., Maloney, J., & Tigchelaar, M.
    (forthcoming). How knowledgeable are SLA researchers about basic statistics? Data from North America and Europe. Studies in Second Language Acquisition.
    [Google Scholar]
  33. Loewen, S., & Gass, S.
    (2009) Research timeline: The use of statistics in L2 acquisition research. Language Teaching, 42(2), 181–196. 10.1017/S0261444808005624
    https://doi.org/10.1017/S0261444808005624 [Google Scholar]
  34. Loewen, S., & Gonulal, T.
    (2015) Exploratory factor analysis and principal components analysis. InPlonsky, L. (Ed), Advancing quantitative methods in second language research. New York: Routledge. 10.4324/9781315870908‑9
    https://doi.org/10.4324/9781315870908-9 [Google Scholar]
  35. Loewen, S., Lavolette, E., Spino, L. A., Papi, M., Schmidtke, J., Sterling, S., & Wolff, D.
    (2014) Statistical literacy among applied linguists and second language acquisition researchers. TESOL Quarterly, 48(2), 360–388. 10.1002/tesq.128
    https://doi.org/10.1002/tesq.128 [Google Scholar]
  36. Mackey, A., & Gass, S. M.
    (2015) Second language research: Methodology and design. New York: Routledge. 10.4324/9781315750606
    https://doi.org/10.4324/9781315750606 [Google Scholar]
  37. Norris, J. M.
    (2015) Statistical significance testing in second language research: Basic problems and suggestions for reform. Language Learning, 65(S1), 97–126. 10.1111/lang.12114
    https://doi.org/10.1111/lang.12114 [Google Scholar]
  38. Norris, J. M., Ross, S. J., & Schoonen, R.
    (2015) Improving second language quantitative research. Language Learning, 65(S1), 1–8. 10.1111/lang.12110
    https://doi.org/10.1111/lang.12110 [Google Scholar]
  39. Norouzian, R., & Plonsky, L.
    (2018) Eta- and partial eta-squared in L2 research: A cautionary review and guide to more appropriate usage. Second Language Research, 34(2), 257–271. 10.1177/0267658316684904
    https://doi.org/10.1177/0267658316684904 [Google Scholar]
  40. Pierce, R., & Chick, H.
    (2013) Workplace statistical literacy for teachers: Interpreting box plots. Mathematics Education Research Journal, 25(2), 189–205. 10.1007/s13394‑012‑0046‑3
    https://doi.org/10.1007/s13394-012-0046-3 [Google Scholar]
  41. Plonsky, L.
    (2011) Study quality in SLA: A cumulative and developmental assessment of designs, analyses, reporting practices, and outcomes in quantitative L2 research (Unpublished doctoral dissertation). Michigan State University, East Lansing, MI.
  42. (2013) Study quality in SLA: An assessment of designs, analyses, and reporting practices in quantitative L2 research. Studies in Second Language Acquisition, 35(4), 655–687. 10.1017/S0272263113000399
    https://doi.org/10.1017/S0272263113000399 [Google Scholar]
  43. (2014) Study quality in quantitative L2 research (1990–2010): A methodological synthesis and call for reform. The Modern Language Journal, 98(1), 450–470. 10.1111/j.1540‑4781.2014.12058.x
    https://doi.org/10.1111/j.1540-4781.2014.12058.x [Google Scholar]
  44. (Ed.) (2015) Advancing quantitative methods in second language research. New York: Routledge. 10.4324/9781315870908
    https://doi.org/10.4324/9781315870908 [Google Scholar]
  45. Plonsky, L., & Derrick, D. J.
    (2016) A meta-analysis of reliability coefficients in second language research. The Modern Language Journal, 100(2), 538–553. 10.1111/modl.12335
    https://doi.org/10.1111/modl.12335 [Google Scholar]
  46. Plonsky, L., & Gass, S.
    (2011) Quantitative research methods, study quality, and outcomes: The case of interaction research. Language Learning, 61(2), 325–366. 10.1111/j.1467‑9922.2011.00640.x
    https://doi.org/10.1111/j.1467-9922.2011.00640.x [Google Scholar]
  47. Plonsky, L., & Gonulal, T.
    (2015) Methodological synthesis in quantitative L2 research: A review of reviews and a case study of exploratory factor analysis. Language Learning, 65(S1), 9–36. 10.1111/lang.12111
    https://doi.org/10.1111/lang.12111 [Google Scholar]
  48. Plonsky, L., Egbert, J., & LaFlair, G. T.
    (2014) Bootstrapping in applied linguistics: Assessing its potential using shared data. Applied Linguistics, 36(5), 591–610.
    [Google Scholar]
  49. Plonsky, L., & Oswald, F. L.
    (2017) Multiple regression as a flexible alternative to ANOVA in L2 research. Studies in Second Language Acquisition, 39(3), 579–592. 10.1017/S0272263116000231
    https://doi.org/10.1017/S0272263116000231 [Google Scholar]
  50. Polio, C., & Gass, S.
    (1997) Replication and reporting. Studies in Second Language Acquisition, 19(4), 499–508. 10.1017/S027226319700404X
    https://doi.org/10.1017/S027226319700404X [Google Scholar]
  51. Rossen, E., & Oakland, T.
    (2008) Graduate preparation in research methods: The current status of APA-accredited professional programs in psychology. Training and Education in Professional Psychology, 2(1), 42–49. 10.1037/1931‑3918.2.1.42
    https://doi.org/10.1037/1931-3918.2.1.42 [Google Scholar]
  52. Schafer, J. L., & Graham, J. W.
    (2002) Missing data: Our view of the state of the art. Psychological Methods, 7(2), 144–177. 10.1037/1082‑989X.7.2.147
    https://doi.org/10.1037/1082-989X.7.2.147 [Google Scholar]
  53. Schield, M.
    (1999) Statistical literacy: Thinking critically about statistics. Of Significance, 1(1), 15–20.
    [Google Scholar]
  54. (2002) Statistical Literacy Survey. Retrieved fromwww.StatLit.org/pdf/2006SchieldIASSIST.pdf
    [Google Scholar]
  55. (2004) Statistical literacy and liberal education at Augsburg College. Peer Review, 6, 16–18. Retrieved fromwww.StatLit.org/pdf/2004SchieldAACU.pdf
    [Google Scholar]
  56. (2010) Assessing statistical literacy: Take CARE. InP. Bidgood, N. Hunt & F. Jolliffe (Eds) Assessment Methods in Statistical Education: An International Perspective. John Wiley & Sons Ltd.. 10.1002/9780470710470.ch11
    https://doi.org/10.1002/9780470710470.ch11 [Google Scholar]
  57. Skidmore, S. T., & Thompson, B.
    (2010) Statistical techniques used in published articles: A historical review of reviews. Educational and Psychological Measurement, 70(5), 777–795. 10.1177/0013164410379320
    https://doi.org/10.1177/0013164410379320 [Google Scholar]
  58. Tabachnick, B., & Fidell, L.
    (2013) Using multivariate statistics (6th ed.). Boston: Pearson Education.
    [Google Scholar]
  59. Thompson, B.
    (1999) Five methodology errors in educational research: A pantheon of statistical significance and other faux pas. InB. Thompson (Ed.), Advances in social science methodology (Vol.5, pp.23–86). Stamford, CT: JAI Press.
    [Google Scholar]
  60. Wallman, K. K.
    (1993) Enhancing statistical literacy: Enriching our society. Journal of the American Statistical Association, 88(421), 1–8.
    [Google Scholar]
  61. Winke, P.
    (2014) Testing hypotheses about language learning using structural equation modeling. Annual Review of Applied Linguistics, 34, 102–122. 10.1017/S0267190514000075
    https://doi.org/10.1017/S0267190514000075 [Google Scholar]
  62. Zimiles, H.
    (2009) Ramifications of increased training in quantitative methodology. American Psychologist, 64(1), 51–56. 10.1037/a0013717
    https://doi.org/10.1037/a0013717 [Google Scholar]
http://instance.metastore.ingenta.com/content/journals/10.1075/itl.18031.gon
Loading
/content/journals/10.1075/itl.18031.gon
Loading

Data & Media loading...

This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error