Adam Scott Carter
Christopher David Hundhausen
ABSTRACT
Analyzing the process data of students as they complete programming assignments has the potential to provide computing educators with insights into their students and the processes by which they learn to program. In prior work, we developed a statistical model that accurately predicts students' homework grades. In this paper, we investigate the relationship between the paths that students take through the programming states on which our statistical model is based, and their overall course achievement. Examining the frequency of the most common transition paths revealed significant differences between students who earned A's, B's, and C's in a CS 2 course. Our results indicate that a) students of differing achievement levels approach programming tasks differently, and b) these differences can be automatically detected, opening up the possibility that they could be leveraged for pedagogical gain.
- Ahadi, A. et al. 2015. Exploring Machine Learning Methods to Automatically Identify Students in Need of Assistance. Proceedings of the Eleventh Annual International Conference on International Computing Education Research (Omaha, NE, USA, 2015). Google Scholar
Digital Library
- Altadmri, A. and Brown, N.C.C. 2015. 37 Million Compilations: Investigating Novice Programming Mistakes in Large-Scale Student Data. Proceedings of the 46th ACM Technical Symposium on Computer Science Education (Kansas City, MO, USA, 2015), 522--527. Google ScholarDigital Library
- Baker, R.S.J. and Siemens, G. 2014. Educational data mining and learning analytics. The Cambridge Handbook of the Learning Sciences. Cambridge University Press. 253--274. Google ScholarCross Ref
- Bergin, S. et al. 2005. Examining the role of self-regulated learning on introductory programming performance. Proc. 2005 ACM International Computing Education Research Workshop. ACM Press. 81--86. Google ScholarDigital Library
- Bransford, J. et al. eds. 1999. How people learn: Brain, mind, experience, and school. National Academy Press.Google Scholar
- Carter, A.S. et al. 2015. The Normalized Programming State Model: Predicting Student Performance in Computing Courses Based on Programming Behavior. Proceedings of the Eleventh Annual International Conference on International Computing Education Research. ACM. 141--150. Google ScholarDigital Library
- Carter, A.S. and Hundhausen, C.D. 2015. The Design of a Programming Environment to Support Greater Social Awareness and Participation in Early Computing Courses. J. Comput. Sci. Coll. 31, 1 (Oct. 2015), 143--153. Google ScholarDigital Library
- Ihantola, P. et al. 2015. Educational Data Mining and Learning Analytics in Programming: Literature Review and Case Studies. Proceedings of the 2015 ITiCSE on Working Group Reports (New York, NY, USA, 2015), 41--63. Google ScholarDigital Library
- Jadud, M.C. 2006. Methods and Tools for Exploring Novice Compilation Behaviour. Proceedings of the Second International Workshop on Computing Education Research. ACM. 73--84. Google ScholarDigital Library
- Jadud, M.C. and Dorn, B. 2015. Aggregate Compilation Behavior: Findings and Implications from 27,698 Users. Proceedings of the Eleventh Annual International Conference on International Computing Education Research (Omaha, NE, USA, 2015). Google ScholarDigital Library
- Jeske, D. et al. 2014. Learner characteristics predict performance and confidence in e-Learning: An analysis of user behavior and self-evaluation. Journal of Interactive Learning Research. 25, 4 (2014), 509--529.Google Scholar
- Leinonen, J. et al. 2016. Automatic Inference of Programming Performance and Experience from Typing Patterns. Proceedings of the 47th ACM Technical Symposium on Computing Science Education (Memphis, TN, USA, 2016). Google ScholarDigital Library
- Ma, W. et al. 2014. Intelligent tutoring systems and learning outcomes: A meta-analytic survey. Journal of Educational Psychology. 106, 2007 (2014), 901--918.Google ScholarCross Ref
- Minor, B. et al. 2015. Data-Driven Activity Prediction: Algorithms, Evaluation Methodology, and Applications. Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (2015). Google ScholarDigital Library
- Schunk, D.H. 2012. Learning theories: An educational perspective. Merrill Prentice Hall.Google Scholar
- Slavin, R.E. 2011. Educational psychology: Theory and practice. Pearson Education.Google Scholar
- U.S. Department of Education, Office of Educational Technology 2012. Enhancing Teaching and Learning through Educational Data Mining and Learning Analytics: An Issue Brief.Google Scholar
- Watson, C. et al. 2013. Predicting Performance in an Introductory Programming Course by Logging and Analyzing Student Programming Behavior. Proceedings of the 2013 IEEE 13th International Conference on Advanced Learning Technologies (2013), 319--323. Google ScholarDigital Library
Index Terms
- Using Programming Process Data to Detect Differences in Students' Patterns of Programming
Recommendations
The Normalized Programming State Model: Predicting Student Performance in Computing Courses Based on Programming Behavior
ICER '15: Proceedings of the eleventh annual International Conference on International Computing Education ResearchEducators stand to benefit from advance predictions of their students' course performance based on learning process data collected in their courses. Indeed, such predictions can help educators not only to identify at-risk students, but also to better ...
Investigating the Applicability of the Normalized Programming State Model to BlueJ Programmers
Koli Calling '18: Proceedings of the 18th Koli Calling International Conference on Computing Education ResearchIt has long been a goal of educators to accurately identify at-risk students early enough in the term to intervene, and the increasing availability of programming process data and learning analytics tools has brought education researchers closer to ...
Comments