Abstract
This paper presents the results of our efforts to incorporate automated judging into the evaluation of programming assignments by students. Our experimentation on automated evaluation of programming assignments was twofold: at first, we have used the stand alone open source system Mooshak independently from the learning management system supporting the rest of e-learning activities; then, we have isolated and integrated its automatic judge engine into the learning management system Claroline. In both cases, automated judging has been used in conjunction with marking by instructors offering regular and frequent feedback. An online questionnaire was presented to the students to quantify their preferences in using the automatic judge with respect to pedagogical results. The data we gathered provides a clear indication that students think positively of the automatic judge when used for evaluation of programming assignments and in conjunction with their instructors’ feedback and marking.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Rosset, A., Douglis, F., Frazee, R.: Strategies for Building Blended Learning (2003), http://www.learningcircuits.org/2003/jul2003/rossett.htm
Heinze, A., Procter, C.: Reflections on the Use of Blended Learning. In: Proceedings of the Conference on Education in a Changing Environment, Univ. Salford, UK (2004)
Valenti, S., Neri, F., Cucchiarelli, C.: An Overview of Current Research on Automated Essay Grading. Journal of Information Technology Education 2 (2003)
Malmi, L., Korhonen, A., Saikkonen, R.: Experiences in automatic assessment on mass courses and issues for designing virtual courses. SIGCSE Bull. 34(3), 55–59 (2002)
Douce, C., Livingstone, D., Orwell, J.: Automatic test-based assessment of programming: A review. J. Educ. Resour. Comput. 5(3), 4 (2005)
Jackson, D., Usher, M.: Grading student programs using ASSYST. In: Jose, S., Miller, C.J.E. (eds.) Proceedings of the Twenty-Eighth SIGCSE Technical Symposium on Computer Science Education, SIGCSE 1997, pp. 335–339. ACM, New York (1997)
Tremblay, G., Guérin, F., Pons, A., Salah, A.: Oto: A generic and extensible tool for marking programming assignments. Software: Practice and Experience 28(3) (2008)
Joy, M.S., Griffiths, N.E., Boyatt, R.: The BOSS Online Submission and Assessment System. ACM Journal on Educational Resources in Computing 5(3), 1–28 (2005)
Suleman, H.: Automatic marking with Sakai. In: Proceedings of the 2008 Annual Research Conference of the South African Institute of Computer Scientists and Information Technologists, SAICSIT 2008, vol. 338, pp. 229–236. ACM, New York (2008)
Sakai Project (2008), http://www.sakaiproject.org
Leal, J.P., Silva, F.: Mooshak: a Web-based multi-site programming contest system. Software Practice and Experience 33(6), 567–581 (2003)
Guerreiro, P., Georgouli, K.: Teaching Programming with a Competitive Attitude to Foster Group Spirit. In: International Conference on The Web Information Systems and Technologies, WEBIST 2008, Madeira, Portugal, pp. 414–421 (2008)
Mooshak’s Help, http://mooshak.dei.uc.pt/~academy
Georgouli, K., Skalkidis, I., Guerreiro, P.: A framework for introducing e-learning in a traditional course. International Journal of Educational Technology and Society 11(2), 227–240 (2008)
Georgouli, K., Guerreiro, P., Kapetanakou, S.: Integrating an Automatic Judge into an Open Source LMS. In: Bastiaens, T., et al. (eds.) Proceedings of World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education 2009, pp. 3492–3499. AACE, Chesapeake (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Georgouli, K., Guerreiro, P. (2010). Incorporating an Automatic Judge into Blended Learning Programming Activities. In: Luo, X., Spaniol, M., Wang, L., Li, Q., Nejdl, W., Zhang, W. (eds) Advances in Web-Based Learning – ICWL 2010. ICWL 2010. Lecture Notes in Computer Science, vol 6483. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-17407-0_9
Download citation
DOI: https://doi.org/10.1007/978-3-642-17407-0_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-17406-3
Online ISBN: 978-3-642-17407-0
eBook Packages: Computer ScienceComputer Science (R0)