Abstract
This paper addresses two MOOCs in Estonian about programming where different kinds of assessment were used. We have used two kinds of automated assessment: quizzes in Moodle and programming exercises with automated feedback provided by Moodle plug-in VPL. We also used two kinds of self-assessment: (1) self-assessment questions with feedback and explanations for every answer and (2) so-called “troubleshooters” for every programming exercise, which contain answers to the questions that can arise during the solution of a given exercise. This paper describes our experience in the creation of quizzes, programming exercises, and tests for automated feedback, self-assessment questions, and troubleshooters. The paper discusses the problems and questions that arose during this process and presents learners’ opinions about self- and automated assessment. The paper concludes with a discussion of the impact of self- and automated assessment in MOOCs, describes the work of MOOC organizers and the behaviour of learners in MOOCs.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Admiraal, W., Huisman, B., Pilli, O.: Assessment in massive open online courses. Electron. J. e-Learn. 13(4), 207–216 (2015)
Anderson, A., Huttenlocher, D., Kleinberg, J., Leskovec. J.: Engaging with massive online courses. In: Proceedings of the 23rd International Conference on World Wide Web (WWW 2014), pp. 687–698. ACM, New York (2014). doi:10.1145/2566486.2568042
Bali, M.: MOOC pedagogy: gleaning good practice from existing MOOCs. J. Online Learn. Teach. 10(1), 44–56 (2014)
Bayne, S., Ross, J.: The pedagogy of the Massive Open Online Course: the UK view. Report, UK (2013)
Dougiamas, M., Taylor, P.C.: Moodle: using learning communities to create an open source course management system. In: Proceedings of the EDMEDIA 2003 Conference, Honolulu, Hawaii (2003)
Higgins, C.A., Gray, G., Symeonidis, P., Tsintsifas, A.: Automated assessment and experiences of teaching programming. J. Educ. Resour. Comput. 5(3), 5 (2005). doi:10.1145/1163405.1163410
Hunt, T.: Computer-marked assessment in moodle: past, present and future. In: Proceedings of CAA 2012 Conference (2012)
Jerinic, L.: Pedagogical patterns for learning programming by mistakes. In: Proceedings of Conference: Computer Algebra and Dynamic Geometry Systems in Mathematical Education (2012). doi:10.13140/2.1.2720.1609
Jordan, K.: MOOC completion rates: the data (2015). http://www.katyjordan.com/MOOCproject.html
Kulkarni, C., Wei, K.P., Le, H., Chia, D., Papadopoulos, K., Cheng, J., Koller, D., Klemmer, S.R.: Peer and self assessment in massive online classes. ACM Trans. Comput. Hum. Interact. 20(6), 33 (2013). doi:10.1145/2505057
Papathoma, T., Blake, C., Clow, D., Scanlon, E.: Investigating learners’ views of assessment types in Massive Open Online Courses (MOOCs). In: Conole, G., Klobučar, T., Rensing, C., Konert, J., Lavoué, É. (eds.) EC-TEL 2015. LNCS, vol. 9307, pp. 617–621. Springer, Cham (2015). doi:10.1007/978-3-319-24258-3_72
Pieterse, V.: Automated assessment of programming assignments. In: van Eekelen, M., Barendsen, E., Sloep, P., van der Veer, G. (eds.) Proceedings of the 3rd Computer Science Education Research Conference on Computer Science Education Research (CSERC 2013), pp. 45–56. Open Universiteit, Heerlen, The Netherlands (2013)
Robins, A., Haden, P., Garner, S.: Problem distributions in a CS1 course. In: Tolhurst, D., Mann, S. (eds.) Proceedings of the 8th Australasian Conference on Computing Education, vol. 52, pp. 165–173. Australian Computer Society, Inc., Darlinghurst, Australia (2006)
Rodríguez-del-Pino, J.C., Rubio-Royo, E., Hernández-Figueroa, Z. J.: A virtual programming lab for Moodle with automatic assessment and anti-plagiarism features. In: Proceedings of the 2012 International Conference on e-Learning, e-Business, Enterprise Information Systems, & e-Government (2012)
Siemens, G.: Massive open online courses: innovation in education? Open Educ. Resour. Innov., Res. Pract. 12 (2013)
Singh, R., Gulwani, S., Solar-Lezama, A.: Automated feedback generation for introductory programming assignments. In: Proceedings of the 34th ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI 2013), pp. 15–26. ACM, New York, (2013). doi:10.1145/2491956.2462195
Vihavainen, A., Luukkainen, M., Kurhila, J.: Multi-faceted support for MOOC in programming. In: Proceedings of the 13th Annual Conference on Information Technology Education, pp. 171–176. ACM. (2012). doi:10.1145/2380552.2380603
Warren, J., Rixner, S., Greiner, J., Wong., S.: Facilitating human interaction in an online programming course. In: Proceedings of the 45th ACM Technical Symposium on Computer Science Education (SIGCSE 2014), pp. 665–670. ACM, New York (2014) doi:10.1145/2538862.2538893
Widom, J.: From 100 Students to 100,000. ACM SIGMOD Blog (2012)
Wilkowski, J., Russell, D.M., Deutsch, A.: 2014. Self-evaluation in advanced power searching and mapping with google MOOCs. In: Proceedings of the first ACM Conference on Learning @ Scale Conference (L@S 2014), pp. 109–116. ACM, New York (2014). doi:10.1145/2556325.2566241
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Lepp, M. et al. (2017). Self- and Automated Assessment in Programming MOOCs. In: Joosten-ten Brinke, D., Laanpere, M. (eds) Technology Enhanced Assessment. TEA 2016. Communications in Computer and Information Science, vol 653. Springer, Cham. https://doi.org/10.1007/978-3-319-57744-9_7
Download citation
DOI: https://doi.org/10.1007/978-3-319-57744-9_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-57743-2
Online ISBN: 978-3-319-57744-9
eBook Packages: Computer ScienceComputer Science (R0)