Abstract
Detecting and diagnosing errors in novice behavior is an important student modeling task. In this paper, we describe MEDD, an unsupervised incremental multistrategy system for the discovery of classes of errors from, and their detection in, novice programs. Experimental results show that MEDD can effectively detect and discover misconceptions and other knowledge-level errors that underlie novice Prolog programs, even when multiple errors are enmeshed together in a single program, and when the programs are presented to MEDD in a different order.
Article PDF
Similar content being viewed by others
References
Baffes, P. & Mooney, R. (1996). Refinement-based student modeling and automated bug library construction. Journal of Artificial Intelligence in Education, 7, 75–116.
Bareiss, E., Porter, B., & Wier, C. (1987). PROTOS: An exemplar-based learning apprentice. Proceedings of the Fourth International Workshop on Machine Learning.
Biswas, G., Weinberg, J., Yang, Q., & Koller, G. (1991). Conceptual clustering and exploratory data analysis. Proceedings of the Eighth International Workshop on Machine Learning (pp. 591–595).
Fisher, T. (1987). Knowledge acquisition via incremental conceptual clustering. Machine Learning, 2, 139–172.
Fisher, D., Xu, L., & Zard, N. (1992). Ordering effects in clustering. Proceedings of the Ninth International Workshop on Machine Learning (pp. 163–168).
Gegg-Harrison, T. (1994). Exploiting program schemata in an automated program debugger. Journal of Artificial Intelligence in Education, 5, 255–278.
Hart, P., Nilsson, N., & Raphael, B. (1968). A formal basis for the heuristic determination of minimum cost paths. IEEE Transactions on Systems, Sience and Cybernetics, 4, 100–107.
Johnson, W. L. (1990). Understanding and debugging novice programs. Artificial Intelligence, 42, 51–97.
Langley, P. & Ohlsson, S. (1984). Automated cognitive modeling. Proceedings of the Second National Conference on Artificial Intelligence (pp. 193–197).
Lebowitz, M. (1986). Integrated learning: Controlling explanation. Cognitive Science, 10, 219–240.
Lebowitz, M. (1987). Experiments with incremental concept formation: UNIMEM. Machine Learning, 2, 103–138.
Looi, C. (1991). Automatic debugging of Prolog programs in a Prolog intelligent tutoring system. Instructional Science, 20, 215–263.
McCalla, G. (1992). The central importance of student modeling to intelligent tutoring. In E. Costa (Ed.), New directions for intelligent tutoring systems, Berlin, Springer Verlag.
Michalski, R. & Stepp, R. (1983). Learning from observation: conceptual clustering. In R. Michalski, J. Carbonell, & T. Mitchell (Eds.), Machine learning: an artificial intelligence approach. Palo Alto, CA: Tioga.
Mitchell, T., Keller, R., & Kedar-Cabelli, S. (1986). Explanation-based generalization: A unifying view. Machine Learning, 1, 47–80.
Neri, F. (1999). The role of explanation in elementary physics learning. Machine Learning, This issue.
Pazzani, M. (1994). Learning causal patterns: making a transition from data-driven to theory-driven learning. In R. Michalski & G. Tecuci (Eds.), Machine learning: a multistrategy approach (Vol. IV, pp. 267–293). San Francisco, CA: Morgan Kaufmann.
Plotkin, G. (1970). A note on inductive generalization. Machine Intelligence, 5, 153–163.
Richards, B. & Mooney, R. (1995). Automated refinement of first-order Horn-clause domain theories. Machine Learning, 19, 95–131.
Shapiro, E. (1983). Algorithmic program debugging. Cambridge, MA: MIT Press.
Sison, R. (1998). Multistrategy discovery and detection of novice programmer errors. Ph.D. Thesis, Department of Computer Science, Tokyo Institute of Technology, Tokyo, Japan.
Sison, R., Numao, M., & Shimura, M. (1997). Using data and theory in multistrategy (mis)concept(ion) discovery. Proceedings of the Fifteenth International Joint Conference on Artificial Intelligence (pp. 274–279).
Sison, R. & Shimura, M. (1998). Student modeling and machine learning. International Journal of Artificial Intelligence in Education, 9, 128–158.
Sleeman, D., Hirsh, H., Ellery, I., & Kim, I. (1990). Extending domain theories: Two case studies in student modeling. Machine Learning, 5, 11–37.
Sterling, L. & Shapiro, E. (1986). The art of prolog. Cambridge, MA: MIT Press.
Tamaki, H. & Sato, T. (1984). Unfold/fold transformation of logic programs. Proceedings of the Second International Logic Programming Conference (pp. 127–138).
Tversky, A. (1977). Features of similarity. Psychological Review, 84, 327–352.
VanLehn, K. (1987). Learning one procedure per lesson. Artificial Intelligence, 31, 1–40.
Wisniewski, E. & Medin, D. (1994). On the interaction of theory and data in concept learning. Cognitive Science, 18, 221–281.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Sison, R.C., Numao, M. & Shimura, M. Multistrategy Discovery and Detection of Novice Programmer Errors. Machine Learning 38, 157–180 (2000). https://doi.org/10.1023/A:1007690108308
Issue Date:
DOI: https://doi.org/10.1023/A:1007690108308