Abstract
In this paper we investigate the lack of reliability and consistency of those binary rule learners in ILP that employ the one-vs-rest binarisation technique when dealing with multi-class domains. We show that we can learn a simple, consistent and reliable multi-class theory by combining the rules of the multiple one-vs-rest theories into one rule list or set. We experimentally show that our proposed methods produce coherent and accurate rule models from the rules learned by a well known ILP learner Aleph.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Quinlan, J.R., Cameron-Jones, R.M.: FOIL: A Midterm Report. In: Proc. European Conf. on Machine Learning, pp. 3–20. Springer, Heidelberg (1993)
Muggleton, S.: Inverse Entailment and Progol. In: Proc. 6th International Workshop on Inductive Logic Programming, vol. 13, pp. 245–286. Springer, Heidelberg (1995)
Srinivasan, A.: The Aleph Manual. Technical report, University of Oxford (2001)
Rifkin, R., Klautau, A.: In Defense of One-Vs-All Classification. Machine Learning Research 5, 101–141 (2004)
Zadrozny, B., Elkan, C.: Transforming Classifier Scores Into Accurate Multiclass Probability Estimates. In: Proc. 8th ACM SIGKDD Int. Conf. on Knowledge Discovery and Data Mining, pp. 694–699. ACM, New York (2002)
Clark, P., Niblett, T.: The CN2 Induction Algorithm. Machine Learning 3, 261–283 (1989)
Friedman, J.H.: Another approach to polychotomous classification. Technical report, Stanford University, Department of Statistics (1996)
Platt, J.C., Cristianini, N.: Large Margin DAGs for Multiclass Classification. In: Advances in Neural Information Processing Systems, vol. 12. MIT Press, Cambridge (2000)
Kijsirikul, B., Ussivakul, N., Meknavin, S.: Adaptive Directed Acyclic Graphs for Multiclass Classification. In: Ishizuka, M., Sattar, A. (eds.) PRICAI 2002. LNCS (LNAI), vol. 2417, pp. 158–168. Springer, Heidelberg (2002)
Dietterich, T.G., Bakiri, G.: Solving Multiclass Learning Problems via Error-Correcting Output Codes. Artificial Intelligence Research 2, 263–286 (1995)
Abudawood, T., Flach, P.: Evaluation Measures for Multi-class Subgroup Discovery. In: Buntine, W., Grobelnik, M., Mladenić, D., Shawe-Taylor, J. (eds.) ECML PKDD 2009. LNCS, vol. 5781, pp. 35–50. Springer, Heidelberg (2009)
Demšar, J.: Statistical Comparisons of Classifiers Over Multiple Data Sets. Machine Learning Research 7, 1–30 (2006)
De Raedt, L., Van Laer, W.: Inductive Constraint Logic. In: Zeugmann, T., Shinohara, T., Jantke, K.P. (eds.) ALT 1995. LNCS, vol. 997, pp. 80–94. Springer, Heidelberg (1995)
Blockeel, H., De Raedt, L.: Top-down Induction of Logical Decision Trees. Artificial Intelligence 101, 285–297 (1997)
Hsu, C.-W., Lin, C.-J.: A Comparison of Methods for Multiclass Support Vector Machines. Neural Networks 13, 415–425 (2002)
Fawcett, T.: An Introduction to ROC Analysis. Pattern Recognition Letters 27(8), 861–874 (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Abudawood, T., Flach, P.A. (2011). Learning Multi-class Theories in ILP. In: Frasconi, P., Lisi, F.A. (eds) Inductive Logic Programming. ILP 2010. Lecture Notes in Computer Science(), vol 6489. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-21295-6_4
Download citation
DOI: https://doi.org/10.1007/978-3-642-21295-6_4
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-21294-9
Online ISBN: 978-3-642-21295-6
eBook Packages: Computer ScienceComputer Science (R0)