Abstract
In this paper we propose an adaptive, self-learning system, which utilizes relational reinforcement learning (RRL), and apply it to a computer vision problem. A common problem in computer vision consists in the discrimination between similar objects which differ in salient features visible from distinct views only. Usually existing object recognition systems have to scan an object from a large number of views for a reliable discrimination. Optimization is achieved at most with heuristics to reduce the amount of computing time or to save storage space. We apply RRL in an appearance-based approach to the problem of discriminating similar objects, which are presented from arbitray views. We are able to rapidly learn scan paths for the objects and to reliably distinguish them from only a few recorded views. The appearance-based approach and the possibility to define states and actions of the RRL system with logical descriptions allow for a large reduction of the dimensionality of the state space and thus save storage and computing time.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Dzeroski, S., De Raedt, L., Driessens, K.: Relational reinforcement learning. In: Machine Learning, vol. 43, pp. 7–52 (2001)
Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Introduction. MIT Press, Cambridge (1998)
Gartner, T., Driessens, K., Ramon, J.: Graph kernels and gaussian processes for relational reinforcement learning. In: Inductive Logic Programming, 13th International Conference, ILP (2003)
Driessens, K., Ramon, J.: Relational instance based regression for relational reinforcement learning. In: Proceedings of the Twentieth International Conference on Machine Learning, pp. 123–130 (2003)
Peters, G.: A Vision System for Interactive Object Learning. In: IEEE International Conference on Computer Vision Systems (ICVS 2006), New York, USA, January 5-7 (2006)
Lindeberg, T., Bretzner, L.: Real-time scale selection in hybrid multi-scale representations. In: Griffin, L.D., Lillholm, M. (eds.) Scale-Space 2003. LNCS, vol. 2695, pp. 148–163. Springer, Heidelberg (2003)
Harris, C., Stephens, M.: A Combined Corner and Edge Detector. In: 4th ALVEY Vision Conference, pp. 147–151 (1988)
Mikolajczyk, K., Schmid, C.: Scale and affine invariant interest point detectors. International Journal of Computer Vision 60(1), 63–86 (2004)
Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vision 60(2), 91–110 (2004)
Baumberg, A.: Reliable feature matching across widely separated views. In: CVPRÂ 2001, p. 1774 (2000)
Beis, J., Lowe, D.: Shape indexing using approximate nearest-neighbor search in highdimensional spaces (1997)
Hartley, R.I., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn. Cambridge University Press, Cambridge (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Häming, K., Peters, G. (2009). Relational Reinforcement Learning Applied to Appearance-Based Object Recognition. In: Palmer-Brown, D., Draganova, C., Pimenidis, E., Mouratidis, H. (eds) Engineering Applications of Neural Networks. EANN 2009. Communications in Computer and Information Science, vol 43. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-03969-0_28
Download citation
DOI: https://doi.org/10.1007/978-3-642-03969-0_28
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-03968-3
Online ISBN: 978-3-642-03969-0
eBook Packages: Computer ScienceComputer Science (R0)