Abstract
Non-rigid physical elements attached to robotic systems introduce non-linear dynamics that requires innovative control approaches. This paper describes some of our results applying Q-Learning to learn the control commands to solve a hose transportation problem. The learning process is developed in a simulated environment. Computationally expensive but dynamically accurate Geometrically Exact Dynamic Splines (GEDS) have been used to model the hose to be transported by a single robot, showing the difficulties of controlling flexible elastic passive linking elements.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Duro, R.J., GraƱa, M., de Lope, J.: On the potential contributions of hybrid intelligent approaches to multicomponen robotic system development. Information SciencesĀ 180(14), 2635ā2648 (2010)
Prieto, A., Bellas, F., CaamaƱo, P., Duro, R.J.: Automatic behavior pattern classification for social robots. In: GraƱa Romay, M., Corchado, E., Garcia Sebastian, M.T. (eds.) HAIS 2010. LNCS, vol.Ā 6076, pp. 88ā95. Springer, Heidelberg (2010)
Echegoyen, Z.: Contributions to visual servoing for legged and linked multicomponent robots. Ph.D. dissertation, UPV/EHU (2009)
Echegoyen, Z., Villaverde, I., Moreno, R., GraƱa, M., dāAnjou, A.: Linked multi-component mobile robots: modeling, simulation and control. In: Robotics and Autonomous Systems, vol.Ā 58(12), pp. 1292ā1305 (2010)
Fernandez-Gauna, B., Lopez-Guede, J.M., Zulueta, E.: Linked multicomponent robotic systems: Basic assessment of linking element dynamical effect. In: GraƱa Romay, M., Corchado, E., Garcia Sebastian, M.T. (eds.) HAIS 2010. LNCS, vol.Ā 6076, pp. 73ā79. Springer, Heidelberg (2010)
Fernandez-Gauna, B., Lopez-Guede, J.M., GraƱa, M.: Learning hose transport control with q-learning. Neural Network WorldĀ 20(7), 913ā923 (2010)
Maravall, D., de-Lope, J., Martin, J.A.: Hybridizing evolutionary computation and reinforcement learning for the design of almost universal controllers for autonomous robots. NeurocomputingĀ 72(4-6), 887ā894 (2009)
Martin, J.A., de Lope, J., Maravall, D.: Adaptation, anticipation and rationality in natural and artificial systems: Computational paradigms mimicking nature. Natural ComputingĀ 8(4), 757ā775 (2009)
Martin, J.A., de Lope, J., Santos, M.: A method to learn the inverse kinematics of multi-link robots by evolving neuro-controllers. NeurocomputingĀ 72(13-15), 2806ā2814 (2009)
Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Introduction. MIT Press, Cambridge (1998)
Theetten, A., Grisoni, L., Andriot, C., Barsky, B.: Geometrically exact dynamic splines. Computer-Aided DesignĀ 40(1), 35ā48 (2008)
GraƱa, M., Torrealdea, F.J.: Hierarchically structured systems. European Journal of Operational ResearchĀ 25, 20ā26 (1986)
GraƱa, M., dāAnjou, A., Albizuri, F.X., Hernandez, M., Torrealdea, F.J., Gonzalez, A.I.: Experiments of fast learning with high order boltzmann machines. Applied IntelligenceĀ 7(4), 287ā303 (1997)
dāAnjou, A., GraƱa, M., Torrealdea, F.J., Hernandez, M.: Solving satisfiability via boltzmann machines. IEEE Transactions on pattern analysis and machine intelligenceĀ 15, 514ā521 (1993)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
Ā© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lopez-Guede, J.M., Fernandez-Gauna, B., GraƱa, M., Zulueta, E. (2011). Empirical Study of Q-Learning Based Elemental Hose Transport Control. In: Corchado, E., KurzyÅski, M., WoÅŗniak, M. (eds) Hybrid Artificial Intelligent Systems. HAIS 2011. Lecture Notes in Computer Science(), vol 6679. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-21222-2_55
Download citation
DOI: https://doi.org/10.1007/978-3-642-21222-2_55
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-21221-5
Online ISBN: 978-3-642-21222-2
eBook Packages: Computer ScienceComputer Science (R0)