Abstract
The potential market of robots that can helpfully work at home is increasing, and such robots are required to possess force and tactile sensors achieving dynamic and cooperative interactions with their users. Virtual realization of force/tactile sensors in robots, using user’s biological signals such as EMG and postural information, is a versatile solution allowing high spatial resolution and degrees of freedom. In this paper, however, we first show the virtual force sensing approach does not work for a three-dimensional cooperative task in which the user is requested to move a load by an upper-limb of the user cooperatively with the robot, and discuss about inevitable problems. We then propose to apply policy gradient learning to overcome the problems, and demonstrate preliminary but promising learning results.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Miyashita, T., Tajika, T., Ishiguro, H., Kogure, K., Hagita, N.: Haptic communication between humans and robots. In: Proc. 12th Int. Symp. Robot Res. (2005) (CD-ROM)
Hoshi, T., Shinoda, H.: A tactile sensing element for a whole body robot skin. In: Proc. 12th Int. Symp. Robot Res. (2005) (CD-ROM)
Tamei, T., Ishii, S., Shibata, T.: Virtual force/tactile sensors for interactive machines using the user’s biological signals. Adv. Robot. 22(8), 893–911 (2008)
Tapus, A., Tapus, C., Mataric, M.J.: Hands-off therapist robot behavior adaptation to user personality for post-stroke rehabilitation therapy. In: Proc. IEEE Int. Conf. Robot Automat., pp. 1547–1553 (2007)
Mitsunaga, N., Smith, C., Kanda, T., Ishiguro, H., Hagita, N.: Adapting robot behavior for human-robot interaction. IEEE Trans. Robot 24(4), 911–916 (2008)
Corcos, D.M., Gottlieb, G.L., Latash, M.L., Almeida, G.L., Agarwal, G.C.: Electromechanical delay: An experimental artifact. J. Electromyogr. Kinesiol. 2, 59–68 (1992)
Weaver, L., Tao, N.: The optimal reward baseline for gradient-based reinforcement learning. In: Proc. 17th Conf. Uncertainty in Artificial Intelligence, pp. 538–545 (2001)
Yoshida, N., Domen, K., Koike, Y., Kawato, M.: A method for estimating torque-vector directions of shoulder muscles using surface EMGs. Bio. Cybern. 86(3), 167–177 (2002)
Buneo, C.A., Soechting, J.F., Flanders, M.: Postural dependence of muscle actions: Implications for neural control. J. Neurosci. 17(6), 2128–2142 (1997)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Tamei, T., Shibata, T. (2009). Policy Gradient Learning of Cooperative Interaction with a Robot Using User’s Biological Signals. In: Köppen, M., Kasabov, N., Coghill, G. (eds) Advances in Neuro-Information Processing. ICONIP 2008. Lecture Notes in Computer Science, vol 5507. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-03040-6_125
Download citation
DOI: https://doi.org/10.1007/978-3-642-03040-6_125
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-03039-0
Online ISBN: 978-3-642-03040-6
eBook Packages: Computer ScienceComputer Science (R0)