Abstract
In this work a shared impedance control scheme for a hybrid human-robot team is designed for transporting a rigid workpiece to a desired position. Within the scope of proposed control structure, both human and robot are regarded as mechanical impedance and their parameters are adapted continuously in real-time. Reinforcement learning is used to find an impedance parameter set for the whole team to optimize a task-orient cost function. Then the learned parameters are further adjusted by taking human’s disagreement into consideration. The proposed method is aimed to reduce human’s control effort during collaboration and be flexible to variation of the task or environment. Experimental results are presented to illustrate the performance.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Ajoudani, A., Zanchettin, A.M., Ivaldi, S., Albu-Schäffer, A., Kosuge, K., Khatib, O.: Progress and prospects of the human-robot collaboration. Auton. Robots 42(5), 957–975 (2018)
Ficuciello, F., Villani, L., Siciliano, B.: Variable impedance control of redundant manipulators for intuitive human-robot physical interaction. IEEE Trans. Robotics 31(4), 850–863 (2015)
Haddadin, S.: Towards Safe Robots: Approaching Asimov’s 1st Law. PhD thesis, Rheinisch-Westfälischen Technischen Hochschule Aachen (2011)
Hogan, N.: Impedance control: an approach to manipulation: Part II–implementation. J. Dyn. Syst. Meas. Control 107(1), 8 (1985)
Jarrassé, N., Sanguineti, V., Burdet, E.: Slaves no longer: review on role assignment for human-robot joint motor action. Adapt. Behav. 22(1), 70–82 (2014)
Köpf, F., Inga, J., Rothfuß, S., Flad, M., Hohmann, S.: Inverse reinforcement learning for identification in linear-quadratic dynamic games. IFAC-PapersOnLine 50(1), 14902–14908 (2017). 20th IFAC World Congress
Kucukyilmaz, A., Sezgin, T.M., Basdogan, C.: Conveying intentions through haptics in human-computer collaboration. In: 2011 IEEE World Haptics Conference, pp. 421–426, June 2011
Lewis, F., Vrabie, D., Syrmos, V.: Optimal Control. EngineeringPro collection. Wiley, New York (2012)
Li, Y., Tee, K.P., Yan, R., Chan, W.L., Wu, Y.: A framework of human-robot coordination based on game theory and policy iteration. IEEE Trans. Robot. 32(6), 1408–1418 (2016)
Mörtl, A., Lawitzky, M., Kucukyilmaz, A., Sezgin, M., Basdogan, C., Hirche, S.: The role of roles: physical cooperation between humans and robots. Int. J. Robot. Res. 31(13), 1656–1674 (2012)
Schmidtler, J., Bengler, K.: Fast or accurate? -performance measurements for physical human-robot collaborations. Procedia Manufacturing 3, 1387–1394 (2015). ) 6th International Conference on Applied Human Factors and Ergonomics (AHFE 2015) and the Affiliated Conferences, AHFE 2015
Svinin, M., Goncharenko, I., Lee, H., Yamamoto, M.: Modeling of human-like reaching movements in the manipulation of parallel flexible objects. In: 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 4830–4835, October 2016
Yang, C., Ganesh, G., Haddadin, S., Parusel, S., Albu-Schaeffer, A., Burdet, E.: Human-like adaptation of force and impedance in stable and unstable interactions. IEEE Trans. Robot. 27(5), 918–930 (2011)
Acknowledgement
We would like to thank Dr. Daniel Görges for his helpful advice and comments.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Wu, M., He, Y., Liu, S. (2020). Shared Impedance Control Based on Reinforcement Learning in a Human-Robot Collaboration Task. In: Berns, K., Görges, D. (eds) Advances in Service and Industrial Robotics. RAAD 2019. Advances in Intelligent Systems and Computing, vol 980. Springer, Cham. https://doi.org/10.1007/978-3-030-19648-6_12
Download citation
DOI: https://doi.org/10.1007/978-3-030-19648-6_12
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-19647-9
Online ISBN: 978-3-030-19648-6
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)