Skip to main content
SpringerLink
Log in

Gesture recognition based human–robot interactive control for robot soccer

  • Technical Paper
  • Published:
Microsystem Technologies Aims and scope Submit manuscript

Abstract

This paper proposes an interaction method in human gestures for controlling robot play soccer. It aims to design a human–robot interactive control scheme let a humanoid robot to substitute who want but cannot such as disabled people without feet for playing soccer games. The scheme first adopts the Kinect based gesture recognition system to analyze human gestures, and then drives the humanoid robot to do respective motions for playing soccer or throwing ball according to what human gestures. The proposed gesture recognition scheme consists of two subsystems in which the Kinect-based 3D framework trace system provides the kernel recognition and the electromyography signal measurement assists the slight movement detection. It mainly makes all the motions of upper body classified as several types of gestures. Every different gesture is set in relative to a unique soccer motion of the humanoid robot. Therefore, a gesture is a control commend of a robotic motion. Based on such translation, a human can only use his/her hands and upper body to play soccer but in humanoid robot. From the experimental results, it demonstrates the satisfactory interactive human–robot soccer processes.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  • Arzu G, Recep DS, Albert AS (2014) Auto-evaluation of motion imitation in a child-robot imitation game for upper arm rehabilitation, vol 1. In: IEEE international symposium on robot and human int. communication. IEEE, Edinburgh, Scotland, UK, pp 199–204

  • Chen D, Li G, Jiang G, Fang Y, Ju Z, Liu H (2015) Intelligent computational control of multi-fingered dexterous robotic hand. J Comput Theor Nanosci 12(12):6126–6132

    Article  Google Scholar 

  • Ferreira A, Celeste WC, Cheein FA, Bastos-Filho TF, Sarcinelli-Filho M, Carelli R (2008) Human–machine interfaces based on EMG and EEG applied to robotic systems. J NeuroEng Rehabil 5(1):10

    Article  Google Scholar 

  • Georgi M, Amma C, Schultz T (2015) Recognizing hand and finger gestures with IMU based motion and EMG based muscle activity sensing. Biosignals 4:99–108

    Google Scholar 

  • Hachaj T, Ogiela M (2013) Rule-based approach to recognizing human body poses and gestures in real time. Multimed Sys 20(1):81–99

    Article  Google Scholar 

  • Harada A, Nakakuki T, Hikita M, Ishii C (2010) Robot finger design for myoelectric hand and recognition of finger motions via surface EMG. In: IEEE conference on automation and logistics. IEEE, Hong Kong and Macau, China, pp 273–278

  • Kulić D (2017) Human motion imitation. In: Goswami A, Vadakkepat P (eds) Humanoid robotics: a reference. Springer, Dordrecht, pp 1–21

    Google Scholar 

  • Lee JH (2012) Full-body imitation of human motions with Kinect and heterogeneous kinematic structure of humanoid robot. In: IEEE/SICE int. symp. on system integration. IEEE, Fukuoka, Japan, pp 93–98

  • Lunardini F, Casellato C, d’Avella A, Sanger TD, Pedrocchi A (2016) Robustness and reliability of synergy-based myocontrol of a multiple degree of freedom robotic arm. IEEE Trans Neural Syst Rehabil Eng 24(9):940–950

    Article  Google Scholar 

  • Miranda L, Vieira T, Martinez D, Lewiner T, Vieira AW, Campos MF (2012) Real-time gesture recognition from depth data through key poses learning and decision forests, vol 1. In: 25th SIBGRAPI conference on graphics, patterns and images. IEEE, Ouro Preto, Brazil, pp 268–275

  • Patsadu O, Nukoolkit C, Watanapa B (2012) Human gesture recognition using kinect camera. In: Ninth international conference on computer science and software engineering (JCSSE). IEEE, Bangkok, Thailand, pp 28–32

Download references

Acknowledgements

The authors would like to express their appreciation to Ministry of Science and Technology, Taiwan under Contract Numbers MOST106-2221-E-218-003, MOST106-2622-E-037-002-CC3 and MOST106-2622-E-218-008-CC3 for financial supporting.

Author information

Authors and Affiliations

  1. Department of Electrical Engineering, Southern Taiwan University of Science and Technology, Tainan, Taiwan

    Ming-Yuan Shieh & Chen-Yang Wang

  2. Department of Sports Medicine, Kaohsiung Medical University, Kaohsiung, Taiwan

    Wen-Lan Wu

  3. Department of Medical Research, Kaohsiung Medical University Hospital, Kaohsiung, Taiwan

    Jing-Min Liang

Authors
  1. Ming-Yuan Shieh
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chen-Yang Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Wen-Lan Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jing-Min Liang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ming-Yuan Shieh.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Shieh, MY., Wang, CY., Wu, WL. et al. Gesture recognition based human–robot interactive control for robot soccer. Microsyst Technol 27, 1175–1186 (2021). https://doi.org/10.1007/s00542-018-4138-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00542-018-4138-1

Search

Navigation