Short communication
Dynamic training protocol improves the robustness of PR-based myoelectric control

https://doi.org/10.1016/j.bspc.2016.08.017Get rights and content

Abstract

In pattern recognition (PR)-based myoelectric control schemes, the classifier is generally trained in ideal laboratory conditions, due to which the classification accuracy might be affected by confounding factors such as force variations, limb positions, and inadvertent electromyography (EMG) activation. Many endeavors have been put forward to mitigate this effect by adopting new training protocols that consider only quite a few independent factors. In this note, we propose a dynamic protocol, which embraces multiple EMG variations in data collection, to train a classifier with improved generalization ability. A total of four training protocols are examined, wherein affecting factors like upper-limb movements, contraction levels and inadvertent EMG activations are differently considered. Based on receiver operating characteristic (ROC) analysis, we came up with a new performance metric, ROC area rate (RAR), to directly inspect the accuracy and robustness of the classifiers obtained through different training protocols. Our results show that, compared with the other three protocols, the protocol with dynamic limb postures and dynamic muscle contractions (termed as DPDE) obtains the highest RAR (73.3%, on-way analysis of variance, p<0.005). Our results suggest that there is no need to integrate every EMG variation in the training protocol for receiving a robust EMG pattern recognition. Online control experiments with three amputees manipulating a multiple-DOF prosthetic hand also verify our findings.

Introduction

Using engineering approaches to restoring human hand’s function has long been an ambitious goal in robotics society. In literature, a variety of robotic/prosthetic hand prototypes with different degrees of dexterity have been developed [1], [2]. Meanwhile, on the market, advanced hand prostheses with multiple degrees of freedom (DOF) and neural control/feedback interfaces have also started to become available [3], [4], [5], [6], [7]. However, the artificial hand still cannot be naturally and intuitively used as a biological hand with the same degree of skill and delicacy [8]. A fact is that, as the number of the active joints increases, the control of these dexterous prosthetic hands tends to be exponentially complicated [9], [10], [11].

For operating a prosthetic hand, a bidirectional interface (peripheral machine interface, PMI) [12] that links the mechanical hand to its user is required. Among various biomedical signals, the myoelectric signals (electromyography, EMG) collected from the residual arm of the amputee are widely used. The signal contains rich neural information and requires no surgery and hospitalization. In ideal laboratory conditions, several grip patterns and finder/wrist motions can be faithfully decoded based on the EMG activation patterns [13], [14], [15]. However, the pattern recognition (PR)-based control schemes still have many problems when being put into clinical practice [12], despite the considerable academic achievements [9], [16], [17].

One big problem in the PR-based myoelectric control is that one cannot ensure the learned classifier’s generalization ability in various application environments. Confounding factors, such as electrode shifting [18], [19], different contraction levels [20], [21] and changing body positions [22], would inevitably introduce some signal variations that dramatically affect the performance of the classifier trained on ideal laboratory conditions [11], [12]. For example, without considering the transient EMG signals (generally produced at the initiation stage of a contraction), there is only a weak correlation between the control system’s offline classification accuracy and its real usability [23]. Thus, if the EMG signals collected from dynamic contractions are included during training, the usability of the PR-based control scheme can be greatly improved [20], [24], [25]. Body posture is another annoying factor affecting the accuracy of the EMG pattern recognition [22], [26]. This factor can be alleviated by collecting training samples on several preselected body postures (especially, the arm postures) [27], [28], [29]. Another driving source for low online control accuracy is the inadvertent EMG activation, which are caused by involuntary muscular contractions and seen as one of the main reason of frustration during clinical testing [30]. This problem can be somehow resolved through extensive subject training, for obtaining more disciplined, repeatable EMG signals resisting the confounding factors.

To increase the PR-based EMG control’s usability, another solution is to improve the classifier’s generalization ability by directly enveloping some EMG variations during training [24]. However, it is impractical to consider all confounding factors at the same time in one training session. An effective, uniform and easy-to-perform training protocol is greatly desired when pushing PR-based EMG control into clinical practice. From this angle, this note initially proposes a new training protocol that synthesizes dynamic muscle contractions, dynamic limb postures, and inadvertent EMG activations together. This protocol can improve the generalization ability of the PR-based EMG control used in general living conditions.

Section snippets

Subjects

Eight healthy, able-bodied subjects (seven men and one woman, right-handed) participated in our experiment. Their average age is 29.1 ± 4.1 yr (mean ± standard deviation, hereafter), and the average body mass index (BMI, weight/height2) is 21 ± 3.2 kg/m2. These subjects have no records of neuromuscular diseases.

Three transradial amputees (male, right-handed, 42–50 years old, one bilateral amputation caused by electric shock, two unilateral amputation caused by machine accident) also participated in

Intra-protocol and inter-protocol validation

From each protocol, we trained an individual classifier (SVM, RBF kernel, C = 32, γ = 0.125, one-against-one) and validated it on each intra-protocol pair and inter-protocol pair. In intra-protocol validation, the training and validation samples are from the same protocol with 10-fold cross validation. In inter-protocol validation, training and validation samples are from different protocols. The RAR index was calculated and then averaged over all healthy subjects, as Fig. 2 shows.

In intra-protocol

Discussions

A valid PR-based EMG control system should be trained according to its specific application scenario; however, exclusively considering all influence factors seems to be impractical. Traditional methods that train classifier on a fixed arm position with a steady muscular contraction, like SPSE, only promise a very limited scope of application. Current approaches tend to involve EMG variations relative to muscular contractions [21], [24] and arm postures [27], [28], [29], [36], but rarely

Conclusions

It has been verified that promoting EMG diversities in the training session improves the usability of a PR-based EMG control scheme; however, how to properly incorporate every EMG variations in the training session is still unknown. In this note, we attempted to integrate multiple confounding factors (force variations, limb positions, and inadvertent EMG activations) in the data collection, or training phase, to improve the robustness of the PR-based EMG control system. We examined four

Competing interests

None declared

Funding

None

Ethical approval

All participants gave informed consent to take part in the study, which was approved by the Ethics Committee and School of Mechatronics Engineering, Harbin Institute of Technology, China.

Acknowledgments

The authors would like to thank all the subjects participated in the experiments for their generous cooperation. The authors also appreciate the help of Dr. Li for his guidance in the amputee experiments. This work is partially supported by the National Program on Key Basic Research Project (973, NO. 2011CB013306), the National Natural Science Foundation of China (No. 51765123, NO. 61603112), the Self-Planned Task of State Key Laboratory of Robotics and System (NO. SKLRS201603B), the China

References (49)

  • J.A. Berg et al.

    Behavioral demonstration of a somatosensory neuroprosthesis

    IEEE Trans. Neural Syst. Rehabil. Eng.

    (2013)
  • L.R. Hochberg et al.

    Reach and grasp by people with tetraplegia using a neurally controlled robotic arm

    Nature

    (2012)
  • Y.H. Kim et al.

    Neuron selection based on deflection coefficient maximization for the neural decoding of dexterous finger movements

    IEEE Trans. Neural Syst. Rehabil. Eng.

    (2015)
  • L. Honghai

    Exploring human hand capabilities into embedded multifingered object manipulation

    IEEE Trans. Ind. Inf.

    (2011)
  • B. Peerdeman et al.

    Myoelectric forearm prostheses: State of the art from a user-centered perspective

    J. Rehabil. Res. Dev.

    (2011)
  • L. Biagiotti et al.

    How Far Is the Human Hand? A Review on Anthropomorphic Robotic Endeffectors

    (2008)
  • E. Scheme et al.

    Electromyogram pattern recognition for control of powered upper-limb prostheses: state of the art and challenges for clinical use

    J. Rehabil. Res. Dev.

    (2011)
  • C. Castellini et al.

    Proceedings of the first workshop on Peripheral Machine Interfaces: going beyond traditional surface electromyography

    Front. Neurorob.

    (2014)
  • M.A. Oskoei et al.

    Myoelectric control systems—a survey

    Biomed. Signal Process. Control

    (2007)
  • A. Cloutier et al.

    Control of hand prostheses: a literature review

  • D. Edeer et al.

    Upper Limb Prostheses: A Review of the Literature with a Focus on Myoelectric Hands

    WorkSafeBC Evidence-Based Practice Group

    (2011)
  • A.J. Young et al.

    The effects of electrode size and orientation on the sensitivity of myoelectric pattern recognition systems to electrode shift

    IEEE Trans. Biomed. Eng.

    (2011)
  • D. Yang et al.

    Dynamic hand motion recognition based on transient and steady-state EMG signals

    Int. J. Humanoid Rob.

    (2012)
  • T. Lorrain et al.

    Influence of the training set on the accuracy of surface EMG classification in dynamic contractions for the control of multifunction prostheses

    J. Neuroeng. Rehabil.

    (2011)
  • Cited by (28)

    • Human hand movement recognition using infinite hidden Markov model based sEMG classification

      2021, Biomedical Signal Processing and Control
      Citation Excerpt :

      sEMG is a non-invasive procedure to detect, record, and interpret electric activities of skeletal muscles [7]. sEMG signals contain rich planning and execution motion information and have been widely applied in prosthesis [8], rehabilitation [9], human–robot collaboration [10] and teleoperation [11]. Recently, with the development of machine learning, research on pattern recognition (PR)-based myoelectric controllers dominates the academic community [12,13].

    • A robust model-based neural-machine interface across different loading weights applied at distal forearm

      2021, Biomedical Signal Processing and Control
      Citation Excerpt :

      The data-driven approaches attained good myocontrol performance under ideal experimental conditions. However, as the data-driven approaches lacked learning transfer, their control performance would drop dramatically while the testing conditions’ variance occurred, such as electrode shift [28,29], upper limb posture changes [30,31], loading weight changes [32], and long-term usage [33,34], etc. Several methods have been introduced to account for the variability of the conditions to improve the decoding accuracy of EMG-based NMIs [35,36].

    • Robust EMG pattern recognition in the presence of confounding factors: features, classifiers and adaptive learning

      2018, Expert Systems with Applications
      Citation Excerpt :

      Moreover, we attached an external load (250 g weight) to the hand, to allow assessment of the effect of inadvertent EMG activities caused by wrist rotation. We found that a dynamic training protocol collecting the EMG signals at dynamic limb postures together with varying force levels can greatly improve the classifier's robustness against multiple confounding factors (Yang, Gu, Jiang, Osborn, & Liu, 2017). However, since the electrodes we used at that time (Otto Bock®, 13E200 = 50) only produced a type of direct-current, enveloping myoelectric signal, the evaluation work on various EMG features was not performed.

    View all citing articles on Scopus
    View full text