Biologically-inspired push recovery capable bipedal locomotion modeling through hybrid automata☆
Introduction
Human like machine development in various areas is the need of the hour, for instance, in an event of disaster anthropomorphic bipedal robots can come in handy. Studying human anatomy for walking can also be utilized to design prosthetics for the injured or handicapped [1]. The bottom line is giving the reality to the dream that robots perform tasks conducive for humans like climbing stairs, avoiding obstacles, traversing inaccessible rough terrains and space exploration are to name a few. Currently available humanoids, Honda’s Advanced Step in Innovative Mobility (ASIMO), Humanoid Robotics Project (HRP)-2 and NAO walk with bent knees so that dynamic CoM is always above the feet so that it does not roll at the cost of the flat foot move. The most evident solution to bent-knee problem seems to be purely passive walking gait without actuation. But ballistic knee dynamic walkers, similar to that of Ted McGeer’s [2], need actuation when plying on flat surfaces, uphill or rough terrains and more importantly considering 3D, i.e. yaw effects is necessary.
To be compatible with human environment, bipeds are preferred albeit inherently unstable. Human walk is outcome of several thousands of years of evolution and thus worth this attention while most of the presently available robots walk with bent knee/flat foot [3]. We are habitual of walking on flat ground so we are not bothered to pay attention to it. Human–robot interaction will also help in rehabilitation of injured [4], prosthetics and assistance to elders. We develop robot capable of doing wide variety of works in place of humans. A human-inspired method for achieving bipedal robotic walking is proposed in which a hybrid model [5] of a human is used in conjunction with experimental walking data to obtain a multi-domain hybrid system.
Humanoid locomotion modeling and generation of rhythmic pattern is considered as a highly complex and non-linear problem. There is lot of research already done in the field of bipedal locomotion. There are several methodologies which have been used to attain the insight of biped locomotion. Kiyotoshi Matsuoka [6] has described how simple neurons can be connected together to design a neural oscillator [7] to produce rhythmic patterns for given input parameters.
We seek to find a new way towards automatically generating stable flat ground biped robotic walking from human gait combined with human inspired control which displays a universal behavior. Human walking is realized the several DoF (Degrees of Freedom) coupled with highly non-linear dynamics and forces such that the (velocity of) leg comes to rest when it strikes the ground [8], [9]. So we try to obtain a low dimensional representation of human walking and modeling the continuous and discrete behavior through hybrid systems [10], [11].
The hybrid system [12] is a dynamic system which has both continuous and discrete components. To represent such type of system we apply hybrid automata representation [13], [14]. To manifest both components, flow is represented by a differential equation while jump can be described by a difference equation or control graph allowing for more flexibility in modeling dynamic phenomena. There are several systems which can be modeled using the Hybrid systems [15], [16], such as physical system with impact, logic-dynamic controllers, and even internet congestion to name a few [17], [18]. In general, the state of a hybrid system [19], [20] is defined by the values of the continuous variables and a discrete control mode [21], [22]. The state evolution is governed either, continuously according to a flow condition, or discretely according to a control graph. Continuous flow dictates, as long as so-called invariants hold true, while discrete transitions occur as soon as stated jump conditions are agreed upon [23], [24]. Discrete transitions are associated with events also. Fig. 1, Fig. 2 are the graphical decomposition of human gait cycle into different phases.
All the earlier research related to bipedal locomotion pattern generation is classified into two categories [25], [26]:-
- 1.
First category of bipedal walk study is based on precise knowledge about robot dynamics. The dynamics parameters are mass, location of CoM and inertia for each internal link prepared for the model. So whole study is based on the underactuated system which is very much close to human walking pattern and thus based on accuracy of model data.
- 2.
Second category of study based on the fully actuated system. On contrary this group uses very few information of dynamics such as location of total CoM and total angular momentum. This approach relies on a feed back control since controller has less information about system dynamics.
Before providing a formal and detailed description of our algorithm, it is necessary to provide some details into the nature of the gait cycle and the various phases associated with it. The following points summarize the relevant features of human gait [27], [28], [29].
- 1.
Each gait cycle is usually of about 1–1.3 s on an average but the figures may vary for the given data.
- 2.
There are broadly two phases Stance and Swing and each is further into a four sub phases. Each phase and sub phase accounts for a percentage of the entire gait cycle. Usually the Swing phase roughly accounts for 40% of the gait cycle and Stance phase approximates to 60% of the gait cycle.
These timestamps are not very sharp and distinct that is, in other words the decision boundaries between the different sub phases have an inherent fuzziness associated with them [30]. There might be missing timestamps and other data points in the training dataset [31], hence the system was first trained on a rigorous human annotated and almost error free standard dataset [32], [33]. Subsequently other datasets were added to it in order to enrich it. As mentioned before the sampling rate of the data plays a very important role, as under sampling as well as oversampling require minor tweaking of our algorithm.
The phases of the human gait are depicted in Fig. 3:
Physical observation of human gait[]
- 1.
The motion of the COM is sinusoidal in nature both in the vertical and the horizontal plane.
- 2.
The two phases occur alternately, that is when one leg is in swing phase the other leg is in the stance phase and vice-versa.
- 3.
The Gait signal is unique to a given person but the phases and their response time in general are almost common to all persons.
- 4.
This periodicity in gait signal has to be exploited in order to achieve tangible results.
- 5.
The motion signal of the knee is highly non-linear due a double hump which is noticed in the knee signal. This makes things much more difficult to model. All the difficulty arises from this non-linear signal.
The organization of the paper is divided into six sections. Section 1 gives the essential background details, history, terminology of hybrid system and human locomotion modeled as a hybrid automaton. Section 2 is dedicated to the Human GAIT analysis, which is essentially a foremost requirement for discernment of human locomotion, their stability analysis and their capability of recovering from unknown perturbations. Section 3 is dedicated for hybrid system and manifestation as hybrid automata. Section 4 is about the humanoid locomotion as hybrid system and the parameters for hybrid automata design. The fifth section is verification of our hybrid automata model with OpenSim humanoid gait data [34]. The last section will tell about more the concluding remarks and future scope with impending work.
Section snippets
Methodology
The methodology used here is as, starting with human data, we look for various behaviors incorporated in human walking by representing data in a general yet simple form of a function. Using this anthropomorphic representation, we aim to design a nonlinear controller for robots. Along the lines of a biologically-inspired control [35], we constitute a canonical walking function incorporating all other output data which defines a solution to system. To establish a formal method we zero in for a
Experimental results and analysis
Our Model:- The Model has total 6 Degree of freedom. 3 for each leg and the dynamics and model parameters are defined in Table 1. Fig. 9 is the ideal curve of different joints and Fig. 10 is the details of the our Automata Implementation.
The confidence intervals of the invariants are shown above; here is the absolute value of the correlation coefficient between similar joints of both the legs like right hip and left hip, right knee and left knee, etc. The guards are the functional thresholds
Conclusion, impending work and discussions
We frame the problem of finding the best possible gait for a biped under some perturbation and then balancing itself towards stable gait as a hybrid control system problem. Our prima facie results demonstrate the power and potential of hybrid system. The problem as a whole is audacious in hybrid control, and this work puts forward first steps in the direction of paving way for efficient tools for handling such type of problems. We developed the biological inspired controller for humanoid walk.
Vijay Bhaskar Semwal obtained his B.Tech. from the College of Engineering Roorkee, Roorkee, in 2008. He received his M.Tech. from IIIT Allahabad in 2010. Currently, he is pursuing a Ph.D. from IIIT Allahabad. Before becoming a research scholar at IIIT Allahabad, he worked as a Senior System Engineer (R&D) with Siemens Gurgaon and Bangalore. He has worked for various major organizations, such as Siemens AG and Newgen. Currently he is serving as vice chair for IEEE student branch of
References (41)
- et al.
Biometric gait identification based on a multilayer perceptron
Robot. Auton. Syst.
(2015) - et al.
Biped dynamic walking using reinforcement learning
Robot. Auton. Syst.
(1997) - et al.
Design improvements and control of a hybrid walking robot
Robot. Auton. Syst.
(2011) - et al.
Using computed muscle control to generate forward dynamic simulations of human walking from experimental data
J. Biomech.
(2006) - et al.
Comparison of different gaits with rotation of the feet for a planar biped
Robot. Auton. Syst.
(2009) - et al.
Toward a human-like biped robot with compliant legs
Robot. Auton. Syst.
(2009) - et al.
Modeling, stability and control of biped robots—a general framework
Automatica
(2004) - et al.
Automatically composing and parameterizing skills by evolving finite state automata
Robot. Auton. Syst.
(2012) - et al.
Response threshold models and stochastic learning automata for self-coordination of heterogeneous multi-task distribution in multi-robot systems
Robot. Auton. Syst.
(2013) Context and Consciousness: Actiivty Theory and Human–Computer Interaction
(1996)
Passive dynamic walking
Int. J. Robot. Res.
The theory of hybrid automata
Biomechanical analysis on the foot under normal and abnormal gait for orthotics design
Key Eng. Mater.
Mechanisms of frequency and pattern control in the neural rhythm generators
Biol. Cybernet.
Human activity recognition using gait pattern
Int. J. Comput. Vis. Image Process. (IJCVIP)
Hybrid model structures
Modularity for timed and hybrid systems
Cited by (54)
Design and analysis of a novel 12-DOF self-balancing lower extremity exoskeleton for walking assistance
2022, Mechanism and Machine TheoryDevelopment of the LSTM Model and Universal Polynomial Equation for All the Sub-Phases of Human Gait
2023, IEEE Sensors JournalBalance and Posture Control of Legged Robots: A Survey
2023, Journal of Intelligent and Robotic Systems: Theory and ApplicationsHDL-PSR: Modelling Spatio-Temporal Features Using Hybrid Deep Learning Approach for Post-Stroke Rehabilitation
2023, Neural Processing LettersData Driven Approach for Inverse Kinematics in 2D and 3D
2023, 2023 IEEE 7th Conference on Information and Communication Technology, CICT 2023
Vijay Bhaskar Semwal obtained his B.Tech. from the College of Engineering Roorkee, Roorkee, in 2008. He received his M.Tech. from IIIT Allahabad in 2010. Currently, he is pursuing a Ph.D. from IIIT Allahabad. Before becoming a research scholar at IIIT Allahabad, he worked as a Senior System Engineer (R&D) with Siemens Gurgaon and Bangalore. He has worked for various major organizations, such as Siemens AG and Newgen. Currently he is serving as vice chair for IEEE student branch of IIIT-Allahabad. For 2013–2014 he served as publicity committee mentor for IEEE student branch IIIT Allahabad. His research interests are machine learning, evolutionary algorithms, analysis of biped locomotion and humanoid push recovery, artificial intelligence, design & analysis of algorithms, biometric identification, Brain wave based authentication. He has published 3 SCI Journal Papers. His paper titled “Less computationally intensive fuzzy logic (type-1)-based controller for humanoid push recovery” got much attention and acceptance in robotics research communities for its novel contribution (PDF).
Shiv Ashutosh Katiyar obtained his B.Tech. in Electronics & Communication Engineering from the Shri Ramswaroop Memorial College of Engineering & Management, Lucknow in 2010. He received his M.Tech. in Information Technology (Specialization in Robotics) from IIIT Allahabad in 2014. Currently, he is working as Software Engineer at Verizon Data Services India (VDSI) Pvt Ltd, Chennai. He qualified the prestigious Graduate Aptitude Test for Engineering (GATE). His research interests are machine learning, analysis of biped locomotion and humanoid push recovery, artificial intelligence, control system, non-linear dynamics, humanoid robotics and hybrid system.
Rupak Chakraborty is an undergraduate student at the Indian Institute of Information Technology, Allahabad. Presently he is in his senior year, his interests lie in Machine Learning, Artificial Intelligence, Robotics, Computer Vision and allied fields. Apart from this he takes an avid interest in Algorithms and Data-structures. He will be joining Adobe Systems, India from July, 2015 after his graduation.
G.C. Nandi graduated from Indian Institute of Engineering, Science & Technology (Formerly Bengal Engineering College, Shibpur, Calcutta University), in 1984 and post graduated from Jadavpur University, Calcutta in 1986. He obtained his Ph.D. degree from Russian Academy of Sciences, Moscow in 1992. He was awarded National Scholarship by Ministry of Human Resource Development (MHRD), Govt of India in 1977 and Doctoral Fellowship by External Scholarship Division, MHRD, Govt. of India in 1988. During 1997 he was visiting research scientist at the Chinese University at Hong Kong and he was also visiting Faculty with Institute for Software Research, School of Computer Sciences, Carnegie Mellon University, USA, (2010–2011). Currently, he is serving as the senior most Professor and Dean of Academic Affairs of Indian Institute of Information Technology, Allahabad. From January to July 2014, he served as the Director-in-Charge of Indian Institute of Information Technology, Allahabad. He is the Senior Member of ACM, Senior member of IEEE, Chairman, ACM-IIIT-Allahabad Professional Chapter, (2009–2010), Chartered Member of Institute of Engineers (India), Member of DST (Department of Science and Technology, Govt. of India) Program Advisory Committee member of Robotics, Mechanical and Manufacturing Engineering. He has published more than 100 papers in the various refereed journals and international conferences. His research interest includes robotics specially biped locomotion control & humanoid push recovery, artificial intelligence, soft computing and computer controlled systems.
- ☆
Tools: Webots, Matlab, Imitator, OpenSim.