Next Article in Journal
A Smart Card-Based Two-Factor Mutual Authentication Scheme for Efficient Deployment of an IoT-Based Telecare Medical Information System
Previous Article in Journal
EMD-Based Energy Spectrum Entropy Distribution Signal Detection Methods for Marine Mammal Vocalizations
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Improving Accuracy of Real-Time Positioning and Path Tracking by Using an Error Compensation Algorithm against Walking Modes

1
Department of Mechanical Engineering and Automation, Northeastern University, Shenyang 110819, China
2
Senzhigaoke Co., Ltd., Shenyang 110002, China
3
Robotics Laboratory, Shenyang Sport University, Shenyang 110102, China
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Sensors 2023, 23(12), 5417; https://doi.org/10.3390/s23125417
Submission received: 4 May 2023 / Revised: 29 May 2023 / Accepted: 5 June 2023 / Published: 7 June 2023
(This article belongs to the Topic Wireless Sensor Networks)

Abstract

:
Wide-range application scenarios, such as industrial, medical, rescue, etc., are in various demand for human spatial positioning technology. However, the existing MEMS-based sensor positioning methods have many problems, such as large accuracy errors, poor real-time performance and a single scene. We focused on improving the accuracy of IMU-based both feet localization and path tracing, and analyzed three traditional methods. In this paper, a planar spatial human positioning method based on high-resolution pressure insoles and IMU sensors was improved, and a real-time position compensation method for walking modes was proposed. To validate the improved method, we added two high-resolution pressure insoles to our self-developed motion capture system with a wireless sensor network (WSN) system consisting of 12 IMUs. By multi-sensor data fusion, we implemented dynamic recognition and automatic matching of compensation values for five walking modes, with real-time spatial-position calculation of the touchdown foot, enhancing the 3D accuracy of its practical positioning. Finally, we compared the proposed algorithm with three old methods by statistical analysis of multiple sets of experimental data. The experimental results show that this method has higher positioning accuracy in real-time indoor positioning and path-tracking tasks. The methodology can have more extensive and effective applications in the future.

1. Introduction

High-precision 3D indoor positioning and navigation methods [1] have a strong demand for portability, real-time, high accuracy and stability in scenarios such as the safety and security of rescue personnel and real-time worker location identification in industrial scenes. However, with the improvement of social modernization and the complexity of urban building structures, traditional navigation modes based on radio frequency navigation are difficult to meet the existing needs. Radio frequency navigation methods rely on satellite timing positioning or signal reduction algorithms for spatial positioning [2,3,4]. Traditional civil frequency satellite positioning methods have poor positioning accuracy, with an accuracy range of about 2 m. Although RTK or PPK technology based on differential satellite positioning [5,6,7] has been applied in recent years, and its accuracy has also been improved to a centimeter level. For rescue and industrial indoor scenes, satellite signals cannot be effectively transmitted and received [8], which greatly limits the application and development of this technology in indoor environments. However, various indoor navigation technologies based on signal attenuation models, such as positioning based on WIFI and UWB ultra-bandwidth [9,10], suffer from huge installation costs and relatively complex usage mode. The use of this type of approach does not allow for high indoor positioning accuracy and requires dense pre-set dedicated RF tag nodes, with positioning accuracy being greatly affected by node density and line-of-sight obstructions.
In the context of the rapid development of MEMS technology [11], especially with respect to human wearable devices [12], the excellent characteristics of MEMS, such as miniaturization and low power consumption, make it widely demanded and applied in medical, industrial modernization, military, sport and other scenarios. Optical motion capture methods or MEMS sensor motion capture method is commonly used in precise positioning of the human body [13,14,15]. However, this positioning method based on special equipment for remote video acquisition cannot be effectively applied in situations such as fire-damaged scenes or earthquake rescue in which the space is small and the camera is not arranged in advance and cannot be possible to get enough good line of sight [16,17]. The inertial navigation positioning method can effectively avoid the limitation of relying on external pre-arranged equipment. This method relies on the built-in sensors of the inertial navigation system to sense the movement and rotation of the object and to obtain the moving position and trajectory of the three-dimensional space by algorithm [18] integration. However, the high-precision inertial navigation positioning method requires the use of a high-precision fiber optic [19] gyroscope or a high-precision accelerometer [20], which is too large for the human body to wear. Furthermore, the resolution circuit of the high-resolution accelerometer [21] is relatively complex, so it cannot be used for portable applications in body-worn devices.
The integrated inertial navigation method using MEMS manufacturing process [22] has the characteristics of small volume, light weight and simple structure. As a portable sensor scheme that can be worn on the human body, it is widely used in rescue scenarios and other applications, for example, a watch accessory or integrated into clothing [23]. As the precision of the monolithic integration sensor cannot be compared to that of larger light-based gyroscopes and piezoelectric accelerometers, the data collected by the MEMS sensor itself alone have a large drift in real-time position obtained by primary and secondary integration of angular velocity and acceleration due to manufacturing accuracy errors and low sampling frequency [24,25]. The traditional positioning method based on the monolithic MEMS sensor often use the zero velocity detection methods (ZUPT) [26], which relies on fixing the position of human lower limb leg or foot, by detecting the state of zero relative velocity between the foot and ground, such as the supporting phase of human gait to reduce the serious position deviation caused by sensor data drift. This method requires to analyze and preprocess the whole data to obtain the characteristics of the overall drift of the data, followed by data filtering to finally obtain more accurate positioning data. Nevertheless, as a replay-based positioning method, it does not allow for good real-time human location. Another solution is to use the method of whole-body wearable motion capture [27], which detects the location of the person wearing the device. This method can realize real-time positioning, but it can only rely on inertial data for landing detection on the foot. In the implementation of landing detection, the sensor fixed near the foot or lower limb may appear wrong landing detection, advance detection or lag landing detection due to occasional small sliding movements [28,29]. Therefore, how to design a positioning method suitable for the application scene with high accuracy, stability and real-time requirements is a problem that needs to solve for indoor positioning technology.
This paper focused on improving the positioning accuracy of gait analysis based on IMUs. By the motion capture system with 12 wireless IMU modules we implemented before, the real-time position of each foot can be got within 20 ms. We attempted to get more accurate position for real-time walking simulation, and it gave a try to add two high-resolution pressure insoles to the system, which could be used in a particular example of analyzing a footballer’s nifty footwork. The main aims and contributions of this paper are:
  • Using high-spatial-resolution plantar-pressure insoles to capture plantar pressure distribution has improved the accuracy of plantar pressure distribution when the foot comes in contact with the ground, achieving recognition of five walking modes;
  • Analyzing and comparing three previous IMU landing point capture and path tracking methods, conducting error analysis and proposing improved methods;
  • Implementing a system with a fully wireless, synchronous and real-time transmission software and hardware architecture, and completing on-site testing of five walking modes;
  • Exploring the possibility of multi-scene adaptation and proposing a method for determining the position of feet under changing ground conditions.

2. Related Work

The positioning method of relying on IMU can achieve spatial positioning. How to capture the time and position of touching the ground more accurately is the key to improve the accuracy of the spatial positioning of inertial motion capture. Common methods for judging the state of the foot touchdown are the feet ground height comparison method, foot acceleration jitter judgment and insole pressure threshold judgment. The difference between these three methods lies in the conditions that trigger the touchdown judgment; the method for updating the position after triggering the touchdown condition is consistent. V c h a n g e is the 3D vector from the touchdown foot pointing ( P t ) to the suspended foot ( P s ). We defined two bool variables, T D R and T D L , representing the touchdown status of the right or left foot, respectively. Assuming the right foot touches the ground, the action vector is given by Equation (1); the action vector for the left foot touchdown is given by Equation (2). Finally, the location of the current suspended foot is given by Equation (3):
V c h a n g e = V R 2 L = P L P R , i f T D R = 1 ,
V c h a n g e = V L 2 R = P R P L , i f T D L = 1 ,
P s = P t + V c h a n g e ,
where P R and P L are the positions of the right and left foot, respectively.
The problem is how to choose from Equations (1) and (2) to find V c h a n g e . In the following sections, three touchdown judgment methods are compared.

2.1. Judgment by Height of Left and Right Foot—Only IMU

Day to day, the human body, especially in an indoor environment, mostly experiences flat walking situations. There is a change in the vertical drop when walking, and the lowest point of both feet is the moment the human foot touches the ground. Hence, we can judge which foot is touching the ground by comparing the vertical height drops, with the following Equation (4):
T D R = 1 , i f P L z > P R z , T D L = 1 , i f P R z > P L z ,
where P R z and P L z are the z axis positions of the right and left foot, respectively.
The advantage of the both feet level height comparison algorithm is the simplicity of the judgment, the low consumption of computing resources and the ability to quickly determine which foot is in contact with the ground. However, there is a greater possibility of misjudgment, mainly reflected in the following three aspects:
  • The purely flat walking area in the daily state is too idealized to guarantee the horizontal state at the time of walking;
  • The angle error and error connection caused by the measurement error will lead to the jumping error between the actual height position of the feet and the calculated height position, which will lead to the estimation of the height of the feet not being absolutely accurate;
  • The judgment of height comparison between the feet during walking and the moment of contact between the foot and the ground do not coincide exactly. During the gait cycle, only the middle of the support phase is identifiable, as the foot in contact with the ground does not produce large slips, while other transition moments produce a situation where the position of the foot in contact with the ground moves relative to the ground, so it will lead to incorrect judgments of the time of full contact with the ground.

2.2. Zero-Speed Detection and Positioning of Foot Jitter Acceleration—Only IMU

According to the law of the data in the gait cycle, the acceleration data of the foot will be close to the stationary state when the foot is in a state of touching the ground [30,31]. After through filtering and threshold judgment, the triaxial acceleration vectors can obtain the feet alternately time of quasi stationary state with the ground. As shown in Figure 1, when the stationary data is 1, it is judged to be the moment when the foot touches the ground and locks with the ground [32], determined by removing the 3D component of gravity in the absolute space of the sensor, as shown by Equation (5):
T D R = 1 , i f A R < A a , T D L = 1 , i f A L < A a ,
where A L is the 3D acceleration value of the left foot, A R is the 3D acceleration value of the right foot, A a is the modulus length of the threshold foot acceleration for determining the stationary landing foot and scalars A R and A L represent the right and left foot, respectively.
The advantage of the foot acceleration locking algorithm is that the state at the moment of touchdown can be judged more quickly by acceleration and has the characteristic of a more obvious data cycle. However, in the process of three-dimensional fixed measurement, if the absolute acceleration analysis is adopted, that is, containing the numerical component of gravitational acceleration in three axes, the numerical intelligence of the three-axis components is not completely consistent with the data thresholds of different fixed positions and attitudes. If the net three-dimensional acceleration method with gravitational acceleration removed is used to measure the data, it is necessary to calculate the spatial attitude of the data and eliminate the projection component of gravity, which is computationally intensive. As the touchdown foot is not completely stable, this method will experience acceleration jumps on the uneven and partially rugged ground, resulting in an incorrect moment of touchdown judgment.

2.3. Judgment by Net Data of Foot Pressure Insoles—IMU + Insole

Generally, the method of using pressure shoes to trigger and determine the contact point is more accurate than the IMU method. The plantar pressure value is monitored cyclically, and considered a touchdown state when it exceeds the threshold, as shown in Equation (6):
T D R = 1 , i f M a x P r e s s u r e R > t h r e s h o l d , T D L = 1 , i f M a x P r e s s u r e L > t h r e s h o l d ,
Figure 2 shows the phases of the gait cycle starting with the right leg as an example, which was mainly divided into four support types [33]. In the double support phase, where both feet are touching the ground, the foot may slide on the ground. Then, in the single support phase, the right foot touches the ground with no movement. In the third phase (another double support phase), the left foot begins to touch the ground. In the last phase, the left foot becomes the single support foot.
Due to the uniformity of the foot morphology, it is common to use the judgment method of plantar pressure [34] net value for a quick moment-to-moment judgment of whether there is a touchdown. However, this will cause a large error in the judgment when the soles of the feet and the ground slide or the ground is relatively rugged and uneven.

3. Materials and Methods

3.1. System Architecture

Twelve IMUs and a pair of insoles with pressure sensors were combined to collect data, as shown in Figure 3. However, in fact, we utilized seven IMUs marked with dark blue to calculated the P R and P L , and insoles marked with orange to compensate for theerror. Each cross symbol represents the location of the IMU, and every pressure insole is placed inside corresponding shoe. All data needed are transmitted to the PC through WiFi with the UDP protocol, and then analyzed in the software. The data transfer rate is 50 Hz. By analyzing the UDP protocol data of wireless sensor, data delay rate is less than 10 ms. All data are synchronized by timestamp alignment in multiple sensor data frames in the motion capture software, and the error of the synchronized acquisition trigger time is controlled within 20 ms. The synchronized data are processed to form a 3D structure of the human rod connection and a plantar pressure distribution image of both feet in self-developed gait analysis software. This complete WSN system [35] can collect and analyze data during human walking, identify the contact points of the foot and compare the actual walking path with the reconstructed path data.
The posture measurement system used in this work was self-designed, which is called TRACKING TM and typed as CRE-CC02, with 0.81° absolute angle accuracy tested by the third-party institution CHANGCHENG INSTITUTE OF METROLOGY & MEASUREMENT. It is a nine-axis IMU with three axes, i.e., accelerometer (range: ±16 g), gyroscope (range: ± 2000 /s) and magnetometer, available for multi-dimensional data fusion and posture recognition relative to the ground coordinate. As shown in Figure 4, IMU can be connected to the main chip (an MCU supporting wireless communication at the center of Figure 4d) by the IIC bus in two ways. One way is to integrate the chip onto the board, as shown in Figure 4e. Another way is to connect the module to the board through wires (see Figure 4a,d,f). There are four combinations available depending on the way and location, and we can choose from them according to actual needs. The product is powered by a lithium-ion rechargeable battery (see Figure 4b). The appearance packaged in a shell (see Figure 4c) and coordinate system definition is shown in Figure 4g,h. IMU’s data, including quaternions, three axes of acceleration and three axes of angular velocity, are sent to the PC at each sampling period. The size of the module in Figure 4g is 37 mm × 37 mm × 14 mm, while the size of the module in Figure 4h is 25 mm × 10 mm × 4.5 mm.
While traditional plantar pressure insoles use eight or fewer pressure sensors, we chose a high-resolution pressure insole (RPPS-99, LEGACT Technology Co., Ltd, Shenzhen, China) with 99 points (measuring range: 0.1–10 kg, durability: 1 million times) for plantar-pressure-data acquisition and analysis, as shown in Figure 5. Each insole is equipped with an ESP32 Arduino to collect the AD value and send data to a PC by using WiFi. The figure also shows the distribution of plantar-pressure sensors and shoes used for experiments. Due to the fact that insoles are not self-designed, the first step before the experiment is to calibrate insoles using a pressure gauge (WDF-500, Wei Du Electronics Co., Ltd, Wenzhou, China) with a measurement of 500 N and accuracy of ±1%. As shown in Figure 6a, the pressure gauge is pressurized to the insole’s sense point by rotating the screw at the top end. Then, 14 bit of AD voltage of the single point sampled by 50 Hz is printed in real time through a serial port. The collected measurement values corresponding to pressure values of 0–200 is calibrated using the MATLAB curve fitting tool, as shown in Figure 6b. The result shows that the mathematical relationship between the pressure value and the AD value of the insole is a cubic polynomial. After completing the calibration, multiple plantar pressure data can be collected. In our experiments, the point at which the pressure is greater than the threshold (5N) will have its value recorded, with an acquisition range of 5–200 N.

3.2. Error Analysis of the Foot Touchdown Position

3.2.1. Error in P c h a n g e

Each of the above three methods (see Section 2) has its own advantages and disadvantages, but none of them have been able to solve existing principal errors. In Figure 7, it is assumed that both feet move along the desired straight line from left to right (right arrow dotted line), and in fact, that the landing point is fitted as a spline curve (solid line with arrow), with a solid circle representing the landing point ( P t ) and a hollow circle representing the position of one foot in the air P s when another triggers a touchdown. The vector V c h a n g e is the change from a foot during touchdown and suspension (see Equation (3)). In theory, the real action vector connects two adjacent landing points (i.e., P c h a n g e ), while V c h a n g e leads to errors in analyzing the touchdown to suspended foot position.

3.2.2. Error in P R , P L

For real-time path tracking in gait analysis, we expected to capture more accurate landing points. A three-dimensional real-time pose model of human bones [36] is constructed in gait analysis using spatial pose equations. Here, the additional five IMU modules were not considered. Each position and posture information of lower limbs can obtained with link-frame assignment [37], as shown in Figure 8, relying on data of seven IMUs (one at the waist and six at the lower limbs, see Figure 3). Here, O 0 represents hip joint, O 1 . x and O 2 . x represent the centers of articulation (knee and ankle joints) and O 3 . x represent the end of feet. Among them, two purple marker points (O 3 . x ) represent the foot position (i.e., P R , P L ), which is from the transformation matrix, as shown in Equation (7) within the motion capture system:
3 0 R = 1 0 R 2 1 R 3 2 R ,
where P R / P L is from the last column of a matrix 3 0 R , which represents O 3 . x relative to O 0 , and x refers to both legs.
Since the wrapping between the shoe and the foot is a loosely fixed relationship, the position of the foot relative to the shoe is not fixed during walking. As shown in Figure 9, P 1 to P 3 is the leftmost position of the foot in the shoe, P 2 to P 4 is the rightmost position, P 5 to P 7 is the foremost position and P 6 to P 8 is the rearmost position. The movement of the feet relative to the calves (in Figure 8, O 3 . x is relative to O 2 . x , and x refers to both legs) only involves rotation, without a translation motion; the IMU fixed on the shoe has a displacement relative to the foot during walking, which leads to errors in calculating P R , P L by a kinematic transformation matrix.

3.3. Proposed Improvement—IMU + Insole

In order to improve the accuracy of real-time path tracing in gait analysis, considering errors in P R , P L and P c h a n g e , this paper improves the threshold judgment method of insole pressure (see Section 2.3).
By using pressure insoles with high spatial resolution, we can more accurately locate the force point of the foot, as shown in Figure 10. Obviously, there are different force points when we walk on different paths, such as going straight, turning, etc. The walking mode can be realized through the position relationship of the maximum pressure point on the front and back soles of both feet during walking.
After analyzing the plantar-pressure points in the process of walking, we carried out more fine-error-position compensation. We have defined five walking modes: straight forward walking, small angle left turn, small angle right turn, large angle left turn and large angle right turn, as shown in Figure 11. The small turning radius is 2 m, and the large turning radius is 4 m. In the path tracking process, not only should the touchdown trigger be identified, but also the walking mode. According to the real-time recognized walking mode, we compensate for the error of each step to achieve higher positioning accuracy, as shown in Equation (8). The flow of the real-time compensation algorithm realized with the software is shown in Figure 12.
P s = P t + V c h a n g e + ε P ,
where ε P is the compensation value, which depends on the recognized walking mode.
The rules table for walking modes recognition and compensation values corresponding to the five modes were obtained with the experiments. All three participants had normal arched feet. Each person walked 50 steps at a time and repeated this three times along each path, for a total of 45 trials. We firstly marked a series of points on the path, with a jagged distribution of an average of 0.5–0.6 m intervals, as shown with the black points in Figure 11. Other paths are similar. Participants were asked to step on the marker point for each foot landing. By comparing the measured values P L , P R with the actual value of the corresponding marked point, we were able to obtain the error compensation values for both feet in each walking mode. Finally, we took the average error of nine trials as the compensation values for each mode, as shown in Table 1.
Furthermore, we established the coordinate position of the high-resolution pressure insole, as shown in Figure 13. By comparing the foot pressure distribution characteristics under five walking modes, areas with obvious recognition were identified. P F 1 and P F 2 positions were selected latitudinally, and P L 1 , P L 2 , P L 3 , P R 1 and P R 2 longitudinally. The fourteen pressure sensing points covered are the key data for determining the walking mode. The discriminant criteria are summarized in Table 2 after the experiments. B W is the body weight of the human body. When the S t e p detected is less than the threshold L w (15 cm here, because it can filter out the situation of walk dragging along the ground), and the total pressure at the relevant positions exceeds 0.7 times the body weight, it can be considered to be in a stationary standing state. F L represents the left foot pressure, F R represents the right foot pressure and the subscripts correspond to the pressure area in Figure 13. For example, F L P R 1 > t h means that when the pressure value in the PR1 area of the left foot is greater than the threshold, it is determined that the left foot is in a 4 m radius right turn mode. Based on Table 1, the compensation value [x, y] is equal to [−0.94, −0.52]. F L P R i is the sum of F L P R 1 and F L P R 2 . `&’ means logical `and’; `|’ means logical `or’. t h is the pressure threshold for triggering judgment.

3.4. Comparison Experiments

To verify that the improved compensation algorithm is more accurate than the previous three methods (see Section 2), we designed repeated experiments of walking on a flat ground. In the experiment, we asked each subject to wear wireless IMUs and wireless plantar pressure insoles and walk counterclockwise from point A along a straight line to points B, C and D, and finally back to point A. Figure 14a shows a top view of the experimental site, where the checkerboard grid represents the dimensions of the floor tiles, each measuring 400 mm × 400 mm, with AB and CD measuring 7 × 400 mm and BC and DA measuring 10 × 400 mm. We collected the motion capture and plantar pressure synchronization data from four healthy representative subjects (see Table 3) of different body shapes, 10 times/person, for a total 40 trials.
During each experiment, the data of all IMUs and insoles are synchronously collected by the computer, and the real-time virtual motion capture of IMU can be seen with the gait analysis software, as shown in Figure 14b. After all the experiments were completed, we used four methods to reconstruct the walking path (see right side in Figure 14). Finally, we compared the deviation between the walking paths fitted by the four methods and the preset test rectangular path.

4. Results

For the convenience of description, we have agreed on the identification of four methods as follows:
Method I:
Judgment by height of both feet;
Method II:
Zero-speed detection;
Method III:
Net data of plantar pressure;
Method IV:
Improved compensation algorithm.
After using these four methods to process data and reconstruct paths separately, we obtained position values of the four marked points A, B, C and D. It should be noted that point A data represent the value when walking back to the starting point. In Figure 15, where blue, green, cyan and red correspond to the data points results of the above four methods, Figure 15a shows the absolute positions at each point, and Figure 15b shows the net bias of all points after subtracting the absolute positional deviation. Method IV outperforms the other methods in terms of absolute value response and net deviation in both mean position and dispersion. Figure 16 shows the mean and net deviation results in the x-direction and y-direction at points A, B, C and D (four boxes from left to right in each subblock) with the four methods. Both figures show that the fourth set of data outperforms the previous sets in terms of mean, median and deviation values.
By comparing the mean, median standard deviation and variance of the four points under different methods, as shown in Table 4, we found that Method IV has the lowest mean/median bias and variance at each point. This result indicates that the values obtained by the fourth method are closer to the target point than the previous three methods.
The original data of A, B, C and D obtained by the four methods were statistically analyzed, and the data of central tendency and dispersion degree of each group of data were obtained, as shown in Table 4. Comparing the mean and median values obtained by the four methods at points A, B, C and D, we can see that the mean and median values obtained by the second method are smaller than those obtained by the first method, the mean and median values obtained by the third method are smaller than those obtained by the second method and the mean and median values of X and Y obtained by the fourth method are closer to 0 compared to those obtained by the first three methods. This indicates that the values obtained by the fourth method are closer to the target point than the first three methods.

5. Discussion and Conclusions

By comparing the standard deviation and variance values obtained by the four methods at four points A, B, C and D, it can be found that the standard deviation and variance values of X and Y obtained by the second method are less than those of the first method, the values obtained by the third method is less than that of the second method and the values obtained by the fourth method are the least. The results show that the fourth method has a lower degree of data dispersion, shown by the statistical results in the scatter diagram, see Figure 15.
In our research, we proposed a improved feet positioning compensation method, using a practical multi-sensor data acquisition and analysis system. By sensing the walking mode through high-spatial-resolution plantar pressure, the system automatically matches the compensation values obtained from the experiments. Compared to other methods, it has higher accuracy to recognize touchdown and trace path in gait analysis. In a sense, this is a compensation method based on statistical error [38], so it can achieve even better results under test conditions within the preset mode range. It was reported that none of 17 proposed algorithms can be generally preferred over the others in gait event detection from IMU measurements, taking the IMU position, target variable and computational approach into account [39]. Our method, error compensation against waking modes, is generally applicable to those algorithms for improving positioning accuracy.
This paper only tested the four methods under situation of walking on a flat ground. As a next step, we will also carry out experiments on human–object hybrid recognition [40] for indoor staircase scenes, corridor scenes, slope scenes, door scenes, etc. When the amount of data for various walking modes is large enough, we will use machine learning and deep learning algorithms to achieve end-to-end automated walking mode recognition and position compensation systems.
When using IMU and pressure insoles for tracking and positioning, there are several limitations that affect the accuracy limit:
  • Fixed bias and motion shift of sensors: the solution to this is to fix the module tightly to the skeletal position of the body limbs and avoid fixing it to unstable muscle parts.
  • Interference of magnetic field disturbance to IMU: it is suggested to avoid using this method in areas with strong magnetic fields and to keep it away from magnetic fields in the process of preservation.
  • Partial bending of insoles: the solution to this is to use the fourth method to support the process of phase.
  • Sliding of insoles in shoes; tying the shoelace tightly may be better.
The first two factors affect all four methods, while the latter two factors are only related to Method III and IV. That is to say, the method we propose is related to all four factors. These errors can be minimized as much as possible, though they cannot be completely eliminated, by improving the experimental design, equipment, environment, etc.
The high-precision wearable positioning method can break through the limitations of indoor positioning that only relies on the single technology of RF, can be used in a scene without an RF layout and with a low RF signal and does not require higher positioning accuracy. The method in this paper improves the real-time positioning accuracy of wearable systems, which has a positive significance for related fields, such as gait analysis, wearable device applications, etc. Compared with the external positioning reference systems, wearable active positioning solution can rely on its own actual position and dynamic real-time offset to achieve real-time positioning. It will provide positioning support to rescue operations, in scenarios where external infrastructure is damaged, due to fires, earthquakes, etc.
In this paper, a positioning method based on IMU and pressure insole for path tracing was improved. We collected real-time data of whole-body movement and plantar pressure distribution. After repeated experiments and statistical analysis, the results show that this method has a higher accuracy than the previous three methods. Our system, implemented based on the improved method, can achieve real-time (within 20 ms) and high-precision (within a 0.05 mm standard deviation) indoor positioning and path tracing. This study has certain practical significance.

Author Contributions

Conceptualization, J.G. and Z.L.; methodology, J.G. and Z.L.; software, J.G. and D.H.; validation, J.G. and Z.L.; formal analysis, J.G. and Z.L.; investigation, J.G., Z.L. and D.H.; data curation, Z.L. and D.H.; writing—original draft preparation, J.G. and Z.L.; writing—review and editing, Z.L.; supervision, M.C. and H.W.; project administration, M.C. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Key R & D Program of China, grant number 2021YFF0306405.

Institutional Review Board Statement

This study was carried out in accordance with the Declaration of Helsinki (2013) of the World Medical Association and protocols and was approved by the Institutional Review Committee of Northeastern University.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data that support the findings of this study are available from the first author, [[email protected]], upon reasonable request.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
MEMSMicro-Electro-Mechanical System
ZUPTZero-Velocity Update
MCUMicrocontroller Unit
IMUInertial Measuring Unit
UDPUser Datagram Protocol
WSNWireless sensor networks
3DThree-dimension
PCPersonal Computer
ADAnalog to digital

References

  1. Soni, R.; Trapasiya, S. A survey of step length estimation models based on inertial sensors for indoor navigation systems. Int. J. Commun. Syst. 2021, 45, e5053. [Google Scholar] [CrossRef]
  2. Rusli, M.E.; Ali, M.; Jamil, N.; Din, M.M. An Improved Indoor Positioning Algorithm Based on RSSI-Trilateration technique for Internet of Things (IOT). In Proceedings of the 6th International Conference on Computer and Communication Engineering (ICCCE 2016), Kuala Lumpur, Malaysia, 25–27 July 2016; pp. 72–77. [Google Scholar]
  3. Hou, Z.G.; Li, F.; Yao, Y. An Improved indoor UHF RFID localization method based on deviation correction. In Proceedings of the 4th International Conference on Information Science and Control Engineering (Icisce), Changsha, China, 21–23 July 2017; pp. 1401–1404. [Google Scholar]
  4. Kawahara, Y.; Hosaka, H.; Sakata, K. Positioning System Using PHS and A Radio Beacon for Logistics. In Proceedings of the IEEE International Conference on Automation and Logistics, Qingdao, China, 1–3 September 2008; pp. 92–95. [Google Scholar]
  5. Obeidat, H.; Shuaieb, W.; Obeidat, O.; Abd-Alhameed, R.J.W.P.C. A Review of Indoor Localization Techniques and Wireless Technologies. Wirel. Pers. Commun. 2021, 119, 289–327. [Google Scholar] [CrossRef]
  6. Zhu, J.; Xu, H. Review of RFID-Based Indoor Positioning Technology. In Proceedings of the 12th International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing (IMIS), Matsue, Japan, 4–6 July 2018; pp. 632–641. [Google Scholar]
  7. Levine, J. Time and frequency distribution using satellites. Rep. Prog. Phys. 2002, 65, 1119. [Google Scholar] [CrossRef]
  8. Vepa, R.; Zhahir, A. High-Precision Kinematic Satellite and Doppler Aided Inertial Navigation System. J. Navig. 2011, 64, 91–108. [Google Scholar] [CrossRef]
  9. Hakansson, M.; Jensen, A.B.O.; Horemuz, M.; Hedling, G. Review of code and phase biases in multi-GNSS positioning. Gps Solut. 2017, 21, 849–860. [Google Scholar] [CrossRef] [Green Version]
  10. Brena, R.F.; Garcia-Vazquez, J.P.; Galvan-Tejada, C.E.; Munoz-Rodriguez, D.; Vargas-Rosales, C.; Fangmeyer, J. TI Evolution of Indoor Positioning Technologies: A Survey. J. Sens. 2017, 2017, 2630413. [Google Scholar] [CrossRef]
  11. Fitzgerald, A.M.; White, C.D.; Chung, C.C. MEMS Product Development: From Concept to Commercialization, 1st ed.; Springer: Cham, Switzerland, 2021; pp. 3–29. [Google Scholar]
  12. Yang, G.; Virk, G.S.; Yang, H. Wearable Sensors and Robots: Proceedings of International Conference on Wearable Sensors and Robots 2015; Zhejiang University Press: Hangzhou, China, 2015; pp. 3–301. [Google Scholar]
  13. Wei, Y.; Wu, Y.; Wang, L.; Zhu, X. Research and Application of Locating Factors Based on iBeacon Technology. In Proceedings of the 14th International Conference on Wireless Communications, Networking and Mobile Computing (WiCOM), Kunming, China, 18–20 September 2018; pp. 44–57.
  14. Liu, F.; Liu, J.; Yin, Y.; Wang, W.; Hu, D.; Chen, P. A Survey on WiFi-Based Indoor Positioning Technologies. IET Commun. 2020, 14, 1372–1383. [Google Scholar] [CrossRef]
  15. Alarifi, A.; Al-Salman, A.; Alsaleh, M.; Alnafessah, A.; Al-Hadhrami, S.; Al-Ammar, M.A.; Al-Khalifa, H.S.J.S. Ultra wideband indoor positioning technologies: Analysis and recent advances. Sensors 2016, 16, 707. [Google Scholar] [CrossRef] [Green Version]
  16. Li, M.Y.; Mourikis, A.I. High-precision, consistent EKF-based visual-inertial odometry. Int. J. Robot. Res. 2013, 32, 690–711. [Google Scholar] [CrossRef]
  17. Zhang, X.Y.; Lin, Z.L.; Zhang, C.X. A highly accurate positioning and orientation system based on the usage of four-cluster fibre optic gyros. In Proceedings of the Conference on AOPC—Optoelectronics and Nanophotonics, Beijing, China, 20–22 June 2021. [Google Scholar]
  18. Zhou, X.; Yang, G.L.; Cai, Q.Z.; Wang, J. A Novel Gravity Compensation Method for High Precision Free-INS Based on “Extreme Learning Machine”. Sensors 2017, 16, 2019. [Google Scholar] [CrossRef] [Green Version]
  19. Zhao, X.X.; Chen, G.; Liu, H.; Wang, L. A Multivariate Temperature Drift Modeling and Compensation Method for Large-Diameter High-Precision Fiber Optic Gyroscopes. IEEE Trans. Instrum. Meas. 2022, 71, 8502912. [Google Scholar] [CrossRef]
  20. Welker, T.C.; Pachter, M.; Huffman, R.E. Gravity Gradiometer Integrated Inertial Navigation. In Proceedings of the EUROPEAN CONTROL CONFERENCE (ECC), ETH Zurich, Zurich, Switzerland, 17–19 July 2013. [Google Scholar]
  21. Chang, X.Q.; Ma, T.H. Design of high precision capacitive microaccelerometer. In Proceedings of the 6th International Symposium on Test and Measurement (ISTM), Dalian, China, 1–4 June 2005; pp. 5629–5632. [Google Scholar]
  22. Titterton, D.H.; Weston, J.L. MEMS inertial sensor. In Strapdown Inertial Navigation Technology; The Institution of Engineering and Technology: Stevenage, UK, 2004; pp. 189–218. [Google Scholar]
  23. Filippeschi, A.; Schmitz, N.; Miezal, M.; Bleser, G.; Ruffaldi, E.; Stricker, D.J.S. Survey of motion tracking methods based on inertial sensors: A focus on upper limb human motion. Sensors 2017, 17, 1257. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  24. Bergun, M.; Mensure, A.; Tuncay, C.; Aydin, O.; Cigdem, B. 3D Kinematic Analysis of Overarm Movements for Different Sports. Kinesiology 2009, 41, 105–111. [Google Scholar]
  25. van Schaik, J.E.; Dominici, N. Motion tracking in developmental research: Methods, considerations, and applications. Prog. Brain Res. 2020, 254, 89–111. [Google Scholar]
  26. Zhou, W.; He, J.; He, X.; Yu, H.; Peng, B. Dielectric charging induced drift in micro device reliability—A review. Microelectron. Reliab. 2016, 66, 1–9. [Google Scholar] [CrossRef]
  27. Popescu, M.; Mronga, D.; Bergonzani, I.; Kumar, S.; Kirchner, F. Experimental Investigations into Using Motion Capture State Feedback for Real-Time Control of a Humanoid Robot. Sensors 2022, 22, 9853. [Google Scholar] [CrossRef]
  28. Du, J.; Gerdtman, C.; Lindén, M. Signal quality improvement algorithms for MEMS gyroscope-based human motion analysis systems: A systematic review. Sensors 2018, 18, 1123. [Google Scholar] [CrossRef] [Green Version]
  29. Han, S.; Meng, Z.; Omisore, O.; Akinyemi, T.; Yan, Y. Random Error Reduction Algorithms for MEMS Inertial Sensor Accuracy Improvement—A Review. Micromachines 2020, 11, 1021. [Google Scholar] [CrossRef]
  30. Kim, S. Method for Maintaining Initial Azimuth of Tactical Grade IMU by Using Zero Velocity Update Algorithm. J. Electr. Soc. Pap. 2019, 11, 122–128. [Google Scholar]
  31. Yang, M.K.; Zhu, R.; Xiao, Z.L.; Yan, B. Symmetrical-Net: Adaptive Zero Velocity Detection for ZUPT-Aided Pedestrian Navigation System. IEEE Sens. J. 2022, 22, 5075–5085. [Google Scholar] [CrossRef]
  32. Gait-Tracking-With-x-IMU, xioTechnologies. Available online: https://github.com/xioTechnologies/Gait-Tracking-With-x-IMU/ (accessed on 7 February 2022).
  33. Uzunhisarckl, E.; Etinkaya, M.B.; Fidan, U.; Alkuu, S. Technology, Investigation of EMG Signals in Lower Extremity Muscle Groups During Robotic Gait Exercises. Eur. J. Sci. Technol. 2019, 109–118. [Google Scholar] [CrossRef]
  34. Prasanth, H.; Caban, M.; Keller, U.; Courtine, G.; Ijspeert, A.; Vallery, H.; Von Zitzewitz, J. Wearable sensor-based real-time gait detection: A systematic review. Sensors 2021, 21, 2727. [Google Scholar] [CrossRef]
  35. Liang, Q.L.; Durrani, T.S.; Pi, Y.M.; Samn, S.W. Hybrid Wireless Sensor Networks: Theory and Design. Int. J. Distrib. Sens. Netw. 2016, 12. [Google Scholar] [CrossRef] [Green Version]
  36. Xiang, Y.; Arora, J.S.; Abdel-Malek, K. Physics-based modeling and simulation of human walking: A review of optimization-based and other approaches. Struct. Multidisc. Optim. 2010, 42, 1–23. [Google Scholar] [CrossRef]
  37. John, J.C. Kinematics of manipulator. In Introduction to Robotics: Mechanics and Control, 3rd ed.; Pearson Education, Inc.: London, UK, 2005; pp. 66–78. [Google Scholar]
  38. Dobaczewski, J.; Nazarewicz, W.; Reinhard, P.G. Error estimates of theoretical models: A guide. J. Phys. G Nucl. Part. Phys. 2014, 41, 074001. [Google Scholar] [CrossRef] [Green Version]
  39. Giulia, P.P.; Maria, C.B.; Rita, S.; Silvia, F. Analysis of the performance of 17 algorithms from a systematic review: Influence of sensor position, analysed variable and computational approach in gait timing estimation from IMU measurements. Gait Posture 2018, 66, 76–82. [Google Scholar]
  40. Kuni, R.; Prathivadi, Y.; Wu, J.; Bennett, T.R.; Jafari, R. Exploration of Interactions Detectable by Wearable IMU Sensors. In Proceedings of the IEEE 12th International Conference on Wearable and Implantable Body Sensor Networks (BSN), Cambridge, MA, USA, 2–12 June 2015. [Google Scholar]
Figure 1. Acceleration and stationary during walking.
Figure 1. Acceleration and stationary during walking.
Sensors 23 05417 g001
Figure 2. The phases of a gait cycle.
Figure 2. The phases of a gait cycle.
Sensors 23 05417 g002
Figure 3. The architecture of the WSN system and the framework of this paper.
Figure 3. The architecture of the WSN system and the framework of this paper.
Sensors 23 05417 g003
Figure 4. Structure of the IMU and its coordinate system.
Figure 4. Structure of the IMU and its coordinate system.
Sensors 23 05417 g004
Figure 5. Structure of shoes and insoles for experiments. (a) Shoes; (b) Pressure insole; (c) Arduino MCU.
Figure 5. Structure of shoes and insoles for experiments. (a) Shoes; (b) Pressure insole; (c) Arduino MCU.
Sensors 23 05417 g005
Figure 6. Insoles’ pressure numerical calibration. (a) Pressure calibration; (b) Fitted pressure curve.
Figure 6. Insoles’ pressure numerical calibration. (a) Pressure calibration; (b) Fitted pressure curve.
Sensors 23 05417 g006
Figure 7. Principal error analysis of the algorithm.
Figure 7. Principal error analysis of the algorithm.
Sensors 23 05417 g007
Figure 8. Link-frame assignment of the whole body. The first three pictures axes of IMUs at their positions, while the last two pictures are the simplified joint coordinate system.
Figure 8. Link-frame assignment of the whole body. The first three pictures axes of IMUs at their positions, while the last two pictures are the simplified joint coordinate system.
Sensors 23 05417 g008
Figure 9. Possible relative positions of a foot in a shoe during walking.
Figure 9. Possible relative positions of a foot in a shoe during walking.
Sensors 23 05417 g009
Figure 10. Plantar pressure (2 × 99 points) analysis during walking. Steps 1–9 represent the plantar pressure distribution during a gait cycle. Button abbreviation: P(Pause), S(Stop), FW(Forward), BW(Backward), REC(Record), DISP(Display).
Figure 10. Plantar pressure (2 × 99 points) analysis during walking. Steps 1–9 represent the plantar pressure distribution during a gait cycle. Button abbreviation: P(Pause), S(Stop), FW(Forward), BW(Backward), REC(Record), DISP(Display).
Sensors 23 05417 g010
Figure 11. Five walking modes for error compensation. 1. Left turn with r = 4 m; 2. Left turn with r = 2 m; 3. Go straight; 4. Right turn with r = 2 m; 5. Right turn with r = 4 m. The black dots represent the straight line gait.
Figure 11. Five walking modes for error compensation. 1. Left turn with r = 4 m; 2. Left turn with r = 2 m; 3. Go straight; 4. Right turn with r = 2 m; 5. Right turn with r = 4 m. The black dots represent the straight line gait.
Sensors 23 05417 g011
Figure 12. Flow of the touchdown position calculation with compensation.
Figure 12. Flow of the touchdown position calculation with compensation.
Sensors 23 05417 g012
Figure 13. Coordinate position of the pressure insoles and possible position of max force point under when standing still (Red: high pressure; Blue: low pressure; white: no pressure). The number 1–99 represent the position of each sensor in a insole.
Figure 13. Coordinate position of the pressure insoles and possible position of max force point under when standing still (Red: high pressure; Blue: low pressure; white: no pressure). The number 1–99 represent the position of each sensor in a insole.
Sensors 23 05417 g013
Figure 14. Data collection and path tracking in the walking experiments. (a) Walking experiments; (b) Real-time positioning and track record.
Figure 14. Data collection and path tracking in the walking experiments. (a) Walking experiments; (b) Real-time positioning and track record.
Sensors 23 05417 g014
Figure 15. (a) Absolute positions of the four methods; (b) The net deviations of all points.
Figure 15. (a) Absolute positions of the four methods; (b) The net deviations of all points.
Sensors 23 05417 g015
Figure 16. Comparison of the position bias by four methods in the X, Y direction.
Figure 16. Comparison of the position bias by four methods in the X, Y direction.
Sensors 23 05417 g016
Table 1. Compensation values.
Table 1. Compensation values.
ε P /mmLeft FootRight Foot
DirectionLeft TurnForwardRight TurnLeft TurnForwardRight Turn
Axisxyxyxyxyxyxy
Going straight0.340.55−0.230.62
Turning r = 4 m0.190.27−0.94−0.520.97−0.48−0.160.24
Turning r = 2 m0.350.97−1.28−1.731.25−1.8−0.341.02
Table 2. Walking modes’ discriminant criteria.
Table 2. Walking modes’ discriminant criteria.
Trigger ConditionStanding StillGoing StraightTuring r = 4 mTuring r = 2 m
Left
Foot
Turn Left F L P R 1 > t h F L P R 2 > t h
Turn Right ( F L P L 2 | F L P L 3 ) > t h F L P L 1 > t h
BothForward S t e p < L w (15 cm) &
( Σ F L P R i + Σ F R P R i )
> 0.7 B W
S t e p > L w (15 cm) &
(No others trigger) &
( F L P F 1 + F R P F 1
F L P F 2 F R P F 2 ) > t h
Right
Foot
Turn Left ( F R P L 2 | F R P L 3 ) > t h F R P L 1 > t h
Turn Right F R P R 1 > t h F R P R 2 > t h
Table 3. The information of the subjects.
Table 3. The information of the subjects.
GenderHeight/cmWeight/kgShoe Size/mm
1female17263245
2male16852.5255
3female16050235
4male18381270
Table 4. Mean, median, standard deviation and variance of the four methods at the four points.
Table 4. Mean, median, standard deviation and variance of the four methods at the four points.
Point No. &
Method No.
Mean ValueMedianStandard DeviationVariance
X/mmY/mmX/mmY/mmX/mmY/mmX/mm 2 Y/mm 2
AI0.1556−0.11410.1569−0.11340.02980.02250.00090.0005
II−0.0267−0.1606−0.0286−0.15790.01540.03220.00020.001
III0.0073−0.17330.009−0.17170.01490.03730.00020.0014
IV−0.0063−0.0289−0.008−0.02890.01520.01620.00020.0003
BI0.12260.08650.12470.08720.03170.02830.0010.0008
II0.0680.0340.07090.0290.02340.02120.00050.0004
III0.08440.04610.08240.04520.02550.02020.00070.0004
IV0.017−0.02080.0152−0.02040.02020.01980.00040.0004
CI0.04780.22990.04830.22070.02870.0390.00080.0015
II0.00710.0430.00770.03790.02590.03330.00070.0011
III0.02590.17080.02730.17040.02860.04150.00080.0017
IV0.00290.0150.00070.02170.02830.03090.00080.001
DI0.01030.11450.00480.11320.02160.0310.00050.001
II−0.01970.0274−0.01660.02860.02030.0190.00040.0004
III−0.01810.0846−0.01780.08250.01770.02470.00030.0006
IV−0.00440.01−0.00070.00750.01760.01780.00030.0003
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Gong, J.; Li, Z.; Chen, M.; Wang, H.; Hu, D. Improving Accuracy of Real-Time Positioning and Path Tracking by Using an Error Compensation Algorithm against Walking Modes. Sensors 2023, 23, 5417. https://doi.org/10.3390/s23125417

AMA Style

Gong J, Li Z, Chen M, Wang H, Hu D. Improving Accuracy of Real-Time Positioning and Path Tracking by Using an Error Compensation Algorithm against Walking Modes. Sensors. 2023; 23(12):5417. https://doi.org/10.3390/s23125417

Chicago/Turabian Style

Gong, Jiale, Ziyang Li, Mingzhu Chen, Hong Wang, and Dongmo Hu. 2023. "Improving Accuracy of Real-Time Positioning and Path Tracking by Using an Error Compensation Algorithm against Walking Modes" Sensors 23, no. 12: 5417. https://doi.org/10.3390/s23125417

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop