Chuyu Wang
Abstract
The rising popularity of electronic devices with gesture recognition capabilities makes the gesture-based human-computer interaction more attractive. Along this direction, tracking the body movement in 3D space is desirable to further facilitate behavior recognition in various scenarios. Existing solutions attempt to track the body movement based on computer version or wearable sensors, but they are either dependent on the light or incurring high energy consumption. This paper presents RF-Kinect, a training-free system which tracks the body movement in 3D space by analyzing the phase information of wearable RFID tags attached on the limb. Instead of locating each tag independently in 3D space to recover the body postures, RF-Kinect treats each limb as a whole, and estimates the corresponding orientations through extracting two types of phase features, Phase Difference between Tags (PDT) on the same part of a limb and Phase Difference between Antennas (PDA) of the same tag. It then reconstructs the body posture based on the determined orientation of limbs grounded on the human body geometric model, and exploits Kalman filter to smooth the body movement results, which is the temporal sequence of the body postures. The real experiments with 5 volunteers show that RF-Kinect achieves 8.7° angle error for determining the orientation of limbs and 4.4cm relative position error for the position estimation of joints compared with Kinect 2.0 testbed.
Supplemental Material
Available for Download
Supplemental movie, appendix, image and software files for, RF-Kinect: A Wearable RFID-based Approach Towards 3D Body Movement Tracking
- 2017. Average human arm length. https://www.reference.com/science/long-average-human-arm-62c7536c5e56f385.. (2017).Google Scholar
- 2017. Cone - Wikipedia. https://en.wikipedia.org/wiki/Cone. (2017).Google Scholar
- 2017. Fitbit. http://www.fitbit.com/. (2017).Google Scholar
- 2017. Gesture Recognition Market-Global Industry Analysis Size Share Growth Trends and Forecast 2016-2024. http://www.transparencymarketresearch.com/gesture-recognition-market.html.. (2017).Google Scholar
- 2017. Leap Motion. https://www.leapmotion.com. (2017).Google Scholar
- 2017. Motion capture systems | Vicon. https://www.vicon.com. (2017).Google Scholar
- 2017. Rigid body - Wikipedia. https://en.wikipedia.org/wiki/RigidBody. (2017).Google Scholar
- 2017. X-box Kinect. http://www.xbox.com. (2017).Google Scholar
- Fadel Adib, Chen-Yu Hsu, Hongzi Mao, Dina Katabi, and Frédo Durand. 2015. Capturing the human figure through a wall. ACM Transactions on Graphics (TOG) 34, 6 (2015), 219. Google ScholarDigital Library
- Fadel Adib, Zachary Kabelac, and Dina Katabi. 2015. Multi-person motion tracking via RF body reflections. In Proc. of USENIX NSDI. Google ScholarDigital Library
- Sena Agezo, Yuxiang Zhang, Ziyu Ye, Somesh Chopra, Shrenik Vora, and Timothy Kurzweg. 2016. Battery-free RFID heart rate monitoring system. In Proc. of IEEE Wireless Health (WH). IEEE.Google ScholarCross Ref
- Jacques Denavit. 1955. A kinematic notation for lower-pair mechanisms based on matrices. Trans. of the ASME. Journal of Applied Mechanics (1955).Google Scholar
- Han Ding, Longfei Shangguan, Zheng Yang, Jinsong Han, Zimu Zhou, Panlong Yang, Wei Xi, and Jizhong Zhao. 2015. Femo: A platform for free-weight exercise monitoring with rfids. In Proc. of ACM SenSys. Google ScholarDigital Library
- M. Hazewinkel. 1987. Encyclopaedia of Mathematics. Springer. https://books.google.com/books?id=WzbzxytdAuUCGoogle Scholar
- Wenjun Hu, Hao Gu, and Qifan Pu. 2013. LightSync: unsynchronized visual communication over screen-camera links. In Proceedings of the 19th annual international conference on Mobile computing 8 networking. ACM, 15--26. Google ScholarDigital Library
- Mostafa Izz, Zhongyuan Li, Hongbo Liu, Yingying Chen, and Feng Li. {n. d.}. Uber-in-Light: Unobtrusive Visible Light Communication Leveraging Complementary Color Channel.Google Scholar
- Bryce Kellogg, Vamsi Talla, and Shyamnath Gollakota. 2014. Bringing gesture recognition to all devices. In Proc. of USENIX NSDI. Google ScholarDigital Library
- Ye-Sheng Kuo, Pat Pannuto, Ko-Jen Hsiao, and Prabal Dutta. 2014. Luxapose: Indoor positioning with mobile phones and visible light. In Proc. of ACM Mobicom. Google ScholarDigital Library
- Oscar D Lara and Miguel A Labrador. 2013. A survey on human activity recognition using wearable sensors. IEEE Communications Surveys 8 Tutorials (2013).Google Scholar
- Tianxing Li, Chuankai An, Zhao Tian, Andrew T Campbell, and Xia Zhou. 2015. Human sensing using visible light communication. In Proc. of ACM MobiCom. Google ScholarDigital Library
- Qiongzheng Lin, Lei Yang, Yuxin Sun, Tianci Liu, Xiang-Yang Li, and Yunhao Liu. 2015. Beyond one-dollar mouse: A battery-free device for 3d human-computer interaction via rfid tags. In Proc. of IEEE INFOCOM.Google ScholarCross Ref
- Chang Liu, Lei Xie, Chuyu Wang, J Wu, and Sanglu Lu. 2016. Track Your Foot Step: Anchor-free Indoor Localization based on Sensing Users' Foot Steps. In Proc. of IEEE MASS.Google ScholarCross Ref
- Abhinav Parate, Meng-Chieh Chiu, Chaniel Chadowitz, Deepak Ganesan, and Evangelos Kalogerakis. 2014. RisQ: recognizing smoking gestures with inertial sensors on a wristband. In Proc. of ACM MobiSys. Google ScholarDigital Library
- Joel C Perry and Jacob Rosen. 2006. Design of a 7 degree-of-freedom upper-limb powered exoskeleton. In Proc. of IEEE BioRob.Google ScholarCross Ref
- Qifan Pu, Sidhant Gupta, Shyamnath Gollakota, and Shwetak Patel. 2013. Whole-home gesture recognition using wireless signals. In Proc. of ACM MobiCom. Google ScholarDigital Library
- Longfei Shangguanand Kyle Jamieson. 2016. The Design and Implementation of a Mobile RFID Tag Sorting Robot. In Proc. of ACM MobiSys. Google ScholarDigital Library
- Longfei Shangguan and Kyle Jamieson. 2016. Leveraging Electromagnetic Polarization in a Two-Antenna Whiteboard in the Air. In Proceedings of the 12th International on Conference on emerging Networking EXperiments and Technologies. ACM, 443--456. Google ScholarDigital Library
- Longfei Shangguan, Zheng Yang, Alex X Liu, Zimu Zhou, and Yunhao Liu. 2015. Relative localization of rfid tags using spatial-temporal phase profiling. In Proc. of USENIX NSDI. Google ScholarDigital Library
- Longfei Shangguan, Zimu Zhou, and Kyle Jamieson. {n. d.}. Enabling Gesture-based Interactions with Objects. In Proc. of ACM Mobisys. Google ScholarDigital Library
- Sheng Shen, He Wang, and Romit Roy Choudhury. 2016. I am a Smartwatch and I can Track my Userąŕs Arm. In Proc. of ACM MobiSys. Google ScholarDigital Library
- Li Sun, Souvik Sen, Dimitrios Koutsonikolas, and Kyu-Han Kim. 2015. Widraw: Enabling hands-free drawing in the air on commodity wifi devices. In Proceedings of the 21st Annual International Conference on Mobile Computing and Networking. ACM, 77--89. Google ScholarDigital Library
- Daniel Vlasic, Rolf Adelsberger, Giovanni Vannucci, John Barnwell, Markus Gross, Wojciech Matusik, and Jovan Popović. 2007. Practical motion capture in everyday surroundings. In ACM transactions on graphics (TOG), Vol. 26. Acm, 35. Google ScholarDigital Library
- He Wang, Ted Tsung-Te Lai, and Romit Roy Choudhury. 2015. MoLe: Motion Leaks Through Smartwatch Sensors. In Proc. of ACM MobiCom. Google ScholarDigital Library
- Jue Wang and Dina Katabi. 2013. Dude, where's my card?: RFID positioning that works with multipath and NOLS. In Proc. of ACM SIGCOMM. Google ScholarDigital Library
- Jue Wang, Deepak Vasisht, and Dina Katabi. 2015. RF-IDraw: virtual touch screen in the air using RF signals. In Proc. of ACM SIGCOMM. Google ScholarDigital Library
- Ju Wang, Jie Xiong, Hongbo Jiang, Xiaojiang Chen, and Dingyi Fang. 2016. D-watch: Embracing" bad" multipaths for device-free localization with COTS RFID devices. (2016), 253--266. Google ScholarDigital Library
- Wei Wang, Alex X Liu, Muhammad Shahzad, Kang Ling, and Sanglu Lu. 2015. Understanding and modeling of wifi signal based human activity recognition. In Proceedings of the 21st Annual International Conference on Mobile Computing and Networking. ACM, 65--76. Google ScholarDigital Library
- Wei Wang, Alex X Liu, and Ke Sun. 2016. Device-free gesture tracking using acoustic signals. In Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking. ACM, 82--94. Google ScholarDigital Library
- Teng Wei and Xinyu Zhang. 2016. Gyro in the air: tracking 3D orientation of batteryless internet-of-things. In Proc. of ACM Mobicom. 55--68. Google ScholarDigital Library
- Chao Xu, Parth H Pathak, and Prasant Mohapatra. 2015. Finger-writing with Smartwatch: A Case for Finger and Hand Gesture Recognition using Smartwatch. In Proceedings of the 16th International Workshop on Mobile Computing Systems and Applications (ACM HotMobile). ACM, 9--14. Google ScholarDigital Library
- Lei Yang, Yekui Chen, Xiang-Yang Li, Chaowei Xiao, Mo Li, and Yunhao Liu. 2014. Tagoram: Real-time tracking of mobile RFID tags to high precision using COTS devices. In Proc. of ACM MobiCom. Google ScholarDigital Library
- Lei Yang, Yao Li, Qiongzheng Lin, Huanyu Jia, Xiang-Yang Li, and Yunhao Liu. 2017. Tagbeat: Sensing Mechanical Vibration Period With COTS RFID Systems. IEEE/ACM Transactions on Networking 25 (2017), 3823--3835. Google ScholarDigital Library
- Lei Yang, Qiongzheng Lin, Xiangyang Li, Tianci Liu, and Yunhao Liu. 2015. See through walls with cots rfid system!. In Proceedings of the 21st Annual International Conference on Mobile Computing and Networking. ACM, 487--499. Google ScholarDigital Library
- Zheng Yang, Chenshu Wu, Zimu Zhou, Xinglin Zhang, Xu Wang, and Yunhao Liu. 2015. Mobility increases localizability: A survey on wireless indoor localization using inertial sensors. ACM Computing Surveys (CSUR) 47, 3 (2015), 54. Google ScholarDigital Library
- Xiaojun Zhu, Qun Li, and Guihai Chen. 2013. APT: Accurate outdoor pedestrian tracking with smartphones. In Proc. of IEEE INFOCOM.Google ScholarCross Ref
Index Terms
- RF-Kinect: A Wearable RFID-based Approach Towards 3D Body Movement Tracking
Recommendations
IMU-Kinect: a motion sensor-based gait monitoring system for intelligent healthcare
UbiComp/ISWC '19 Adjunct: Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable ComputersGait rehabilitation is a common method of postoperative recovery after the user sustains an injury or disability. However, traditional gait rehabilitations are usually performed under the supervision of rehabilitation specialists, meaning the patients ...
An IMU-compensated skeletal tracking system using Kinect for the upper limb
The Kinect device is being increasingly used in conjunction with rehabilitative actions. However, the use of Kinect as a skeletal tracking system requires several further modifications and technological breakthroughs. This study used inertial ...
Predicting muscle forces measurements from kinematics data using kinect in stroke rehabilitation
Muscle strength is mostly measured by wearable devices. However, wearing such devices is a tedious, unpleasant, and sometimes impossible task for stroke patients. In this paper, a mathematical model is proposed to estimate the strength of the upper limb ...
Comments