Dawei Yan
Weiwei Jiang
Skip Abstract Section
Abstract
WiFi has gradually developed into one of the main candidate technologies for indoor environment sensing. In this paper, we are interested in using COTS WiFi devices to identify material details, including location, material type, and shape, of stationary objects in the surrounding environment, which may open up new opportunities for many applications. Specifically, we present Wi-Painter, a model-driven system that can accurately detects smooth-surfaced material types and their edges using COTS WiFi devices without modification. Different from previous arts for material identification, Wi-Painter subdivides the target into individual 2D pixels, and simultaneously forms a 2D image based on identifying the material type of each pixel. The key idea of Wi-Painter is to exploit the complex permittivity of the object surface which can be estimated by the different reflectivity of signals with different polarization directions. In particular, we construct the multi-incident angle model to characterize the material, using only the power ratios of the vertically and horizontally polarized signals measured at several different incident angles, which avoids the use of inaccurate WiFi signal phases. We implement and evaluate Wi-Painter in the real world, showing an average classification accuracy of 93.4% for different material types including metal, wood, rubber and plastic of different sizes and thicknesses, and across different environments. In addition, Wi-Painter can accurately detect the material type and edge of the word "LOVE" spliced with different materials, with an average size of 60cm × 80cm, and material edges with different orientations.
- Kamran Ali, Alex X Liu, Wei Wang, and Muhammad Shahzad. 2015. Keystroke recognition using wifi signals. In Proceedings of the 21st annual international conference on mobile computing and networking. 90--102.Google Scholar
Digital Library
- RMA Azzam. 1986. Relationship between the p and s Fresnel reflection coefficients of an interface independent of angle of incidence. JOSA A 3, 7 (1986), 928--929.Google ScholarCross Ref
- HE Bennett and JO119764 Porteus. 1961. Relation between surface roughness and specular reflectance at normal incidence. JOSA 51, 2 (1961), 123--129.Google ScholarCross Ref
- Alejandro Blanco, Pablo Jiménez Mateo, Francesco Gringoli, and Joerg Widmer. 2022. Augmenting mmWave localization accuracy through sub-6 GHz on off-the-shelf devices. In MobiSys'22. 477--490.Google Scholar
- Max Born and Emil Wolf. 2013. Principles of optics: electromagnetic theory of propagation, interference and diffraction of light. Elsevier.Google Scholar
- Shane R Cloude and Konstantinos P Papathanassiou. 1998. Polarimetric SAR interferometry. IEEE Transactions on geoscience and remote sensing 36, 5 (1998), 1551--1565.Google ScholarCross Ref
- Shane R Cloude and Eric Pottier. 1996. A review of target decomposition theorems in radar polarimetry. IEEE transactions on geoscience and remote sensing 34, 2 (1996), 498--518.Google ScholarCross Ref
- Ian G Cumming and Frank H Wong. 2005. Digital processing of synthetic aperture radar data. Artech house 1, 3 (2005), 108--110.Google Scholar
- Ashutosh Dhekne, Mahanth Gowda, Yixuan Zhao, Haitham Hassanieh, and Romit Roy Choudhury. 2018. Liquid: A wireless liquid identifier. In Proceedings of the 16th annual international conference on mobile systems, applications, and services. 442--454.Google ScholarDigital Library
- Jian Ding and Ranveer Chandra. 2019. Towards low cost soil sensing using Wi-Fi. In The 25th Annual International Conference on Mobile Computing and Networking. 1--16.Google Scholar
- Anthony P. Doulgeris, Stian Normann Anfinsen, and Torbjørn Eltoft. 2008. Classification With a Non-Gaussian Model for PolSAR Data. IEEE Transactions on Geoscience and Remote Sensing 46, 10 (2008), 2999--3009. https://doi.org/10.1109/TGRS.2008.923025Google ScholarCross Ref
- GA Emmons and PM Alexander. 1983. Polarization scattering matrices for polarimetric radar. Technical Report. ARMY MISSILE COMMAND REDSTONE ARSENAL AL ADVANCED SENSORS DIRECTORATE.Google Scholar
- Chao Feng, Jie Xiong, Liqiong Chang, Ju Wang, Xiaojiang Chen, Dingyi Fang, and Zhanyong Tang. 2019. Wimi: Target material identification with commodity wi-fi devices. In 2019 IEEE 39th International Conference on Distributed Computing Systems (ICDCS). IEEE, 700--710.Google ScholarCross Ref
- Alejandro C Frery, Renato J Cintra, and Abraao DC Nascimento. 2012. Entropy-based statistical analysis of PolSAR data. IEEE Transactions on Geoscience and Remote Sensing 51, 6 (2012), 3733--3743.Google ScholarCross Ref
- Mohamed A Gacem, Amer S Zakaria, Mahmoud H Ismail, Usman Tariq, and Sherif Yehia. 2022. Measurement of Construction Materials Properties Using Wi-Fi and Convolutional Neural Networks. IEEE Access 10 (2022), 126100--126116.Google ScholarCross Ref
- David J Griffiths. 2005. Introduction to electrodynamics.Google Scholar
- Unsoo Ha, Junshan Leng, Alaa Khaddaj, and Fadel Adib. 2020. Food and liquid sensing in practical environments using rfids. In Proceedings of the 17th USENIX Symposium on Networked Systems Design and Implementation (NSDI'20).Google Scholar
- Irena Hajnsek, Thomas Jagdhuber, Helmut Schon, and Konstantinos Panagiotis Papathanassiou. 2009. Potential of Estimating Soil Moisture Under Vegetation Cover by Means of PolSAR. IEEE Transactions on Geoscience and Remote Sensing 47, 2 (2009), 442--454. https://doi.org/10.1109/TGRS.2008.2009642Google ScholarCross Ref
- Irena Hajnsek, Eric Pottier, and Shane R Cloude. 2003. Inversion of surface parameters from polarimetric SAR. IEEE Transactions on Geoscience and Remote Sensing 41, 4 (2003), 727--744.Google ScholarCross Ref
- Donny Huang, Rajalakshmi Nandakumar, and Shyamnath Gollakota. 2014. Feasibility and limits of wi-fi imaging. In Proceedings of the 12th ACM conference on embedded network sensor systems. 266--279.Google ScholarDigital Library
- Yongzhi Huang, Kaixin Chen, Yandao Huang, Lu Wang, and Kaishun Wu. 2021. Vi-liquid: unknown liquid identification with your smartphone vibration. In Proceedings of the 27th Annual International Conference on Mobile Computing and Networking. 174--187.Google ScholarDigital Library
- John David Jackson. 1999. Classical electrodynamics.Google Scholar
- Wenjun Jiang, Hongfei Xue, Chenglin Miao, Shiyang Wang, Sen Lin, Chong Tian, Srinivasan Murali, Haochen Hu, Zhi Sun, and Lu Su. 2020. Towards 3D human pose construction using WiFi. In Proceedings of the 26th Annual International Conference on Mobile Computing and Networking. 1--14.Google ScholarDigital Library
- Usman Mahmood Khan and Muhammad Shahzad. 2022. Estimating soil moisture using RF signals. In Proceedings of the 28th Annual International Conference on Mobile Computing And Networking. 242--254.Google ScholarDigital Library
- Manikanta Kotaru, Kiran Joshi, Dinesh Bharadia, and Sachin Katti. 2015. SpotFi: Decimeter Level Localization Using WiFi. SIGCOMM Comput. Commun. Rev. 45, 4 (aug 2015), 269--282. https://doi.org/10.1145/2829988.2787487Google ScholarDigital Library
- Dieter Landolt. 2007. Corrosion and surface chemistry of metals. CRC press.Google Scholar
- Jong-Sen Lee, Mitchell R Grunes, Thomas L Ainsworth, Li-Jen Du, Dale L Schuler, and Shane R Cloude. 1999. Unsupervised classification using polarimetric decomposition and the complex Wishart classifier. IEEE Transactions on Geoscience and Remote Sensing 37, 5 (1999), 2249--2258.Google ScholarCross Ref
- Jong-Sen Lee, Mitchell R Grunes, and R Kwok. 1994. Classification of multi-look polarimetric SAR imagery based on complex Wishart distribution. International Journal of Remote Sensing 15, 11 (1994), 2299--2311.Google ScholarCross Ref
- Jong-Sen Lee and Eric Pottier. 2017. Polarimetric radar imaging: from basics to applications. CRC press.Google Scholar
- Chao Li, Fan Li, Wei Du, Lihua Yin, Bin Wang, Chonghua Wang, and Tianjie Luo. 2021. A Material Identification Approach Based on Wi-Fi Signal. Computers, Materials & Continua 69, 3 (2021).Google Scholar
- Chenning Li, Zheng Liu, Yuguang Yao, Zhichao Cao, Mi Zhang, and Yunhao Liu. 2020. Wi-fi see it all: generative adversarial network-augmented versatile wi-fi imaging. In Proceedings of the 18th Conference on Embedded Networked Sensor Systems. 436--448.Google ScholarDigital Library
- Xiang Li, Daqing Zhang, Qin Lv, Jie Xiong, Shengjie Li, Yue Zhang, and Hong Mei. 2017. IndoTrack: Device-free indoor human tracking with commodity Wi-Fi. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3 (2017), 1--22.Google ScholarDigital Library
- Jian Liu, Yan Wang, Yingying Chen, Jie Yang, Xu Chen, and Jerry Cheng. 2015. Tracking vital signs during sleep leveraging off-the-shelf wifi. In Proceedings of the 16th ACM international symposium on mobile ad hoc networking and computing. 267--276.Google ScholarDigital Library
- Xuefeng Liu, Jiannong Cao, Shaojie Tang, Jiaqi Wen, and Peng Guo. 2015. Contactless respiration monitoring via off-the-shelf WiFi devices. IEEE Transactions on Mobile Computing 15, 10 (2015), 2466--2479.Google ScholarDigital Library
- AI Logvin. 2007. Mathematical and physical modelling of microwave scattering and polarimetric remote sensing: monitoring the Earth's environment using polarimetric radar: formulation and potential applications. Vol. 3. Springer Science & Business Media.Google Scholar
- Junqi Ma, Zhaoxin Chang, Fusang Zhang, Jie Xiong, Beihong Jin, and Daqing Zhang. 2022. Mobi2Sense: enabling wireless sensing under device motions. In Proceedings of the 28th Annual International Conference on Mobile Computing And Networking. 766--768.Google Scholar
- Marko Malajner, Dušan Gleich, and Peter Planinšič. 2019. Material Identification Using UWB. In 2019 14th International Conference on Advanced Technologies, Systems and Services in Telecommunications (TELSIKS). 232--234. https://doi.org/10.1109/TELSIKS46999.2019.9002328Google ScholarCross Ref
- Kazuo Ouchi. 2013. Recent trend and advance of synthetic aperture radar with selected topics. Remote Sensing 5, 2 (2013), 716--807.Google ScholarCross Ref
- Anurag Pallaprolu, Belal Korany, and Yasamin Mostofi. 2022. Wiffract: a new foundation for RF imaging via edge tracing. In MobiCom'22. 255--267.Google Scholar
- David M Pozar. 2011. Microwave engineering. John wiley & sons.Google Scholar
- Paul C Proffitt and Honggang Wang. 2018. Static object Wi-Fi imaging and classifier. In 2018 IEEE International Symposium on Technologies for Homeland Security (HST). IEEE, 1--7.Google ScholarCross Ref
- Kun Qian, Chenshu Wu, Yi Zhang, Guidong Zhang, Zheng Yang, and Yunhao Liu. 2018. Widar2. 0: Passive human tracking with a single Wi-Fi link. In Proceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services. 350--361.Google ScholarDigital Library
- Yili Ren, Sheng Tan, Linghan Zhang, Zi Wang, Zhi Wang, and Jie Yang. 2020. Liquid level sensing using commodity wifi in a smart home environment. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 1 (2020), 1--30.Google ScholarDigital Library
- Fei Shang, Panlong Yang, Yubo Yan, and Xiang-Yang Li. 2022. LiqRay: non-invasive and fine-grained liquid recognition system. In Proceedings of the 28th Annual International Conference on Mobile Computing And Networking. 296--309.Google ScholarDigital Library
- Fei Shang, Panlong Yang, Yubo Yan, and Xiang-Yang Li. 2023. PackquID: In-packet Liquid Identification Using RF Signals. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 4 (2023), 1--27.Google ScholarDigital Library
- Cong Shi, Tianming Zhao, Yucheng Xie, Tianfang Zhang, Yan Wang, Xiaonan Guo, and Yingying Chen. 2021. Environment-independent In-baggage Object Identification Using WiFi Signals. In 2021 IEEE 18th International Conference on Mobile Ad Hoc and Smart Systems (MASS). 71--79. https://doi.org/10.1109/MASS52906.2021.00018Google ScholarCross Ref
- Wagner B Silva, Corina C Freitas, Sidnei JS Sant'Anna, and Alejandro C Frery. 2013. Classification of segments in PolSAR imagery by minimum stochastic distances between Wishart distributions. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 6, 3 (2013), 1263--1273.Google ScholarCross Ref
- Frank Stern and Charles Weaver. 1970. Dispersion of dielectric permittivity due to space-charge polarization. Journal of Physics C: Solid State Physics 3 (1970), 1736--1746.Google ScholarCross Ref
- Chen Wang, Jian Liu, Yingying Chen, Hongbo Liu, and Yan Wang. 2018. Towards in-baggage suspicious object detection using commodity wifi. In 2018 IEEE Conference on Communications and Network Security (CNS). IEEE, 1--9.Google ScholarCross Ref
- Hao Wang, Daqing Zhang, Junyi Ma, Yasha Wang, Yuxiang Wang, Dan Wu, Tao Gu, and Bing Xie. 2016. Human respiration detection with commodity WiFi devices: Do user location and body orientation matter?. In Proceedings of the 2016 ACM international joint conference on pervasive and ubiquitous computing. 25--36.Google ScholarDigital Library
- Ju Wang, Jie Xiong, Xiaojiang Chen, Hongbo Jiang, Rajesh Krishna Balan, and Dingyi Fang. 2017. TagScan: Simultaneous target imaging and material identification with commodity RFID devices. In Proceedings of the 23rd Annual International Conference on Mobile Computing and Networking. 288--300.Google ScholarDigital Library
- Wei-Chih Wang. 1986. Electromagnetic wave theory. Google Scholar (1986).Google Scholar
- Yichao Wang, Yili Ren, Yingying Chen, and Jie Yang. 2022. Wi-Mesh: A WiFi Vision-based Approach for 3D Human Mesh Construction. In Proceedings of the 20th ACM Conference on Embedded Networked Sensor Systems. 362--376.Google ScholarDigital Library
- L.B. Wolff. 1990. Polarization-based material classification from specular reflection. IEEE Transactions on Pattern Analysis and Machine Intelligence 12, 11 (1990), 1059--1071. https://doi.org/10.1109/34.61705Google ScholarDigital Library
- Chenshu Wu, Feng Zhang, Beibei Wang, and KJ Ray Liu. 2020. msense: Towards mobile material sensing with a single millimeter-wave radio. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 3 (2020), 1--20.Google ScholarDigital Library
- Kaishun Wu. 2016. Wi-metal: Detecting metal by using wireless networks. In 2016 IEEE International Conference on Communications (ICC). IEEE, 1--6.Google ScholarCross Ref
- Binbin Xie, Jie Xiong, Xiaojiang Chen, Eugene Chai, Liyao Li, Zhanyong Tang, and Dingyi Fang. 2019. Tagtag: material sensing with commodity RFID. In Proceedings of the 17th conference on embedded networked sensor systems. 338--350.Google ScholarDigital Library
- Yaxiong Xie, Zhenjiang Li, and Mo Li. 2015. Precise power delay profiling with commodity WiFi. In Proceedings of the 21st Annual International Conference on Mobile Computing and Networking. 53--64.Google ScholarDigital Library
- Yaxiong Xie, Jie Xiong, Mo Li, and Kyle Jamieson. 2019. mD-Track: Leveraging multi-dimensionality for passive indoor Wi-Fi tracking. In MobiCom'19. 1--16.Google Scholar
- Jie Xiong and Kyle Jamieson. 2013. ArrayTrack: A Fine-Grained Indoor Location System. In 10th USENIX Symposium on Networked Systems Design and Implementation (NSDI 13). USENIX Association, Lombard, IL, 71--84. https://www.usenix.org/conference/nsdi13/technical-sessions/presentation/xiongGoogle Scholar
- Yoshio Yamaguchi, Yuki Yajima, and Hiroyoshi Yamada. 2006. A four-component decomposition of POLSAR images based on the coherency matrix. IEEE Geoscience and Remote Sensing Letters 3, 3 (2006), 292--296.Google ScholarCross Ref
- Dawei Yan, Yubo Yan, Panlong Yang, Wen-Zhan Song, Xiang-Yang Li, and Pengfei Liu. 2022. Real-time Identification of Rogue WiFi Connections in the Wild. IEEE Internet of Things Journal (2022).Google Scholar
- Jianfei Yang, Xinyan Chen, Han Zou, Chris Xiaoxuan Lu, Dazhuo Wang, Sumei Sun, and Lihua Xie. 2023. SenseFi: A library and benchmark on deep-learning-empowered WiFi human sensing. Patterns 4, 3 (2023).Google Scholar
- Hui-Shyong Yeo, Gergely Flamich, Patrick Schrempf, David Harris-Birtill, and Aaron Quigley. 2016. Radarcat: Radar categorization for input & interaction. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. 833--841.Google ScholarDigital Library
- Youwei Zeng, Dan Wu, Jie Xiong, Enze Yi, Ruiyang Gao, and Daqing Zhang. 2019. FarSense: Pushing the range limit of WiFi-based respiration sensing with CSI ratio of two antennas. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 3 (2019), 1--26.Google ScholarDigital Library
- Diana Zhang, Jingxian Wang, Junsu Jang, Junbo Zhang, and Swarun Kumar. 2019. On the feasibility of wi-fi based material sensing. In The 25th Annual International Conference on Mobile Computing and Networking. 1--16.Google ScholarDigital Library
- Shengkai Zhang, Gaoyang Liu, S Wan, et al. 2021. WiImage: Fine-grained Human Imaging from Commodity WiFi. (2021).Google Scholar
- Mingmin Zhao, Shichao Yue, Dina Katabi, Tommi S Jaakkola, and Matt T Bianchi. 2017. Learning sleep stages from radio signals: A conditional adversarial architecture. In International Conference on Machine Learning. PMLR, 4100--4109.Google Scholar
- Yanzi Zhu, Yibo Zhu, Ben Y Zhao, and Haitao Zheng. 2015. Reusing 60ghz radios for mobile radar imaging. In Proceedings of the 21st Annual International Conference on Mobile Computing and Networking. 103--116.Google ScholarDigital Library
- Yang Zi, Wei Xi, Li Zhu, Fan Yu, Kun Zhao, and Zhi Wang. 2019. Wi-Fi imaging based segmentation and recognition of continuous activity. In Collaborative Computing: Networking, Applications and Worksharing: 15th EAI International Conference, CollaborateCom 2019, London, UK, August 19-22, 2019, Proceedings 15. Springer, 623--641.Google Scholar
Index Terms
- Wi-Painter: Fine-grained Material Identification and Image Delineation Using COTS WiFi Devices
Recommendations
LiqRay: non-invasive and fine-grained liquid recognition system
MobiCom '22: Proceedings of the 28th Annual International Conference on Mobile Computing And NetworkingThe existing RF-based liquid identification methods commonly require a training network of liquid or the container information, such as material and width. Moreover, status quo methods are inapplicable when the solution height is lower than that of the ...
TagScan: Simultaneous Target Imaging and Material Identification with Commodity RFID Devices
MobiCom '17: Proceedings of the 23rd Annual International Conference on Mobile Computing and NetworkingTarget imaging and material identification play an important role in many real-life applications. This paper introduces TagScan, a system that can identify the material type and image the horizontal cut of a target simultaneously with cheap commercial ...
PackquID: In-packet Liquid Identification Using RF Signals
There are many scenarios where the liquid is occluded by other items (e.g. books in a packet), in which existing RF-based liquid identification methods are generally not suitable. Moreover, status methods are not applicable when the height of the liquid ...
Comments