skip to main content
research-article

Spatial Variability Aware Deep Neural Networks (SVANN): A General Approach

Authors Info & Claims
Published:30 November 2021Publication History
Skip Abstract Section

Abstract

Spatial variability is a prominent feature of various geographic phenomena such as climatic zones, USDA plant hardiness zones, and terrestrial habitat types (e.g., forest, grasslands, wetlands, and deserts). However, current deep learning methods follow a spatial-one-size-fits-all (OSFA) approach to train single deep neural network models that do not account for spatial variability. Quantification of spatial variability can be challenging due to the influence of many geophysical factors. In preliminary work, we proposed a spatial variability aware neural network (SVANN-I, formerly called SVANN) approach where weights are a function of location but the neural network architecture is location independent. In this work, we explore a more flexible SVANN-E approach where neural network architecture varies across geographic locations. In addition, we provide a taxonomy of SVANN types and a physics inspired interpretation model. Experiments with aerial imagery based wetland mapping show that SVANN-I outperforms OSFA and SVANN-E performs the best of all.

REFERENCES

  1. [1] Badrinarayanan Vijay, Kendall Alex, and Cipolla Roberto. 2017. SegNet: A deep convolutional encoder-decoder architecture for image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence 39, 12 (2017), 24812495.Google ScholarGoogle ScholarCross RefCross Ref
  2. [2] Conant Richard T., Smith Gordon R., and Paustian Keith. 2003. Spatial variability of soil carbon in forested and cultivated sites: Implications for change detection. Journal of Environmental Quality 32, 1 (2003), 278286.Google ScholarGoogle Scholar
  3. [3] Cowardin Lewis M.. 1979. Classification of Wetlands and Deepwater Habitats of the United States. Fish and Wildlife Service, U.S. Department of the Interior.Google ScholarGoogle ScholarCross RefCross Ref
  4. [4] Cybenko George. 1989. Approximations by superpositions of a sigmoidal function. Mathematics of Control, Signals and Systems 2 (1989), 183192.Google ScholarGoogle ScholarCross RefCross Ref
  5. [5] England W. L.. 1988. An exponential model used for optimal threshold selection on ROC curves. Medical Decision Making 8, 2 (1988), 120–131.Google ScholarGoogle ScholarCross RefCross Ref
  6. [6] Erickson Bradley J., Korfiatis Panagiotis, Akkus Zeynettin, and Kline Timothy L.. 2017. Machine learning for medical imaging. Radiographics 37, 2 (2017), 505515.Google ScholarGoogle ScholarCross RefCross Ref
  7. [7] Fish U. S. and Service Wildlife. 2020. National Wetlands Inventory: Surface Waters and Wetlands. Department of the Interior, Fish and Wildlife Service, Washington, DC. https://fwsprimary.wim.usgs.gov/wetlands/apps/wetlands-mapper/.Google ScholarGoogle Scholar
  8. [8] Fotheringham A. Stewart, Brunsdon Chris, and Charlton Martin. 2003. Geographically Weighted Regression: The Analysis of Spatially Varying Relationships. John Wiley & Sons.Google ScholarGoogle Scholar
  9. [9] Yoav Freund and Robert E. Schapire. 1996. Experiments with a new boosting algorithm. In Proceedings of the 13th International Conference on Machine Learning (ICML’96). 148156. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. [10] Guo Yanming, Liu Yu, Oerlemans Ard, Lao Songyang, Wu Song, and Lew Michael S.. 2016. Deep learning for visual understanding: A review. Neurocomputing 187 (2016), 2748. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. [11] Gupta Jayant, Xie Yiqun, and Shekhar Shashi. 2020. Towards spatial variability aware deep neural networks (SVANN): A summary of results. In Proceedings of the Workshop on Deep Learning for Spatiotemporal Data, Applications, and Systems (DeepSpatial’20).Google ScholarGoogle Scholar
  12. [12] Heindl Andreas, Nawaz Sidra, and Yuan Yinyin. 2015. Mapping spatial heterogeneity in the tumor microenvironment: A new era for digital pathology. Laboratory Investigation 95, 4 (2015), 377384.Google ScholarGoogle ScholarCross RefCross Ref
  13. [13] Iglovikov Vladimir and Shvets Alexey. 2018. TernausNet: U-Net with VGG11 encoder pre-trained on ImageNet for image segmentation. arXiv preprint arXiv:1801.05746 (2018).Google ScholarGoogle Scholar
  14. [14] Jiang Zhe, Sainju Arpan Man, Li Yan, Shekhar Shashi, and Knight Joseph. 2019. Spatial ensemble learning for heterogeneous geographic data with class ambiguity. ACM Transactions on Intelligent Systems and Technology 10, 4 (2019), 125. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. [15] Keddy Paul A.. 2010. Wetland Ecology: Principles and Conservation. Cambridge University Press.Google ScholarGoogle ScholarCross RefCross Ref
  16. [16] Kemker Ronald, Salvaggio Carl, and Kanan Christopher. 2018. Algorithms for semantic segmentation of multispectral remote sensing imagery using deep learning. ISPRS Journal of Photogrammetry and Remote Sensing 145 (2018), 6077.Google ScholarGoogle ScholarCross RefCross Ref
  17. [17] Kloiber Steven M., Macleod Robb D., Smith Aaron J., Knight Joseph F., and Huberty Brian J.. 2015. A semi-automated, multi-source data fusion update of a wetland inventory for East-Central Minnesota, USA. Wetlands 35, 2 (2015), 335348.Google ScholarGoogle ScholarCross RefCross Ref
  18. [18] Krizhevsky Alex, Sutskever Ilya, and Hinton Geoffrey E.. 2012. ImageNet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems. 10971105. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. [19] Kuncheva Ludmila I. and Whitaker Christopher J.. 2003. Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy. Machine Learning 51, 2 (2003), 181207. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. [20] LeCun Y., Bengio Y., and Hinton G.. 2015. Deep learning. Nature 521, 7553 (2015), 436.Google ScholarGoogle ScholarCross RefCross Ref
  21. [21] Lee S., Park S., Son S., Han J., Kim S., and Kim J.. 2019. Land cover segmentation of aerial imagery using SegNet. In Earth Resources and Environmental Remote Sensing/GIS Applications X, Vol. 11156. International Society for Optics and Photonics, 111561J.Google ScholarGoogle Scholar
  22. [22] Leitner Michael, Glasner Philip, and Kounadi Ourania. 2018. Laws of geography. In Oxford Research Encyclopedia of Criminology and Criminal Justice. Oxford University Press, Oxford, UK. DOI: 10.1093/acrefore/9780190264079.013.325Google ScholarGoogle Scholar
  23. [23] Manning Christopher D., Raghavan Prabhakar, and Schütze Hinrich. 2008. Introduction to Information Retrieval. Cambridge University Press. Google ScholarGoogle ScholarCross RefCross Ref
  24. [24] Miotto Riccardo, Wang Fei, Wang Shuang, Jiang Xiaoqian, and Dudley Joel T.. 2018. Deep learning for healthcare: Review, opportunities and challenges. Briefings in Bioinformatics 19, 6 (2018), 12361246.Google ScholarGoogle ScholarCross RefCross Ref
  25. [25] Nusser Sarah M. and Goebel Jeff J.. 1997. The National Resources Inventory: A long-term multi-resource monitoring programme. Environmental and Ecological Statistics 4, 3 (1997), 181204.Google ScholarGoogle ScholarCross RefCross Ref
  26. [26] Agriculture U.S. Department of. 2012. USDA Plant Hardiness Zone Map. USDA. https://planthardiness.ars.usda.gov/PHZMWeb/.Google ScholarGoogle Scholar
  27. [27] Pan Sinno Jialin and Yang Qiang. 2009. A survey on transfer learning. IEEE Transactions on Knowledge and Data Engineering 22, 10 (2009), 13451359. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. [28] Redmon Joseph and Farhadi Ali. 2017. YOLO9000: Better, faster, stronger. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 72637271.Google ScholarGoogle ScholarCross RefCross Ref
  29. [29] Ronneberger Olaf, Fischer Philipp, and Brox Thomas. 2015. U-Net: Convolutional networks for biomedical image segmentation. In Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention. 234241.Google ScholarGoogle ScholarCross RefCross Ref
  30. [30] Russell Stuart and Norvig Peter. 2002. Artificial Intelligence: A Modern Approach (2nd ed.). Prentice Hall.Google ScholarGoogle Scholar
  31. [31] Scott Grant J., England Matthew R., Starms William A., Marcum Richard A., and Davis Curt H.. 2017. Training deep convolutional neural networks for land–cover classification of high-resolution imagery. IEEE Geoscience and Remote Sensing Letters 14, 4 (2017), 549553.Google ScholarGoogle ScholarCross RefCross Ref
  32. [32] Shekhar Shashi, Gunturi Viswanath, Evans Michael R., and Yang KwangSoo. 2012. Spatial big-data challenges intersecting mobility and cloud computing. In Proceedings of the 11th ACM International Workshop on Data Engineering for Wireless and Mobile Access. 16. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. [33] Silvertown Jonathan. 2009. A new dawn for citizen science. Trends in Ecology & Evolution 24, 9 (2009), 467471.Google ScholarGoogle ScholarCross RefCross Ref
  34. [34] Simonyan Karen and Zisserman Andrew. 2014. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014).Google ScholarGoogle Scholar
  35. [35] Sitterson Jan, Knightes Chris, Parmar Rajbir, Wolfe Kurt, Avant Brian, and Muche Muluken. 2018. An Overview of Rainfall-Runoff Model Types. U.S. Environmental Procection Agency, Washington, DC.Google ScholarGoogle Scholar
  36. [36] Szegedy Christian, Liu Wei, Jia Yangqing, Sermanet Pierre, Reed Scott, Anguelov Dragomir, Erhan Dumitru, Vanhoucke Vincent, and Rabinovich Andrew. 2015. Going deeper with convolutions. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 19.Google ScholarGoogle ScholarCross RefCross Ref
  37. [37] Tiner Jr Ralph W.. 1990. Use of high-altitude aerial photography for inventorying forested wetlands in the United States. Forest Ecology and Management 33, 34 (1990), 593604.Google ScholarGoogle ScholarCross RefCross Ref
  38. [38] Turner Monica G. and Chapin F. Stuart. 2005. Causes and consequences of spatial heterogeneity in ecosystem function. In Ecosystem Function in Heterogeneous Landscapes. Springer, 930.Google ScholarGoogle ScholarCross RefCross Ref
  39. [39] Wagner Clifford H.. 1982. Simpson’s paradox in real life. American Statistician 36, 1 (1982), 4648.Google ScholarGoogle Scholar
  40. [40] Xie Yiqun, Cai Jiannan, Bhojwani Rahul, Shekhar Shashi, and Knight Joseph. 2020. A locally-constrained YOLO framework for detecting small and densely-distributed building footprints. International Journal of Geographical Information Science 34, 4 (2020), 777801.Google ScholarGoogle ScholarCross RefCross Ref
  41. [41] Xie Yiqun, Shekhar Shashi, Feiock Richard, and Knight Joseph. 2019. Revolutionizing tree management via intelligent spatial techniques. In Proceedings of the 27th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems. 7174. Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. [42] Zhu Xiao Xiang, Tuia Devis, Mou Lichao, Xia Gui-Song, Zhang Liangpei, Xu Feng, and Fraundorfer Friedrich. 2017. Deep learning in remote sensing: A comprehensive review and list of resources. IEEE Geoscience and Remote Sensing Magazine 5, 4 (2017), 836.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Spatial Variability Aware Deep Neural Networks (SVANN): A General Approach

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      • Published in

        cover image ACM Transactions on Intelligent Systems and Technology
        ACM Transactions on Intelligent Systems and Technology  Volume 12, Issue 6
        December 2021
        356 pages
        ISSN:2157-6904
        EISSN:2157-6912
        DOI:10.1145/3501281
        • Editor:
        • Huan Liu
        Issue’s Table of Contents

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 30 November 2021
        • Accepted: 1 May 2021
        • Revised: 1 April 2021
        • Received: 1 December 2020
        Published in tist Volume 12, Issue 6

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article
        • Refereed

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Full Text

      View this article in Full Text.

      View Full Text

      HTML Format

      View this article in HTML Format .

      View HTML Format