Skip to main content

Map Fusion Method Based on Image Stitching for Multi-robot SLAM

  • Conference paper
  • First Online:
Advances in Swarm Intelligence (ICSI 2021)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 12690))

Included in the following conference series:

Abstract

Compared with the single-robot SLAM, the SLAM task completed by a multi-robot system in cooperation has the advantages of more accuracy, more efficiency and more robustness. This study focuses on the map fusion problem in the multi-robot SLAM task, which is to fuse the local maps created by multiple independent robots into an integrated map. A multi-robot SLAM map fusion method based on image stitching is therefore proposed. A single robot uses lidar SLAM to build a local environment map and upload it to a central node. The central node then maps each local map from a two-dimensional occupancy grid map to a grayscale image. The SuperPoint network is used to extract the depth features from the grayscale images, and the transformation relationships between the local maps are calculated via the feature matching. The matching topology graph is used to realize the final map fusion. It carries out experimental verification in the indoor environment on three mobile robots, which were developed by our own, and the experiment proved that the method has good real-time performance and robustness. After obtaining the global map, some new robots were placed in the environment, and realized the task of multi-robot target search by using the relocalization function.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Lázaro, M., Paz, L., Piniés, P., Castellanos, J., Grisetti, G.: Multi-robot SLAM using condensed measurements. In: Proceedings of the 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 1069–1076. Tokyo, Japan (2013)

    Google Scholar 

  2. Roumeliotis, S., Bekey, G.: Distributed multirobot localization. IEEE Trans. Robot. Autom. 18(5), 781–795 (2002)

    Article  Google Scholar 

  3. Sasaokas, T., Kimoto, I., Kishimoto, Y., Takaba, K., Nakashima, H.: Multi-robot SLAM via information fusion extended Kalman filters. IFAC-PapersOnLine 49(22), 303–308 (2016)

    Article  Google Scholar 

  4. Dellaert, F., Kipp, A., Krauthausen, P.: A multifrontal QR factorization approach to distributed inference applied to multi-robot localization and mapping. In: Proceedings of the 20th National Conference on Artificial Intelligence and the Seventeenth Innovative Applications of Artificial Intelligence Conference, Vol. 3, pp. 1261–1266. Pittsburgh, USA (2005)

    Google Scholar 

  5. Chang, H., Lee, C., Hu, Y., Yung-Hsiang, L.: Multi-robot SLAM with topological/metric maps. In: Proceedings of the 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 1467–1472. San Diego, USA (2007)

    Google Scholar 

  6. Brown, M., Lowe, D.: Automatic panoramic image stitching using invariant features. Int. J. Comput. Vis. 74(1), 59–73 (2007)

    Article  Google Scholar 

  7. Hörner, J.: Map-merging for multi-robot system. Bachelor’s thesis, Charles University in Prague (2016)

    Google Scholar 

  8. DeTone, D., Malisiewicz, T., Rabinovich, A.: SuperPoint: Self-supervised interest point detection and description. In: Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, pp. 337–349. Salt Lake City, USA (2018)

    Google Scholar 

  9. Rublee, E., Rabaud, V., Konolige, K., Bradski, G.: ORB: An efficient alternative to SIFT or SURF. In: Proceedings of the 2011 International Conference on Computer Vision, pp. 2564–2571. Barcelona, Spain (2011)

    Google Scholar 

  10. Lowe, D.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)

    Article  Google Scholar 

  11. Fischler, M., Bolles, R.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)

    Article  MathSciNet  Google Scholar 

  12. Hess, W., Kohler, D., Rapp, H., Andor, D.: Real-time loop closure in 2D LIDAR SLAM. In: Proceedings of the 2016 IEEE International Conference on Robotics and Automation, pp. 1271–1278. Stockholm, Sweden (2016)

    Google Scholar 

  13. Konolige, K., Grisetti, G., Kümmerle, R., Burgard, W., Limketkai, B., Vincent, R.: Efficient sparse pose adjustment for 2D mapping. In: Proceedings of the 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 22–29. Taipei, China (2010)

    Google Scholar 

  14. Grisetti, G., Stachniss, C., Burgard, W.: Improved techniques for grid mapping with Rao-Blackwellized particle filters. IEEE Trans. Robot. 23(1), 34–46 (2007)

    Article  Google Scholar 

  15. Tang, Q., Yu, F., Xu, Z., Eberhard, P.: Swarm robots search for multiple targets. IEEE Access 8, 92814–92826 (2020)

    Google Scholar 

Download references

Acknowledgements

This work is supported by the projects of National Natural Science Foundation of China (No.61873192; No.61603277; No.61733001), the Quick Support Project (No.61403110321), and Innovative Project (No.20-163-00-TS-009-125-01). Meanwhile, this work is also partially supported by the Fundamental Research Funds for the Central Universities and the Youth 1000 program project. It is also partially sponsored by International Joint Project Between Shanghai of China and Baden-Württemberg of Germany (No. 19510711100) within Shanghai Science and Technology Innovation Plan, as well as the projects supported by China Academy of Space Technology and Launch Vehicle Technology. All these supports are highly appreciated. The authors also would like to thank Zhongqun Zhang for his helpful suggestions.

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Tang, Q., Zhang, K., Xu, P., Zhang, J., Cui, Y. (2021). Map Fusion Method Based on Image Stitching for Multi-robot SLAM. In: Tan, Y., Shi, Y. (eds) Advances in Swarm Intelligence. ICSI 2021. Lecture Notes in Computer Science(), vol 12690. Springer, Cham. https://doi.org/10.1007/978-3-030-78811-7_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-78811-7_15

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-78810-0

  • Online ISBN: 978-3-030-78811-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics