Skip to main content

Post-facto Misrecognition Filter Based on Resumable Interruptions for Coping with Real World Uncertainty in the Development of Reactive Robotic Behaviors

  • Conference paper
  • First Online:
Intelligent Autonomous Systems 17 (IAS 2022)

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 577))

Included in the following conference series:

  • 895 Accesses

Abstract

In this paper we propose a resumable interruption framework for robotic applications which allows to “filter” misrecognition signals after their occurrence. Handling misrecognition is essential for deploying reactive systems into the real world, since being over-reactive to detection errors can lead to livelocks and stagnation. For example, constantly interrupting and resuming a picking task due to misrecognition can make the robot alternate between pre-grasping and grasping motions, without ever achieving the task. Our solution is based on resumable interruptions, continuing interrupted procedures from the exact preemption point if similar execution requests are received shortly after a cancellation order. This acts as a post-facto misrecognition filter, which stabilizes execution and ensures task completion. Compared with standard filtering, the post-facto approach allows to deliver signals faster and recover from misrecognition longer. The proposed system is verified through real robot experiments in dynamic and static environments.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 259.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 329.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. BehaviorTree.CPP. https://github.com/BehaviorTree/BehaviorTree.CPP. Retrieved 2022

  2. Bai, A., Russell, S.: Efficient reinforcement learning with hierarchies of machines by leveraging internal transitions. In: Twenty-Sixth International Joint Conference on Artificial Intelligence (2017)

    Google Scholar 

  3. Berenson, D., Srinivasa, S., Kuffner, J.: Task space regions: a framework for pose-constrained manipulation planning. Int. J. Robot. Res. 30(12), 1435–1460 (2011)

    Article  Google Scholar 

  4. Chakraborti, T., Sreedharan, S., Grover, S., Kambhampati, S.: Plan explanations as model reconciliation – an empirical study. In: 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI), pp. 258–266. IEEE (2019)

    Google Scholar 

  5. Colledanchise, M., Ögren, P.: Behavior Trees in Robotics and AI: An Introduction. CRC Press (2018)

    Google Scholar 

  6. Dudek, W., Wȩgierek, M., Szynkiewicz, W., Winiarski, T., et al.: Task harmonisation for a single-task robot controller. In: 2019 12th International Workshop on Robot Motion and Control (RoMoCo), pp. 86–91. IEEE (2019)

    Google Scholar 

  7. Goodfellow, I.J., Shlens, J., Szegedy, C.: Explaining and harnessing adversarial examples. arXiv preprint arXiv:1412.6572 (2014)

  8. Holtz, J., Guha, A., Biswas, J.: Interactive robot transition repair with SMT. arXiv preprint arXiv:1802.01706 (2018)

  9. Isla, D.: GDC 2005 Proceeding: Handling Complexity in the HALO 2 AI. Retrieved October, 21:2009 (2005)

    Google Scholar 

  10. Johnson, B., Kress-Gazit, H.: Analyzing and revising synthesized controllers for robots with sensing and actuation errors. Int. J. Robot. Res. 34(6), 816–832 (2015)

    Article  Google Scholar 

  11. Kim, K., Fainekos, G., Sankaranarayanan, S.: On the minimal revision problem of specification automata. Int. J. Robot. Res. 34(12), 1515–1535 (2015)

    Article  Google Scholar 

  12. Kurakin, A., Goodfellow, I., Bengio, S., et al.: Adversarial examples in the physical world (2016)

    Google Scholar 

  13. Li, T., Pan, J., Zhu, D., Meng, M.Q.-H.: Learning to interrupt: a hierarchical deep reinforcement learning framework for efficient exploration. In: IEEE International Conference on Robotics and Biomimetics (ROBIO), pp. 648–653. IEEE (2018)

    Google Scholar 

  14. Mateas, M., Stern, A.: A behavior language for story-based believable agents. IEEE Intell. Syst. 17(4), 39–47 (2002)

    Article  Google Scholar 

  15. Millington, I., Funge, J.: Artificial Intelligence for Games. CRC Press (2018)

    Google Scholar 

  16. Mohseni-Kabir, A., Veloso, M.M.: Robot task interruption by learning to switch among multiple models. In: IJCAI, pp. 4943–4949 (2018)

    Google Scholar 

  17. Murooka, M., Nozawa, S., Bando, M., Yanokura, I., Okada, K., Inaba, M.: Simultaneous planning and estimation based on physics reasoning in robot manipulation. In: 2018 IEEE International Conference on Robotics and Automation (ICRA), pp. 3137–3144. IEEE (2018)

    Google Scholar 

  18. Nedunuri, S., Prabhu, S., Moll, M., Chaudhuri, S., Kavraki, L.E.: SMT-based synthesis of integrated task and motion plans from plan outlines. In: 2014 IEEE International Conference on Robotics and Automation (ICRA), pp. 655–662. IEEE (2014)

    Google Scholar 

  19. Nilsson, N.J.: A mobile automaton: an application of artificial intelligence techniques. Technical report, SRI International, Menlo Park, CA, Artificial Intelligence Center, 1969

    Google Scholar 

  20. Nilsson, N.J.: Shakey the robot. Technical report, SRI International, Menlo Park, CA, 1984

    Google Scholar 

  21. Omar, S., Ngadi, A., Jebur, H.H.: Machine learning techniques for anomaly detection: an overview. Int. J. Comput. Appl. 79(2) (2013)

    Google Scholar 

  22. Raptis, I.A., Sconyers, C., Martin, R., Mah, R., Oza, N., Mavris, D., Vachtsevanos, G.J.: A particle filtering-based framework for real-time fault diagnosis of autonomous vehicles. In: Annual Conference of the PHM Society, vol. 5 (2013)

    Google Scholar 

  23. Rigatos, G., Busawon, K.: Robotic Manipulators and Vehicles: Control, Estimation and Filtering, vol. 152. Springer (2018)

    Google Scholar 

  24. Rigatos, G.G.: Extended Kalman and particle filtering for sensor fusion in motion control of mobile robots. Math. Comput. Simul. 81(3), 590–607 (2010)

    Google Scholar 

  25. Shon, T., Moon, J.: A hybrid machine learning approach to network anomaly detection. Inf. Sci. 177(18), 3799–3821 (2007)

    Article  Google Scholar 

  26. Sreedharan, S., Srivastava, S., Smith, D., Kambhampati, S.: Why can’t you do that HAL? Explaining unsolvability of planning tasks. In: International Joint Conference on Artificial Intelligence (2019)

    Google Scholar 

  27. Wong, K.W., Ehlers, R., Kress-Gazit, H.: Correct high-level robot behavior in environments with unexpected events. In: Robotics: Science and Systems (2014)

    Google Scholar 

  28. Wong, K.W., Ehlers, R., Kress-Gazit, H.: Resilient, provably-correct, and high-level robot behaviors. IEEE Trans. Robot. 34(4), 936–952 (2018)

    Google Scholar 

  29. Zachary Woodruff, J., Lynch, K.M.: Planning and control for dynamic, nonprehensile, and hybrid manipulation tasks. In: 2017 IEEE International Conference on Robotics and Automation (ICRA), pp. 4066–4073. IEEE (2017)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Guilherme de Campos Affonso .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

de Campos Affonso, G., Okada, K., Inaba, M. (2023). Post-facto Misrecognition Filter Based on Resumable Interruptions for Coping with Real World Uncertainty in the Development of Reactive Robotic Behaviors. In: Petrovic, I., Menegatti, E., Marković, I. (eds) Intelligent Autonomous Systems 17. IAS 2022. Lecture Notes in Networks and Systems, vol 577. Springer, Cham. https://doi.org/10.1007/978-3-031-22216-0_8

Download citation

Publish with us

Policies and ethics