Skip to main content

Fail It till You Make It: Error Expectation in Complex-Plan Execution for Service Robots

  • Conference paper
  • First Online:
Interactive Collaborative Robotics (ICR 2023)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 14214))

Included in the following conference series:

Abstract

Domestic service robots (DSR) are devices aimed to carry out daily household chores. Recently, the range and difficulty of the activities they can perform are reaching amazing performances, frequently resulting in complex plans with several steps requiring many skills where errors are more likely to occur. In this paper, we introduce the concept of error expectation in complex plans for domestic service robots and propose a classification of DSR’s tasks based on the abilities required for their execution. We also propose a recovery system where a type of feedback is chosen based on error expectation and DSR task type. We test our proposal in the context of an object manipulation task and discuss how error expectation contributes to a good feedback choice. An action involving several robot skills, namely navigation, human and object recognition, natural language processing, etc., was illustrated by the “take” action. The video showing the complete execution of a complex command by a robot using error recovery is presented.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 74.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Wisspeintner, T., Van Der Zant, T., Iocchi, L., Schiffer, S.: RoboCup@Home: scientific competition and benchmarking for domestic service robots. Interact. Stud. 10(3), 392–426 (2009)

    Article  Google Scholar 

  2. Amigoni, F., et al.: Competitions for benchmarking: task and functionality scoring complete performance assessment. IEEE Robot. Autom. Mag. 22(3), 53–61 (2015)

    Article  Google Scholar 

  3. Contreras, L., Yamamoto, T., Matsusaka, Y., Okada, H.: Towards general purpose service robots: world robot summit partner robot challenge. Adv. Robot. 36, 812–824 (2022). https://doi.org/10.1080/01691864.2022.2109428

    Article  Google Scholar 

  4. Savage, J., et al.: Semantic reasoning in service robots using expert systems. Robot. Auton. Syst. 114, 77–92 (2019)

    Article  Google Scholar 

  5. James, S., Ma, Z., Arrojo, D.R., Davison, A.J.: RLBench: the robot learning benchmark & learning environment. IEEE Robot. Autom. Lett. 5(2), 3019–3026 (2020)

    Article  Google Scholar 

  6. Zeng, A., et al.: Transporter networks: rearranging the visual world for robotic manipulation. In: Conference on Robot Learning, pp. 726–747 (2021)

    Google Scholar 

  7. Shridhar, M., Manuelli, L., Fox, D.: CLIPort: what and where pathways for robotic manipulation. In: Conference on Robot Learning, pp. 894–906 (2022)

    Google Scholar 

  8. Radford, A., et al.: Learning transferable visual models from natural language supervision. In: International Conference on Machine Learning, pp. 8748–8763 (2021)

    Google Scholar 

  9. Hestness, J., et al.: Deep learning scaling is predictable, empirically. arXiv preprint arXiv:1712.00409 (2017)

  10. Kaplan, J., et al.: Scaling laws for neural language models. arXiv preprint arXiv:2001.08361 (2020)

  11. Szot, A., et al.: Habitat 2.0: training home assistants to rearrange their habitat. Adv. Neural Inf. Process. Syst. 34, 251–266 (2021)

    Google Scholar 

  12. Contreras, L., Matsusaka, Y., Yamamoto, T., Okada, H.: sDSPL-towards a benchmark for general-purpose task evaluation in domestic service robots. In: The 39th Annual Conference of the Robotics Society of Japan (2021)

    Google Scholar 

  13. Srivastava, S., et al.: Behavior: benchmark for everyday household activities in virtual, interactive, and ecological environments. In: Conference on Robot Learning, pp. 477–490 (2022)

    Google Scholar 

  14. Vazquez, E., Contreras, L., Okada, H., Iwahashi, N.: Multimodal human intention-driven robot motion control in collaborative tasks. In: 38-th Annual Conference of the Robotics Society of Japan (2020)

    Google Scholar 

  15. Contreras, L., Muto, Y., Okada, H., Sakamaki, A.: Robot-object interaction strategies for object recognition. In: 37th Annual Conference of the Robotics Society of Japan (2019)

    Google Scholar 

  16. Contreras, L., Mayol-Cuevas, W.: Towards CNN map representation and compression for camera relocalisation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 292–299 (2018)

    Google Scholar 

  17. RoboCup@Home Command Generator. https://github.com/kyordhel/GPSRCmdGen. Accessed 19 May 2023

  18. Fail it till you make it: error expectation in complex-plan execution for service robots. https://youtu.be/rhJ-dcahfqc. Accessed 19 May 2023

Download references

Acknowledgements

This work has been supported by the project, JPNP20006, commissioned by the New Energy and Industrial Technology Development Organization (NEDO) and by PAPIIT-DGAPA UNAM under Grant IG-101721.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jesus Savage .

Editor information

Editors and Affiliations

1 Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary file1 (MP4 21349 kb)

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Contreras, L., Savage, J., Ortuno-Chanelo, S., Negrete, M., Sakamaki, A., Okada, H. (2023). Fail It till You Make It: Error Expectation in Complex-Plan Execution for Service Robots. In: Ronzhin, A., Sadigov, A., Meshcheryakov, R. (eds) Interactive Collaborative Robotics. ICR 2023. Lecture Notes in Computer Science(), vol 14214. Springer, Cham. https://doi.org/10.1007/978-3-031-43111-1_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-43111-1_4

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-43110-4

  • Online ISBN: 978-3-031-43111-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics