Skip to main content
SpringerLink
Log in

Impulse dynamics and augmented reality for real-time interactive digital twin exploration and interrogation

  • Original Article
  • Published:
International Journal on Interactive Design and Manufacturing (IJIDeM) Aims and scope Submit manuscript

Abstract

Digital twins are revolutionizing many engineering fields due to the availability of advanced and reliable instruments for continuous real-time monitoring, control, interrogation, and optimization of a system throughout its entire life cycle. Digital twins can be successfully integrated with augmented reality tools to enhance and facilitate communication from and to the user. The paper discusses a comprehensive methodology to implement and manage digital twins of rigid-link mechanisms, which require real-time dynamic simulation with input and output from sensors and actuators. The entire methodology is enhanced by integrating the Microsoft Hololens 2 augmented reality headset to implement interactive communication using natural interfaces. The paper includes an in-depth discussion of the general and modular approach and a detailed example of an application with an assessment of the accuracy of the simulation results.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

Data availability

The authors declare that all relevant data are within the paper.

References

  1. Grieves, M.: Digital twin of physical systems: opportunities and challenges, In: Proceedings of the ASME 2002 International Mechanical Engineering Congress and Exposition, 17–22 November, New Orleans, USA, (2002)

  2. Merienne, F.: Human factors consideration in the interaction process with virtual environment. Int. J. Interact. Des. Manuf. 4(2), 83–86 (2000)

    Article  Google Scholar 

  3. Valentini, P.P.: Enhancing user role in augmented reality interactive simulations, pp. 233–256. Human Factors in Augmented Reality Environments, Springer, New York (2013)

    Google Scholar 

  4. Chaudhari, S.S., Bhole, K.S., Rane, S., Deshmukh, S.: A generic digital twin application framework for emerging trends in industrial process heaters. Procedia CIRP 119, 1128–1133 (2023)

    Article  Google Scholar 

  5. Chaudhari, S.S., Bhole, K.S., Rane, S.: An application of IIoT framework in system design, performance monitoring and control for industrial process heater. Int. J. Interact. Des. Manuf. (2023). https://doi.org/10.1007/s12008-023-01235-6

    Article  Google Scholar 

  6. Chaudhari, S., Bhole, K.S., Rane, S.: Comparison on conventional and digital technology assisted design methodologies of process heater radiant section. Int. J. Interact. Des. Manuf. (2023). https://doi.org/10.1007/s12008-023-01201-2

    Article  Google Scholar 

  7. Valentini, P.P., Pavia, D., Marotta, E., Cirelli, M.: Interactive simulation of realistic flexible and tearable membrane using virtual reality and haptic force-feedback interface. Int. J. Interact. Des. Manuf. 14, 813–822 (2020)

    Article  Google Scholar 

  8. Ke, S., Xiang, F., Zhang, Z., Zuo, Y.: An enhanced interaction framework based on VR, AR, MR in digital twin. Procedia CIRP 83, 753–758 (2019)

    Article  Google Scholar 

  9. Yin, Y., Zheng, P., Li, C., Wang, L.: A state-of-the-art survey on augmented reality-assisted digital twin for futuristic human-centric industry transformation. Robot. Comput. Integr. Manuf. 81, 102515 (2023)

    Article  Google Scholar 

  10. Cai, Y., Wang, Y., Burnett, M.: Using augmented reality to build digital twin for reconfigurable additive manufacturing system. J. Manuf. Syst. 56, 598–604 (2020)

    Article  Google Scholar 

  11. Li, C., Zheng, P., Li, S., Pang, Y., Lee, C.K.M.: AR-assisted digital twin-enabled robot collaborative manufacturing system with human-in-the-loop. Robot. Comput. Integr. Manuf. 76, 102321 (2022)

    Article  Google Scholar 

  12. García, A., Bregon, A., Martínez-Prieto, M.: Towards a connected digital twin learning ecosystem in manufacturing: enablers and challenges. Comput. Ind. Eng.. Ind. Eng. 171, 108463 (2022)

    Article  Google Scholar 

  13. Liu, S., Vincent, X., Wang, L.: Digital twin-enabled advance execution for human-robot collaborative assembly. CIRP Ann. 71, 25–28 (2022)

    Article  CAS  Google Scholar 

  14. Choi, S.H., Park, K.B., Roh, D.H., Lee, J.Y., Mohammed, M., Ghasemi, Y., Jeong, H.: An integrated mixed reality system for safety-aware human-robot collaboration using deep learning and digital twin generation. Robot. Comput. Integr. Manuf. 73, 102258 (2022)

    Article  Google Scholar 

  15. Valentini, P.P.: Interactive virtual assembling in augmented reality. Int. J. Interact. Des. Manuf. 3, 109–119 (2009)

    Article  Google Scholar 

  16. Qiu, C., Zhou, S., Liu, Z., Gao, Q., Tan, J.: Digital assembly technology based on augmented reality and digital twins: a review. Virtual Real. Intell. Hardw. 1(6), 597–610 (2019)

    Article  Google Scholar 

  17. Chen, C.H., Lin, C.W., Huang, C.C.: The convergence of augmented reality and digital twins: a new approach to product development and manufacturing, J. Intell. Manuf. (2019)

  18. Shah, M.M., Khan, M.M.A., Alshamran, S.A.: Augmented reality and digital twins: a new paradigm for manufacturing, Manuf. Lett. (2020)

  19. Valentini, P.P., Biancolini, M.E.: Interactive sculpting using augmented-reality mesh morphing, and force feedback: force-feedback capabilities in an augmented reality environment. IEEE Consum. Electron. Mag. 7(2), 83–89 (2018)

    Article  Google Scholar 

  20. Valentini, P.P.: Interactive cable harnessing in augmented reality. Int. J. Interact. Des. Manuf. 5, 45–53 (2011)

    Article  Google Scholar 

  21. Valentini, P.P., Pennestrì, E.: Compliant four-bar linkage synthesis with second-order flexure hinge approximation. Mech. Mach. Theory 128, 225–233 (2018)

    Article  Google Scholar 

  22. Valentini, P.P.: Natural Interface in Augmented Reality Interactive Simulations. Virtual and Physical Prototyping 7, 137–151 (2012)

    Article  Google Scholar 

  23. Valentini, P.P., Pezzuti, E.: Accuracy in fingertip tracking using Leap Motion Controller for interactive virtual applications. Int. J. Interact. Des. Manuf. 11, 641–650 (2017)

    Article  Google Scholar 

  24. Valentini, P.P.: Natural interface for interactive virtual assembly in augmented reality using leap motion controller. Int. J. Interact. Des. Manuf. 12(4), 1157–1165 (2018)

    Article  Google Scholar 

  25. Belfiore, N.P., Mariti, L., Pennestrì, E., Valentini, P.P.: Comparison of solution strategies for multibody dynamics equations. Int. J. Numer. Meth. Eng.Numer. Meth. Eng. 88(7), 637–656 (2011)

    Article  ADS  MathSciNet  Google Scholar 

  26. Mirtich, B.V.: Impulse-based dynamic simulation of rigid body systems, PhD thesis, University of California, Berkeley, CA, USA (1996)

  27. Schmitt, A., Bender J.: Impulse-based dynamic simulation of multibody systems: numerical comparison with standard methods, In: Proceedings of automation of discrete production engineering, Sozopol, Bulgaria, pp. 324–329, (2005)

  28. Valentini, P.P., Pezzuti, E.: Interactive multibody simulation in augmented reality. J. Theor. Appl. Mech.Theor. Appl. Mech. 48(3), 733–750 (2010)

    Google Scholar 

  29. Haug, E.J.: Computer aided kinematics and dynamics of mechanical systems, Pearson College Div, USA, (1989)

  30. Azuma, R., Baillot, Y., Behringer, R., Feiner, S., Julier, S., MacIntyre, B.: Recent advances in augmented reality. IEEE Comput. Graph. 21(6), 34–47 (2001)

    Article  Google Scholar 

  31. Liarokapis, F.: An augmented reality interface for visualizing and interacting with virtual content. Virtual Real. 11, 23–43 (2007)

    Article  Google Scholar 

Download references

Acknowledgement

The authors wish to acknowledge the support of the Project ECS 0000024 Rome Technopole,—CUP E83C22003240001, NRP Mission 4 Component 2 Investment 1.5, funded by the European Union NextGenerationEU and of the National Center for HPC, Big Data and Quantum Computing, Project CN_00000013—CUP E83C22003230001, Mission 4 Component 2 Investment 1.4, funded by the European Union—NextGenerationEU.

Author information

Authors and Affiliations

  1. Department of Enterprise Engineering, University of Rome Tor Vergata, Via del Politecnico 1, 00133, Rome, Italy

    Marco Cirelli, Alessio Cellupica, Pietro Canonico & Pier Paolo Valentini

Authors
  1. Marco Cirelli
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Alessio Cellupica
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Pietro Canonico
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Pier Paolo Valentini
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Pier Paolo Valentini.

Ethics declarations

Conflict of interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Cirelli, M., Cellupica, A., Canonico, P. et al. Impulse dynamics and augmented reality for real-time interactive digital twin exploration and interrogation. Int J Interact Des Manuf 18, 929–941 (2024). https://doi.org/10.1007/s12008-023-01704-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12008-023-01704-y

Keywords

Search

Navigation