Skip to main content
SpringerLink
Log in

Natural interface for interactive virtual assembly in augmented reality using Leap Motion Controller

  • Original Paper
  • Published:
International Journal on Interactive Design and Manufacturing (IJIDeM) Aims and scope Submit manuscript

Abstract

In this paper, an augmented reality methodology based on the use of a low-invasiveness hand tracking device is presented. The developed methodology, allows the user to be visually immersed into an augmented scene by means of a head-mounted display. He can interact with the virtual objects without any wearable sensor using the Leap Motion Controller that is able to acquire the pose of each finger of both hands by optical triangulation without markers. In this way, the interaction between the user and the scene can be considered “natural”. The interaction between hands and objects and the assembling among objects is achieved by the modification of the Object Active Feature–Grasping Active Feature methodology, based on the use of algebraic kinematic constraint equations. The approach has been adapted to take into account the specific information coming from the tracking device. An example of implementation is reported and an experimental usability study discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Valentini, P.P., Pezzuti, E., Gattamelata, D.: Virtual Engineering in Augmented Reality, Computer Animation, Series “Computer Science, Technology and Applications”. Nova Publishing, New York (2010)

    Google Scholar 

  2. Merienne, F.: Human factors consideration in the interaction process with virtual environment. Int. J. Interact. Des. Manuf. 4(2), 83–86 (2000)

    Article  Google Scholar 

  3. Valentini, P.P.: Enhancing User Role in Augmented Reality Interactive Simulations, in Human Factors in Augmented Reality Environments, pp. 233–256. Springer, New York (2013)

    Book  Google Scholar 

  4. Wiedenmaier, S., Oehme, O., Schmidt, L., Luczak, H.: Augmented reality (AR) for assembly processes design and experimental evaluation. Int. J. Hum. Comput. Interact. 16, 497–514 (2003)

    Article  Google Scholar 

  5. Pang, Y., Nee, A.Y.C., Ong, S.K., Yuan, M.L., Youcef-Toumi, K.: Assembly feature design in an augmented reality environment. Assem. Autom. 26(1), 34–43 (2006)

    Article  Google Scholar 

  6. Ong, S.K., Pang, Y., Nee, A.Y.C.: Augmented reality aided assembly design and planning. Ann. CIRP 56–1, 49–52 (2007)

    Article  Google Scholar 

  7. Saaski, J., Salonen, T., Hakkarainen, M., Siltanen, S., Woodward, C., Lempiainen, J.: Integration of design and assembly using augmented reality. In: Ratchev, S., Koelemeijer, S. (eds.) IFIP International Federation for Information Processing. Micro-Assembly, Technologies and Applications, vol. 260, pp. 395–404. Springer, Boston (2008)

    Google Scholar 

  8. Valentini, P.P.: Interactive virtual assembling in augmented reality. Int. J. Interact. Des. Manuf. 3, 109–119 (2009)

    Article  Google Scholar 

  9. Chamaret, D., Ullah, S., Richard, P., Naud, M.: Integration and evaluation of haptic feedbacks: from CAD models to virtual prototyping. Int. J. Interact. Des. Manuf. 4, 87–94 (2010)

    Article  Google Scholar 

  10. Toma, M.I., Girbacia, F., Antonya, C.: A comparative evaluation of human interaction for design and assembly of 3D CAD models in desktop and immersive environments. Int. J. Interact. Des. Manuf. 6, 179–193 (2012)

    Article  Google Scholar 

  11. Fiorentino, M., Radkowski, R., Stritzke, C., Uva, A.E., Monno, G.: Design review of CAD assemblies using bimanual natural interface. Int. J. Interact. Des. Manuf. 7, 249–260 (2013)

    Article  Google Scholar 

  12. Valentini, P.P., Pezzuti, E.: Accuracy in fingertip tracking using Leap Motion Controller for interactive virtual applications. Int. J. Interact. Des. Manuf. 11, 641–650 (2017)

    Article  Google Scholar 

  13. Katahira, R., Soga, M.: Development and evaluation of a system for AR enabling realistic display of gripping motions using Leap Motion Controller. Procedia Comput. Sci. 60, 1595–1603 (2015)

    Article  Google Scholar 

  14. Beattie, N., Horan, B., McKenzie, S.: Taking the LEAP with the Oculus HMD and CAD—plucking at thin air? Procedia Technol. 20, 149–154 (2015)

    Article  Google Scholar 

  15. Hui, Z.: Head-mounted display-based intuitive virtual reality training system for the mining industry. Int. J. Min. Sci. Technol. 27, 717–722 (2017)

    Article  Google Scholar 

  16. Chang, K.-H.: E-Design—Computer-Aided Engineering Design. Elsevier, New York (2015)

    Google Scholar 

  17. Haug, E.J.: Computer-Aided Kinematics and Dynamics of Mechanical Systems. Allyn and Bacon, Boston (1988)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Enterpriese Engineering, University of Rome Tor Vergata, Via del Politecnico 1, 00133, Rome, Italy

    Pier Paolo Valentini

Authors
  1. Pier Paolo Valentini
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Pier Paolo Valentini.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Valentini, P.P. Natural interface for interactive virtual assembly in augmented reality using Leap Motion Controller. Int J Interact Des Manuf 12, 1157–1165 (2018). https://doi.org/10.1007/s12008-018-0461-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12008-018-0461-0

Keywords

Search

Navigation