Abstract
To develop cooperative content based on the hand gestures of multiple users, typical frameworks must be separately used for the communication among computers and hand gesture recognition. In this paper, we propose a framework that enables users who are far apart to interact using hand gestures in the same virtual environment. This approach makes possible remote cooperative education content. We present the design of a server and client, as well as techniques for respectively managing multiple users, controlling crashes among multiple users, and managing gesture data for activating the proposed framework on clouds. To verify that the framework enables multiple users to interact, we developed a virtual chemical experiment based on the proposed design and performed the simulation with it. The framework can be used for a variety of educational content using interactions among multiple users.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Kim Y (2011) Study on the development of a virtual reality experiment program in the chemistry education: centering the chemistry unit in the 10th grade science textbook. Dissertation, Kongju National University
Lee Y (1997) Design and implementation of cyber science experiment. Thesis, Ewha Womans University
Lee S (2001) A design and implementation of the virtual experimental laboratory for common science. Thesis, Hanseo University
Chung KS, Kwon S, Huang W-H (2013) Design and development of sensor-based virtual experiment contents for smart phone. J Digit Contents Soc 14(2):161–169. doi:10.9728/dcs.2013.14.2.161
Matsuda H, Shindo Y (2008) Virtual chemical experiment using cyber assistant professor: CAP. In: Eighth IEEE international conference on advanced learning technologies, 2008. ICALT’08, pp 977–981. doi:10.1109/ICALT.2008.109
Ebert LC, Flach P, Thali MJ, Ross S (2014) Out of touch—a plugin for controlling OsiriX with gestures using the leap controller. J Forensic Radiol Imaging 2(3):126–128. doi:10.1016/j.jofri.2014.05.006
Marton F, Agus M, Gobbetti E, Pintore G, Balsa Rodriguez M (2012) Natural exploration of 3D massive models on large-scale light field displays using the FOX proximal navigation technique. Comput Graph 36(8):893–903. doi:10.1016/j.cag.2012.06.005
Xu W, Lee EJ (2013) A new NUI method for hand tracking and gesture recognition based on user experience. Int J Secur Appl 7(2):149–155
Hwang T (2012) Development of architectural design support tools using the natural user interface (NUI). Thesis, Seoul National University of Science and Technology
Shin Y (2013) Design and implementation of the virtual education system focusing on interactions using the gesture-based 3D avatar. Thesis, Korea National University of Transportation
Kolici V, Herrero A, Xhafa F (2014) On the performance of Oracle grid engine queuing system for computing intensive applications. J Inf Process Syst 10(4):491–502. doi:10.3745/JIPS.01.0004
Salam MI, Yau W-C, Chin J-J, Heng S-H, Ling H-C, Phan RC-W, Poh GS, Tan S-Y, Yap W-S (2015) Implementation of searchable symmetric encryption for privacy-preserving keyword search on cloud storage. Human-centric Comput Inf Sci 5(19):1–16. doi:10.1186/s13673-015-0039-9
Cho H, Choi M (2014) Personal mobile album/diary application development. J Converg 5(1):32–37
Low Y, Gonzalez J, Kyrola A, Bickson D, Guestrin C, Hellerstein JM (2012) Distributed graph lab: a framework for machine learning and data mining in the cloud. Proceedings of the VLDB endowment 5(8):716–727. doi:10.14778/2212351.2212354
Bae Y (2000) Development of real-time interactive lecture support tool on client/server environment. Thesis, Anyang University
Hwang K, Choi CY (1998) Design and implementation of multimedia server for distance learning. KIISE Trans Comput Pract 4(3):325–336
Jang SW, Jeon YJ (2000) Design and implementation of a group-based real-time distance learning system. KIISE Trans Comput Pract 6(5):543–554
Kim J-O, Jung J-S, Kim D-H, Kwon S-O, Lee J, Ju S, Park C, Jang R-H, Yoo K-H (2014) Development of interactive 3D video education system based on gesture interface. J HCI Soc Korea 2014(2):551–554
Tam V, Ling-Shan L (2012) Integrating the Kinect camera, gesture recognition and mobile devices for interactive discussion. In: 2012 IEEE international conference on Teaching, Assessment and Learning for Engineering (TALE), pp H4C-11–H4C-13, 20–23. doi:10.1109/TALE.2012.6360362
Acknowledgments
This research was supported by the MSIP (Ministry of Science, ICT and Future Planning), Korea, under the ITRC (Information Technology Research Center) support program (IITP-2016-H8501-16-1014) supervised by the IITP (Institute for Information & communications Technology Promotion) and by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Science, ICT and future Planning (NRF-2015R1A2A2A01003779).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Kim, Y., Cho, S., Fong, S. et al. Design of hand gesture interaction framework on clouds for multiple users. J Supercomput 73, 2851–2866 (2017). https://doi.org/10.1007/s11227-016-1722-y
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11227-016-1722-y