Skip to main content

DuckyCode: A Hybrid Platform with Graphical and Tangible User Interfaces to Program Educational Robots

  • Conference paper
  • First Online:
Novel & Intelligent Digital Systems: Proceedings of the 3rd International Conference (NiDS 2023) (NiDS 2023)

Abstract

Nowadays it seems that there is a great interest in the development of educational systems based on tangible interfaces and educational robotics. However, existing systems seem to have limited capabilities and at the same time show reduced scalability. Therefore, this article describes: a) the sources of potential benefits of tangible user interfaces b) the challenges, and a series of design guidelines for designing such systems c) the DuckyCode system which is an educational robot programming platform that combines tangible, graphical, and text-based programming subsystems. The system presents a series of capabilities that appear for the first time in the relevant literature, enabling users to configure a full internet - connected tangible system as they wish, to interact simultaneously with different interfaces, and to exchange code with remote users. Therefore, the system appears as a programming platform aimed at both experienced and novice users like children and adults.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 149.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 199.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Zuckerman, O., Arida, S., Resnick, M.: Extending tangible interfaces for education: digital montessori-inspired manipulatives. In: Proceedings of the SIGCHI Conference on Human factors in Computing Systems, pp. 859–868. ACM, Portland, Oregon, USA (2005)

    Google Scholar 

  2. Resnick, M., et al.: Digital manipulatives: new toys to think with. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 281–287. ACM Press/Addison-Wesley Publishing Co., Los Angeles, California, United States (1998)

    Google Scholar 

  3. Sapounidis, T., Demetriadis, S.: Educational robots driven by tangible programming languages: a review on the field. In: Alimisis, D., Moro, M., Menegatti, E. (eds.) Educational Robotics in the Makers Era, pp. 205–214. Springer International Publishing, Cham (2017). https://doi.org/10.1007/978-3-319-55553-9_16

    Chapter  Google Scholar 

  4. Sapounidis, T., Stamelos, I., Demetriadis, S.: Tangible user interfaces for programming and education: a new field for innovation and entrepreneurship. In: Papadopoulos, P.M., Burger, R., Faria, A. (eds.) Innovation and Entrepreneurship in Education, pp. 271–295. Emerald Group Publishing Limited (2016). https://doi.org/10.1108/S2051-229520160000002016

    Chapter  Google Scholar 

  5. Sapounidis, T., Demetriadis, S.: Tangible programming interfaces: a literature review. In: 4th Balkan Conference in Informatics, pp. 70–75. Thessaloniki, GREECE (2009)

    Google Scholar 

  6. Price, S., Rogers, Y., Scaife, M., Stanton, D., Neale, H.: Using “tangibles” to promote novel forms of playful learning. Interact. Comput. 15(2), 169–185 (2003). https://doi.org/10.1016/S0953-5438(03)00006-7

    Article  Google Scholar 

  7. Schneider, B., Jermann, P., Zufferey, G., Dillenbourg, P.: Benefits of a tangible interface for collaborative learning and interaction. IEEE Trans. Learn. Technol. 4(3), 222–232 (2011)

    Article  Google Scholar 

  8. Ullmer, B., Ishii, H., Jacob, R.J.K.: Token constraint systems for tangible interaction with digital information. ACM Trans. Comput. Hum. Interact. 12(1), 81–118 (2005)

    Article  Google Scholar 

  9. Price, S., Rogers, Y.: Let’s get physical: the learning benefits of interacting in digitally augmented physical spaces. Comput. Educ. 43(1–2), 137–151 (2004)

    Article  Google Scholar 

  10. Fernaeus, Y., Tholander, J.: Designing for programming as joint performances among groups of children. Interact. Comput. 18(5), 1012–1031 (2006)

    Article  Google Scholar 

  11. Xie, L., Antle, A.N., Motamedi, N.: Are tangibles more fun?: comparing children’s enjoyment and engagement using physical, graphical and tangible user interfaces. In: Proceedings of the 2nd International Conference on Tangible and Embedded Interaction (TEI 2008), pp. 191–198. ACM, New York, NY, USA (2008)

    Google Scholar 

  12. Marshall, P.: Do tangible interfaces enhance learning?. In: Proceedings of the 1st International Conference on Tangible and Embedded Interaction, pp. 163–170. ACM, Baton Rouge, Louisiana, USA (2007)

    Google Scholar 

  13. Sapounidis, T., Demetriadis, S.: Tangible versus graphical user interfaces for robot programming: exploring cross-age children’s preferences. Pers. Ubiquitous Comput. 17(8), 1775–1786 (2013). https://doi.org/10.1007/s00779-013-0641-7

  14. Fernaeus, Y., Tholander, J.: Finding design qualities in a tangible programming space. In: CHI 2006 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 447–456. ACM, Montreal, Canada (2006)

    Google Scholar 

  15. Manches, A., O’Malley, C., Benford, S.: The role of physical representations in solving number problems: a comparison of young children’s use of physical and virtual materials. Comput. Educ. 54(3), 622–640 (2010)

    Google Scholar 

  16. Jacob, R.J.K., et al., ‘Reality-based interaction: a framework for post-WIMP interfaces. In: Proceeding of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems, pp. 201–210. ACM (2008)

    Google Scholar 

  17. Falcão, T.P., Price, S.: What have you done! The role of’interference’in tangible environments for supporting collaborative learning. In: Proceedings of the 9th International Conference on computer supported collaborative Learning, pp. 325–334. International Society of the Learning Sciences, Rhodes, Greece (2009)

    Google Scholar 

  18. Rogers, Y., Lim, Y., Hazlewood, R., Marshall, P.: Equal opportunities: do shareable interfaces promote more group participation than single user displays? Hum. Comput. Interact. 24(1–2), 79–116 (2009)

    Article  Google Scholar 

  19. Stanton, D., et al.: Classroom collaboration in the design of tangible interfaces for storytelling. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 482–489. ACM, Seattle, Washington, United States (2001)

    Google Scholar 

  20. Goldin-Meadow, S.: Hearing Gesture: How Our Hands Help us Think. Belknap Press (2005)

    Google Scholar 

  21. Scott, S.D., Mandryk, R.L., Inkpen, K.M.: Understanding children’s collaborative interactions in shared environments. J. Comput. Assist. Learn. 19(2), 220–228 (2003). https://doi.org/10.1046/j.0266-4909.2003.00022.x

    Article  Google Scholar 

  22. Inkpen, K., Booth, K.S., Gribble, S.D., Klawe, M.: Give and take: children collaborating on one computer. In: CHI 1995 Conference Companion on Human Factors in Computing Systems, in CHI 1995, pp. 258–259. ACM, Denver, Colorado, United States (1995). https://doi.org/10.1145/223355.223663

  23. Clements, D.: Playing with computers, playing with ideas. Educ. Psychol. Rev. 7(2), 203–207 (1995). https://doi.org/10.1007/BF02212494

    Article  Google Scholar 

  24. Sapounidis, T., Demetriadis, S., Papadopoulos, P.M., Stamovlasis, D.: Tangible and graphical programming with experienced children: a mixed methods analysis. Int. J. Child-Comput. Interact. 19, 67–78 (2019). https://doi.org/10.1016/j.ijcci.2018.12.001

    Article  Google Scholar 

  25. Ryan, R.M., Deci, E.L.: Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. Am. Psychol. 55(1), 68–78 (2000). https://doi.org/10.1037/0003-066X.55.1.68

    Article  Google Scholar 

  26. Rogers, Y., Scaife, M., Gabrielli, S., Smith, H., Harris, Eric: A conceptual framework for mixed reality environments: designing novel learning activities for young children. Presence Teleoper. Virtual Environ. 11(6), 677–686 (2002). https://doi.org/10.1162/105474602321050776

    Article  Google Scholar 

  27. Billinghurst, M., Kato, H., Poupyrev, I.: Tangible augmented reality. In: ACM SIGGRAPH ASIA 2008 courses, in SIGGRAPH Asia 2008, pp. 7:1–7:10. ACM, Singapore (2008). https://doi.org/10.1145/1508044.1508051

  28. Sapounidis, T., Demetriadis, S., Stamelos, I.: Evaluating children performance with graphical and tangible robot programming tools. Pers. Ubiquitous Comput. 19(1), 225–237 (2015). https://doi.org/10.1007/s00779-014-0774-3

  29. Shaer, O., Jacob, R.J.K.: A specification paradigm for the design and implementation of tangible user interfaces. ACM Trans. Comput. Hum. Interact. 16(4), 1–39 (2009). https://doi.org/10.1145/1614390.1614395

    Article  Google Scholar 

  30. Sapounidis, T., Stamovlasis, D., Demetriadis, S.: Latent class modeling of children’s preference profiles on tangible and graphical robot programming. IEEE Trans. Educ. 62(2), 127–133 (2019). https://doi.org/10.1109/TE.2018.2876363

    Article  Google Scholar 

  31. Horn, M.S., Jordan Crouser, R., Bers, M.U.: Tangible interaction and learning: the case for a hybrid approach. Personal Ubiquitous Comput. 16(4), 379–389 (2012). https://doi.org/10.1007/s00779-011-0404-2

    Article  Google Scholar 

  32. Sylla, C., Branco, P., Coutinho, C., Coquet, E.: TUIs vs. GUIs: comparing the learning potential with preschoolers. Personal Ubiquitous Comput. 16(4), 421–432 (2012). https://doi.org/10.1007/s00779-011-0407-z

    Article  Google Scholar 

  33. Kwon, D.-Y., Kim, H.-S., Shim, J.-K., Lee, W.-G.: Algorithmic bricks: a tangible robot programming tool for elementary school students. IEEE. Trans. Educ. 55(4), 474–479 (2012)

    Article  Google Scholar 

  34. Rekimoto, J., Ullmer, B., Oba, H.: DataTiles: a modular platform for mixed physical and graphical interactions. In: CHI 2001 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 269–276. ACM, Seattle, Washington, New York, NY, USA (2001)

    Google Scholar 

  35. Kitamura, Y., Itoh, Y., Masaki, T., Kishino, F.: ActiveCube: a bi-directional user interface using cubes. In: Proceedings. Fourth International Conference on Knowledge-Based Intelligent Engineering Systems and Allied Technologies, pp. 99–102. Brighton, UK (2000)

    Google Scholar 

  36. McNerney, T.S.: From turtles to Tangible Programming Bricks: explorations in physical language design. Pers. Ubiquitous Comput. 8(5), 326–337 (2004)

    Article  Google Scholar 

  37. Cockburn, A., Bryant, A.: Leogo: an equal opportunity user interface for programming. J. Vis. Lang. Comput. 8(5–6), 601–619 (1997)

    Google Scholar 

  38. Wyeth, P., Purchase, H.C.: Tangible programming elements for young children. In: CHI’02 Extended Abstracts on Human Factors in Computing Systems, pp. 774–775. ACM, Minneapolis, Minnesota, USA (2002)

    Google Scholar 

  39. Kahn, K.: Drawings on napkins, video-game animation, and other ways to program computers. Commun. ACM 39(8), 49–59 (1996)

    Article  Google Scholar 

  40. Kelleher, C., Pausch, R.: Lowering the barriers to programming. ACM Comput. Surv. 37(2), 83–137 (2005). https://doi.org/10.1145/1089733.1089734

    Article  Google Scholar 

  41. Fishkin, K.P.: A taxonomy for and analysis of tangible interfaces. Pers. Ubiquitous Comput. 8(5), 347–358 (2004)

    Article  Google Scholar 

  42. Blackwell, A.: Cognitive dimensions of tangible programming languages. In: Proceedings of the first joint conference of the Empirical Assessment in Software Engineering and Psychology of Programming Interest Groups, pp. 391–405. Citeseer, Keele, UK (2003)

    Google Scholar 

  43. Sapounidis, T., Demetriadis, S.: Touch your program with hands: qualities in tangible programming tools for novice. In: 15th Panhellenic Conference on Informatics (IEEE/PCI), pp. 363–367. IEEE (2011). https://doi.org/10.1109/PCI.2011.5

  44. Zuckerman, O., Resnick, M.: A physical interface for system dynamics simulation. In: CHI 2003 Extended Abstracts on Human Factors in Computing Systems, pp. 810–811. ACM, New York, NY, Florida, USA (2003)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Theodosios Sapounidis .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Sapounidis, T., Mantziaris, P., Kedros, I. (2023). DuckyCode: A Hybrid Platform with Graphical and Tangible User Interfaces to Program Educational Robots. In: Kabassi, K., Mylonas, P., Caro, J. (eds) Novel & Intelligent Digital Systems: Proceedings of the 3rd International Conference (NiDS 2023). NiDS 2023. Lecture Notes in Networks and Systems, vol 784. Springer, Cham. https://doi.org/10.1007/978-3-031-44146-2_10

Download citation

Publish with us

Policies and ethics