Skip to main content
SpringerLink
Log in

A Multidimensional Taxonomy Model for Music Tangible User Interfaces

  • Conference paper
  • First Online:
MultiMedia Modeling (MMM 2024)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 14556))

Included in the following conference series:

  • 396 Accesses

Abstract

This paper focuses on music tangible user interfaces, namely human-computer interfaces in which a user interacts with digital information through the physical environment with music intention. Music tangible user interfaces can be employed in many scenarios, including music education for beginners, gamification approaches, musical expression for impaired users, and physical and cognitive rehabilitation. After analyzing the state of the art, we will propose a model of multidimensional taxonomy that presents multiple axes along which music tangible user interfaces can be placed. Such a model is expected to help educators, therapists, and interested users choose the best-fitting solution for their specific needs.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Alex, K.: Soft skills. S. Chand Publishing (2009)

    Google Scholar 

  2. Alonso, M.B., Keyson, D.V.: MusicCube: making digital music tangible. In: CHI ’05 Extended Abstracts on Human Factors in Computing Systems, pp. 1176–1179. CHI EA ’05, ACM, New York, NY, USA (2005). https://doi.org/10.1145/1056808.1056870

  3. Amico, M.D., Ludovico, L.A.: Kibo: a MIDI controller with a tangible user interface for music education. In: International Conference on Computer Supported Education, pp. 613–619. SCITEPRESS (2020)

    Google Scholar 

  4. Baratè, A., Korsten, H., Ludovico, L.A.: A music tangible user interface for the cognitive and motor rehabilitation of elderly people. In: Proceedings of the 6th International Conference on Computer-Human Interaction Research and Applications (CHIRA 2022), pp. 121–128. SCITEPRESS - Science and Technology Publications, Lda (2022)

    Google Scholar 

  5. Baratè, A., Korsten, H., Ludovico, L.A., Oriolo, E.: Music tangible user interfaces and vulnerable users: state of the art and experimentation. In: 5th International Conference on CHIRA 2021 and 6th International Conference on CHIRA 2022, Communications in Computer and Information Science, vol. 1882, pp. 1–25. Springer Science and Business Media Deutschland GmbH (2023). https://doi.org/10.1007/978-3-031-41962-1_1

  6. Baratè, A., Ludovico, L.A., Malchiodi, D.: Fostering computational thinking in primary school through a LEGO®-based music notation. In: Procedia Computer Science. Knowledge-Based and Intelligent Information & Engineering Systems: Proceedings of the 21st International Conference, KES 2017, 6–8 September 2017, Marseille, France, vol. 112, pp. 1334–1344 (2017). https://doi.org/10.1016/j.procs.2017.08.018

  7. Bauer, W., Harris, J., Hofer, M.: Music learning activity types (2012). http://activitytypes.wm.edu/MusicLearningATs-June2012.pdf. Accessed 30 Sept 2022

  8. Costanza, E., Shelley, S.B., Robinson, J.: Introducing audio D-touch: a tangible user interface for music composition and performance. In: Proceedings of the 2003 International Conference on Digital Audio EffectsDAFx03 (01/01/03) (2003), https://eprints.soton.ac.uk/270957/

  9. Graham, J., Hull, J.J.: iCandy: a tangible user interface for iTunes. In: CHI ’08 Extended Abstracts on Human Factors in Computing Systems, pp. 2343–2348. CHI EA ’08, ACM, New York, NY, USA (2008). https://doi.org/10.1145/1358628.1358681

  10. Hu, C., Tung, K., Lau, L.: Music Wall: a tangible user interface using tapping as an interactive technique. In: Lee, S., Choo, H., Ha, S., Shin, I.C. (eds.) APCHI 2008. LNCS, vol. 5068, pp. 284–291. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-70585-7_32

    Chapter  Google Scholar 

  11. Ishii, H.: The tangible user interface and its evolution. Commun. ACM 51(6), 32–36 (2008). https://doi.org/10.1145/1349026.1349034

  12. Jordà, S., Geiger, G., Alonso, M., Kaltenbrunner, M.: The reacTable: exploring the synergy between live music performance and tabletop tangible interfaces. In: Proceedings of 1st International Conference on Tangible and Embedded Interaction, pp. 139–146 (2007)

    Google Scholar 

  13. Kim, M.J., Maher, M.L.: The impact of tangible user interfaces on designers’ spatial cognition. Hum.-Comput. Interact. 23(2), 101–137 (2008)

    Article  Google Scholar 

  14. Kumar, V., Dargan, T., Dwivedi, U., Vijay, P.: Note Code: a tangible music programming puzzle tool. In: Proceedings of the 9th International Conference on Tangible, Embedded, and Embodied Interaction, pp. 625–629 (2015)

    Google Scholar 

  15. Ludovico, L.A., Malchiodi, D., Zecca, L.: A multimodal LEGO®-based learning activity mixing musical notation and computer programming. In: MIE 2017: Proceedings of the 1st ACM SIGCHI International Workshop on Multimodal Interaction for Education, pp. 44–48. ACM, New York, NY (2017). https://doi.org/10.1145/3139513.3139519

  16. Miotti, B., Bassani, L., Cauteruccio, E., Morandi, M.: MusicBlocks: an innovative tool for learning the foundations of music. In: CSEDU (1), pp. 475–484 (2022)

    Google Scholar 

  17. Mullett, S.: Lego beats music manipulatives (2017). https://www.letsplaykidsmusic.com/lego-beats-music-manipulatives/. Accessed 30 Sept 2022

  18. National Coalition for Core Arts Standards Archives: what are the national core arts standards? https://www.nationalartsstandards.org/content/national-core-arts-standards. Accessed 10 May 2021

  19. Newton-Dunn, H., Nakano, H., Gibson, J.: Block Jam: a tangible interface for interactive music. J. New Music Res. 32(4), 383–393 (2003)

    Article  Google Scholar 

  20. Oestermeier, U., Mock, P., Edelmann, J., Gerjets, P.: LEGO Music: learning composition with bricks. In: Proceedings of the 14th International Conference on Interaction Design and Children, pp. 283–286. IDC ’15, ACM, New York, NY, USA (2015). https://doi.org/10.1145/2771839.2771897

  21. Paradiso, J.A., Hsiao, K.y., Benbasat, A.: Tangible music interfaces using passive magnetic tags. In: Proceedings of the 2001 Conference on New Interfaces for Musical Expression, pp. 1–4. NIME ’01, National University of Singapore, SGP (2001)

    Google Scholar 

  22. Pedersen, E.W., Hornbæk, K.: mixiTUI: a tangible sequencer for electronic live performances. In: Proceedings of the 3rd International Conference on Tangible and Embedded Interaction, pp. 223–230 (2009)

    Google Scholar 

  23. Peng, H.: Algorithm Rhythm: computational thinking through tangible music device. In: Proceedings of the 6th International Conference on Tangible, Embedded and Embodied Interaction, pp. 401–402. TEI ’12, ACM, New York, NY, USA (2012). https://doi.org/10.1145/2148131.2148234

  24. Potidis, S., Spyrou, T.: Spyractable: a tangible user interface modular synthesizer. In: Kurosu, M. (ed.) HCI 2014. LNCS, vol. 8511, pp. 600–611. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-07230-2_57

    Chapter  Google Scholar 

  25. Presti, G., Adriano, D., Avanzini, F., Baratè, A., Ludovico, L.A.: PhonHarp: a hybrid digital-physical musical instrument for mobile phones exploiting the vocal tract. In: AM’21: Proceedings of the 16th International Audio Mostly Conference: Sonic experiences in the era of the Internet of Sounds, pp. 276–279. ACM International Conference Proceeding Series, ACM (2021). https://doi.org/10.1145/3478384.3478413

  26. Schiettecatte, B., Vanderdonckt, J.: AudioCubes: a distributed cube tangible interface based on interaction range for sound design. In: Proceedings 2nd International Conference on Tangible and Embedded Interaction, pp. 3–10. TEI ’08, ACM, New York, NY, USA (2008). https://doi.org/10.1145/1347390.1347394

  27. Villafuerte, L., Markova, M., Jorda, S.: Acquisition of social abilities through musical tangible user interface: children with autism spectrum condition and the reactable. In: CHI ’12 Extended Abstracts on Human Factors in Computing Systems, pp. 745–760. CHI EA ’12, ACM, New York, NY, USA (2012). https://doi.org/10.1145/2212776.2212847

  28. Waranusast, R., Bang-ngoen, A., Thipakorn, J.: Interactive tangible user interface for music learning. In: 2013 28th International Conference on Image and Vision Computing New Zealand (IVCNZ 2013), pp. 400–405 (2013). https://doi.org/10.1109/IVCNZ.2013.6727048

Download references

Author information

Authors and Affiliations

  1. LIM – University of Milan, via G. Celoria 18, Milan, Italy

    Adriano Baratè & Luca Andrea Ludovico

Authors
  1. Adriano Baratè
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Luca Andrea Ludovico
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Luca Andrea Ludovico .

Editor information

Editors and Affiliations

  1. University of Amsterdam, Amsterdam, The Netherlands

    Stevan Rudinac

  2. Delft University of Technology, Delft, The Netherlands

    Alan Hanjalic

  3. Delft University of Technology, Delft, The Netherlands

    Cynthia Liem

  4. University of Amsterdam, Amsterdam, The Netherlands

    Marcel Worring

  5. Reykjavik University, Reykjavik, Iceland

    Björn Þór Jónsson

  6. Microsoft Research Lab – Asia, Beijing, China

    Bei Liu

  7. The University of Tokyo, Tokyo, Japan

    Yoko Yamakata

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Baratè, A., Ludovico, L.A. (2024). A Multidimensional Taxonomy Model for Music Tangible User Interfaces. In: Rudinac, S., et al. MultiMedia Modeling. MMM 2024. Lecture Notes in Computer Science, vol 14556. Springer, Cham. https://doi.org/10.1007/978-3-031-53311-2_38

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-53311-2_38

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-53310-5

  • Online ISBN: 978-3-031-53311-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation