ABSTRACT
The fusion of music information processing and human physical functions will allow new musical experiences to be created. We developed an interactive music system called “Augmented Percussionists,” which provides users with the experience of playing an automatic musical performance. This system converts music arranged by melody morphing into electrical muscle stimulations (EMS) and controls the body movements of multiple people with devices attached to their hands and feet to realize the performance. The melodies used in the system are divided into segments, and each segment has multiple variations of melodies. The user can control the performers by simply by performing a melody.
- Ayaka Ebisu, Satoshi Hashizume, and Yoichi Ochiai. 2018. Building a feedback loop between electrical stimulation and percussion learning. In In ACM SIGGRAPH 2018 Studio(ISIGGRAPH ’18). ACM, 1–2. Google ScholarDigital Library
- Masatoshi Hamanaka, Keiji Hirata, and Satoshi Tojo. 2007. Implementing ‘A Generating Theory of Tonal Music’. Journal of New Music Research 35, 4 (2007), 249–277.Google ScholarCross Ref
- Fred Lerdahl and linguist Ray Jackendoff. 1983. A Generative Theory of Tonal Music.Cambridge, Massachusetts: MIT Press.Google Scholar
Index Terms
- Augmented Percussionists: A New Musical Experience by Fusion of Melody Morphing and Electrical Muscle Stimulation
Recommendations
Stimulated percussions: method to control human for learning music by using electrical muscle stimulation
AH '17: Proceedings of the 8th Augmented Human International ConferenceIn musical performances, it is important to produce rhythms correctly. However, when beginners play musical instruments, it can be difficult for them to understand rhythms using only visual and auditory rhythm information. To solve this problem, we ...
Building a feedback loop between electrical stimulation and percussion learning
SIGGRAPH '18: ACM SIGGRAPH 2018 StudioA sense of rhythm is essential for playing instruments. However, many beginners learning how to play musical instruments have difficulty with rhythm. We have proposed "Stimulated Percussions," which is a musical instrument performance system using ...
Deep Augmented Performers: A New Ensemble Performance System by Fusion of Melody Morphing and Body Movements
UIST '21 Adjunct: Adjunct Proceedings of the 34th Annual ACM Symposium on User Interface Software and TechnologyThe fusion of music-information processing and human physical functions will enable new musical experiences to be created. We developed an interactive music system called “Deep Augmented Performers,” which provides users with the experience of ...
Comments